Forum:Database

<<< Back to Illogical Zone • <<< Back to Forum

I think I know how we can get a copy of the wiki without the thing being up or without carlb's help. I just don't know how to do it. Not that it was my idea; a giant jerkwad suggested making a bot go through it all and... I dunno, export the pages, or something, and he offered to help make it, so it's an option regardless of my cluelessness, and someone else here might be able to do somat as well if need or want be. And that would also not require that the rendered pages load at all; the pages are definitely still there when it's like this. They just don't want to render.

Question is, would we have anywhere to put it? How big and how much would a server have to be and be able to handle to manage a place like this? ~ 05:01, 9 Jumbly 2011

The text alone shouldn't be very large. War and Peace is 3 MB. Text is no big deal to store. The images on the other hand, could be several gigs. --Nerd42 15:12, 9 Jumbly 2011 (UTC)

War and Peace doesn't have revision history. And what about processing, and the database itself, and the internet connection? And even if we all had direct access to the server and the database, would we know what to do with it without making things worse when problems arise? ~ 15:38, 9 Jumbly 2011

For each export, the server will hit the database to get the revisions. The exporter is slow, back when we were on editthis, the exporter was viable. Having wrestled with it in the past, i can tell you that it is only good for a handful of articles before it falls over. --Silent PenguinLeave Me Alone 17:23, 9 Jumbly 2011 (UTC)

Yeah but as I understand it, the revision history really only stores the changes, not the entire article for each revision. --Nerd42 18:39, 9 Jumbly 2011 (UTC)

You are trying to argue against experience. Although theoretically that could be true, exporting even a few reasonable articles has a lot more data than you might expect. The exporter puts the article revisions into an XML format, with a fair amount of overhead for each revision (plus the changes themselves for each diff, removals, additions, variations, all of which require positions, timestamps, users etc. ). lets start putting some numbers on this, there are 25,515 pages which need exporting of which (taking rough assumptions, 3.1 million page views at 20 views for every edit, rounding based on the statistics page) there are a total of one hundred and fifty five thousand individual revisions, each with their own overhead. Along with over a thousand images. It's alot of data. --Silent PenguinLeave Me Alone 20:33, 9 Jumbly 2011 (UTC)

Otay it wills makes ur computers EXPLODE --Nerd42 02:55, 11 Jumbly 2011 (UTC)

How much data? ~ 06:48, 11 Jumbly 2011

What about dumping this site on a new server? Sincerely, islandmonkey - go speak 07:25, 11 Jumbly 2011 (UTC)

My sig has gone all weird for me, and Kahless's page is missing the Klingon logo. CHANGE THIS NOW!!! ~Dan

The problems with images appear to have been caused by a bad hard drive, http://jpe.gs is back now. Perhaps the main page should be reverted to what passed for normal? --Carlb 09:25, 12 Jumbly 2011 (UTC)

Good to hear, glad it's all sorted out, Thank you carlb.--Silent PenguinLeave Me Alone 15:35, 12 Jumbly 2011 (UTC)

Everybody say tanks

Tanks Carlb! Probably Prism Tanks. Or maybe Gattling - I always did like playing as Yuri --Nerd42 11:44, 12 Jumbly 2011 (UTC)