Wiki html page

aikidoist72 · 2005-04-27 05:45:37

I would like to download the entire Wiki index and associated pages to a depth of 3 so I can put it on cd and install Arch on a remote computer. I have the current and extra caches synced and ready to go. I tried this using wget with all the correct parameters, but 3 1/2 hours later I stopped it. Well over 200mb!!! Is there a Wiki package somewhere I can download instead?

cactus · 2005-04-27 06:46:12

I have a wiki extractor that *kinduv* works. The html it generates is a bit wonky, as I haven't fully snagged the phpwiki parser out of a more recent version of phpwiki. The one I snagged out of was 1.2x or something..

It is a python/php hybrid script, and it take a while to run..I have a generated html dir if you would like to have some pages that are snapshotted from a few months ago, when Judd sent me a snapshot of the wiki gdbm..

Like I said, the pages are a bit ugly, but it is better than a poke in the eye..

in total, I think it is about 2.8MB worth..

aikidoist72 · 2005-04-27 10:33:10

G´day Cactus,

Thank´s mate, I will take up your offer if the command below fail miserably.

wget -r -l 2 -k -p http://wiki2.archlinux.org/index.php/WikiIndex

I have downloaded sections of websites before, but I am struggling to understand why this is different. Does the .php have something to do with it? Just out of interest, how do we org the transfer without posting my email address? :oops: Sorry - still a noob!!!

Cheers

cactus · 2005-04-27 18:37:49

I would just pm you the location of the file on my web server.

Anyway, I assume that the problem is twofold. The first fold is that many wiki pages link offsite. Not too bad, you just tell wget not to go offsite..
the real problem is that a wikiword that is not defined, is still a link. It links to a page saying (please define me). On that page, are several self links..all going to "please define me" pages.

I bet it would snag quite a few "please define me" pages.

aikidoist72 · 2005-04-27 23:01:21

Ok, the command above has worked to an extent. I have a wiki folder that is 19.6Mb and 1976 files. I tried doing a search on ¨cactus¨ and was sent to the Archlinux website. All searches send me to a website.

This is a bummer, but on the whole I am quite happy with the outcome. I can keep clicking through linked pages within the wiki, and have all the info I will require.

Thanks for your help cactus. I am not a whizz with web pages, but if I can refine this lot to a reasonable size, I will zip it and send it to you for your site if you wish.

Cheers

cactus · 2005-04-27 23:14:27

sounds good. thanks.

Arch Linux

#1 2005-04-27 05:45:37

Wiki html page

#2 2005-04-27 06:46:12

Re: Wiki html page

#3 2005-04-27 10:33:10

Re: Wiki html page

#4 2005-04-27 18:37:49

Re: Wiki html page

#5 2005-04-27 23:01:21

Re: Wiki html page

#6 2005-04-27 23:14:27

Re: Wiki html page

Board footer