You are not logged in.

#1 2009-02-13 05:14:08

SamC
Member
From: Calgary
Registered: 2008-05-13
Posts: 611
Website

[SOLVED] Recursively download a website?

How would I download all of the files from a website (for example), skipping ones already downloaded? IE, a, b, and c are on the website, and I download them. The maintainer later comes along and adds a new file, d. What would the wget/curl/something else command be to download only d, automatically? I don't care if the file content changes.

I'm trying to get a sort of mirror of all the .ogg files here, and this the only part I can't figure out.

Last edited by SamC (2009-02-23 02:08:25)

Offline

#2 2009-02-13 05:22:25

steve_v
Member
Registered: 2006-02-11
Posts: 80

Re: [SOLVED] Recursively download a website?

pacman -S wget
man wget :-)

something like 'wget -r -np -nc -A .ogg <address>' should do it.

Steve.

Offline

#3 2009-02-13 05:27:18

SamC
Member
From: Calgary
Registered: 2008-05-13
Posts: 611
Website

Re: [SOLVED] Recursively download a website?

Great, thanks. I just wasn't too sure about the whole non-clobbering thing.

Offline

Board footer

Powered by FluxBB