Using wget for mirroring

faco · 2009-04-16 14:41:02

Hello everyone,

I have a question. I'm trying to use wget to get all packages from extra, community, and core from one ftp mirror in my country (Chile) to one server on my university, wich I have access at great speed. I'm making this because at home my adsl connection is very slow. The question that I have is if I use "wget -m -b "ftp://mirror.archlinux.cl/extra/os/x86_64/*", the packages will by updated, or, for example, "file-version1.pkg.tar.gz" won't be replaced by "file-version2.pkg.tar.gz" ?

Answers or comments are welcome.

Felipe.

kgas · 2009-04-16 14:50:51

man wget
see the option -nc this will answer your questions.

Xyne · 2009-04-16 14:57:34

Are you creating a public mirror or just a local package cache for yourself?

faco · 2009-04-16 15:06:08

I want a local package cache for myself.

Last edited by faco (2009-04-16 19:58:00)

Allan · 2009-04-16 18:11:23

faco wrote:

You are right Xyne, what I'm trying to do is what you say.

I'm reasonably sure that Xyne asked a question...

fukawi2 · 2009-04-17 00:04:42

faco wrote:

Answers or comments are welcome.

rsync would be much better suited to this IMHO if you have a choice...

Xyne · 2009-04-17 06:31:48

faco wrote:

I want a local package cache for myself.

In that case it's probably unnecessary to mirror the repos. Core might be useful, maybe even extra, but there is very little chance that you'll use more than a small fraction of community and it creates unnecessary load on the mirrors to download GBs of packages on a regular basis that you'll never use anyway.

Take a look at powerpill instead. You can use that where you have a good connection and you should be able to download everything you want very quickly.

Alternatively, consider creating a public repo.

Last edited by Xyne (2009-04-18 05:59:56)

faco · 2009-04-17 18:37:21

Thanks a lot. Powerpill is what I was looking.

Last edited by faco (2009-04-17 18:48:30)

faco · 2009-04-18 17:06:23

I realized that "pacman -Sup > packages.list" is what I was looking for.

Last edited by faco (2009-04-18 23:26:30)

Xyne · 2009-04-19 01:18:19

You could also use "powerpill -Su --get-metalink > packages.metalink"

faco · 2009-04-20 01:47:21

I've tried to make that, but when I run "powerpill -Su --get-metalink", i get nothing, only an absolutly clean output.

Xyne · 2009-04-20 02:21:49

Just to check, you tried "powerpill -Su --get-metalink" and that returned nothing, then immediately after you tried "pacman -Sup" and it printed out a list?

If yes, can you tell me what version of "perl-xyne-arch" you have and if the same thing happens with the latest version the next time you have something to update? You can check what should be listed with "pacman -Qu". If that's empty then there's nothing to upgrade.

Arch Linux

#1 2009-04-16 14:41:02

Using wget for mirroring

#2 2009-04-16 14:50:51

Re: Using wget for mirroring

#3 2009-04-16 14:57:34

Re: Using wget for mirroring

#4 2009-04-16 15:06:08

Re: Using wget for mirroring

#5 2009-04-16 18:11:23

Re: Using wget for mirroring

#6 2009-04-17 00:04:42

Re: Using wget for mirroring

#7 2009-04-17 06:31:48

Re: Using wget for mirroring

#8 2009-04-17 18:37:21

Re: Using wget for mirroring

#9 2009-04-18 17:06:23

Re: Using wget for mirroring

#10 2009-04-19 01:18:19

Re: Using wget for mirroring

#11 2009-04-20 01:47:21

Re: Using wget for mirroring

#12 2009-04-20 02:21:49

Re: Using wget for mirroring

Board footer