Bittorrent & Pacman Idea

Zariel · 2009-03-24 12:32:57

inotify && mktorrent would do the trick no?

godane · 2009-03-24 18:49:28

I think the bitttorrent idea needs be used only for older packages and any packages over 50MB. This way there is more of a reason to save on bandwidth without it being every little package.

PS i was thinking more the line of games, openoffice, etc.

Zariel · 2009-03-24 19:32:13

Old packages would be awesome, hmm when I get home ill put one of my old pcs into use and try some things

z.s.tar.gz · 2009-03-24 22:21:39

The over 50 megs idea was what I was getting at originally.
But, not just individual packages, I'm saying compress all the kde group packages into one file and download that.

Basically, use for old packages, big packages, and package groups.

Nezmer · 2009-03-24 23:56:21

Your suggestion is to make an official archive that contains many packages and use bittorrent to share it .
As already mentioned The main problem here is durability .
1) What If a lot of users are still downloading the archive and a new one arrives ?
2) Creating such an archive would imply that all its contents work . That sounds like a stable mini-release (Something the developers are not welling to put effort into) .

Last edited by Nezmer (2009-03-25 00:00:02)

cpcgm · 2009-03-25 05:53:21

But if you plug this into pacman or on top of it, it will know which packages are old and which are new. I wouldn't use a separate program. And I think it could also work for not too large files. If you get all the downloads of files larger than, let's say 10 MB from the mirrors everyone might benefit.

Xilon · 2009-04-03 16:01:32

genisis300 wrote:

could the tracker not be made by a script as suggested everytime a new package is uploaded a tracker is made at the same time?

Sure, but then you have to download that torrent file first, and then download it using that information. An initial HTTP seed would also have to be used (there's an extension for Bittorrent for that, actually). There are problems though. Is this torrent of the whole repository or is it of a single package? What happens to the old package/repository torrents? Are they archived and continued to be seeded or are the torrents broken? What about the HTTP seeds? Do we keep around every single revision of a repository?

cpcgm wrote:

But if you plug this into pacman or on top of it, it will know which packages are old and which are new. I wouldn't use a separate program. And I think it could also work for not too large files. If you get all the downloads of files larger than, let's say 10 MB from the mirrors everyone might benefit.

Actually it would most likely have to be a separate program anyway. A daemon is the most logical option. Pacman would communicate with the daemon which would do the actual downloading. An alternative option is to use the XferCommand in pacman's config. This would point to the daemon's client, which would queue up the torrents and wait for it to be downloaded.

The purpose for having the daemon is for seeding.

Last edited by Xilon (2009-04-03 16:05:09)

z.s.tar.gz · 2009-04-03 21:23:26

I actually wrote this because my downloads with pacman were super slow, and it turned out I had the wrong mirror commented.

Anyways, I was thinking this:

# bitman -S gnome gnome-extra
searching for group...
donwload group "gnome" and "gnome-extra" ?
500MB [y/n] Y
downloading... 680 k/s
gnome group: done
gnome-extra group: done
sending groups to pacman...
done

(pacman dialogs)

Anyways, I'm done with the idea. If anyone else wants to do anything, go ahead.

jpe30 · 2009-04-05 03:51:05

Yea, there is really no advantage here either. The mirrors max out my connection anyways.

Fackamato · 2009-04-06 09:58:15

jpe30 wrote:

Yea, there is really no advantage here either. The mirrors max out my connection anyways.

I guess one adavantage would be when a new packages gets released, such as Xorg 1.6 or kernel 2.6.30. Then the mirrors would be hammered (well, sometimes), and this would put less load on them.

Another benefit would be that you could get the latest packages even if your mirror hasn't synced yet.

Xilon · 2009-04-07 18:47:15

Fackamato wrote:

jpe30 wrote:
Yea, there is really no advantage here either. The mirrors max out my connection anyways.
I guess one adavantage would be when a new packages gets released, such as Xorg 1.6 or kernel 2.6.30. Then the mirrors would be hammered (well, sometimes), and this would put less load on them.
Another benefit would be that you could get the latest packages even if your mirror hasn't synced yet.

I'm sure that after a while of seeding the load would drop, but it would also drop naturally since less people would upgrade over time. I'd argue that xdeltas would provide a more significant decrease in mirror load.

Arch Linux

#26 2009-03-24 12:32:57

Re: Bittorrent & Pacman Idea

#27 2009-03-24 18:49:28

Re: Bittorrent & Pacman Idea

#28 2009-03-24 19:32:13

Re: Bittorrent & Pacman Idea

#29 2009-03-24 22:21:39

Re: Bittorrent & Pacman Idea

#30 2009-03-24 23:56:21

Re: Bittorrent & Pacman Idea

#31 2009-03-25 05:53:21

Re: Bittorrent & Pacman Idea

#32 2009-04-03 16:01:32

Re: Bittorrent & Pacman Idea

#33 2009-04-03 21:23:26

Re: Bittorrent & Pacman Idea

#34 2009-04-05 03:51:05

Re: Bittorrent & Pacman Idea

#35 2009-04-06 09:58:15

Re: Bittorrent & Pacman Idea

#36 2009-04-07 18:47:15

Re: Bittorrent & Pacman Idea

Board footer