You are not logged in.

#1 2015-12-12 17:43:05

nomorewindows
Member
Registered: 2010-04-03
Posts: 3,362

[Solved] delegate proxy

I'm running delegate which seems to work ok.  It will automatically cache pacman pkgs (whereas there is a wiki on how to do this with squid), but there's some sort of rub, it only caches on the local machine where delegate is running.  If I want it to work on another machine it acts like the proxy isn't there (by setting http_proxy to the delegate server).  But then after awhile, delegate seems to quit working and operates really slow or not at all.  Anybody else used delegate?

Last edited by nomorewindows (2015-12-15 19:11:44)


I may have to CONSOLE you about your usage of ridiculously easy graphical interfaces...
Look ma, no mouse.

Offline

#2 2015-12-12 18:39:22

jasonwryan
Anarchist
From: .nz
Registered: 2009-05-09
Posts: 30,424
Website

Re: [Solved] delegate proxy

Not a Sysadmin issue, moving to Apps and DEs


Arch + dwm   •   Mercurial repos  •   Surfraw

Registered Linux User #482438

Offline

#3 2015-12-12 21:44:47

nomorewindows
Member
Registered: 2010-04-03
Posts: 3,362

Re: [Solved] delegate proxy

I usually have my shared pacman cache mounted on each machine as the proxy doesn't seem to work.  There is always pacserve, but it keeps a copy on the client, and so mounting the shared cache is quicker (and an extra step). 

I can look through the delegate cache and see that the db files and package files are there but for some reason it doesn't pick up on the other network clients. 

Looking at another thread says that using curl in makepkg will work with proxies, so I might try uncommenting the XferCommand in pacman.conf.

Just anything to save having to redownload the same files over and over again from the Internet saves time.


I may have to CONSOLE you about your usage of ridiculously easy graphical interfaces...
Look ma, no mouse.

Offline

#4 2015-12-13 04:04:58

nomorewindows
Member
Registered: 2010-04-03
Posts: 3,362

Re: [Solved] delegate proxy

It looks like wget is the better option.


I may have to CONSOLE you about your usage of ridiculously easy graphical interfaces...
Look ma, no mouse.

Offline

#5 2015-12-14 14:34:05

nomorewindows
Member
Registered: 2010-04-03
Posts: 3,362

Re: [Solved] delegate proxy

Watching the output of wget, it doesn't call the proxy on the official repos, but it wall call the proxy on the unofficial repos for machines other than the proxy server.  The proxy server machine updates the proxy will all of its' requests.  Something doesn't make sense.  Maybe I need to do a pacman --debug to find out why its' doing what it is doing.

Maybe this has something to do with it having to read the mirrorlist file for the official repos, and not for unofficial repos. 

Interestingly enough, the problem with the repo-ck unofficial repo, dropping the connection can be maintained by using wget.  Otherwise, the wiki states using duplicate mirror entries in pacman.conf.

Last edited by nomorewindows (2015-12-14 14:36:51)


I may have to CONSOLE you about your usage of ridiculously easy graphical interfaces...
Look ma, no mouse.

Offline

#6 2015-12-15 19:11:27

nomorewindows
Member
Registered: 2010-04-03
Posts: 3,362

Re: [Solved] delegate proxy

Ok I think I found it.
In pacman.conf I was using https mirror on the client, when I was using http same mirror on the delegate/squid proxy machine and it was working and of course I was only setting http_proxy and not any other proxy variable. 
I probably don't need to use wget or curl as everything seemed to be working fine otherwise.


I may have to CONSOLE you about your usage of ridiculously easy graphical interfaces...
Look ma, no mouse.

Offline

#7 2015-12-27 17:20:49

nomorewindows
Member
Registered: 2010-04-03
Posts: 3,362

Re: [Solved] delegate proxy

I keep getting HTTP_REFERRER error on the bbs here when going through either squid or delegate when using firefox when posting a reply.


I may have to CONSOLE you about your usage of ridiculously easy graphical interfaces...
Look ma, no mouse.

Offline

#8 2016-01-03 22:06:02

nomorewindows
Member
Registered: 2010-04-03
Posts: 3,362

Re: [Solved] delegate proxy

It looks like it might have been firefox, or even some of its' addons having problems.
Looks like WPAD/PAC doesn't really want to work that great, and the proxy switching addon I was using is now not recommended by mozilla (at least not verified).  Using firefox's proxy settings box, behaves a little strange.  Manual configuration of the proxy seems to be the reliable option, as it doesn't totally like the autoconfiguration script method.


I may have to CONSOLE you about your usage of ridiculously easy graphical interfaces...
Look ma, no mouse.

Offline

#9 2016-01-17 18:33:50

nomorewindows
Member
Registered: 2010-04-03
Posts: 3,362

Re: [Solved] delegate proxy

I'm not sure why I would need to run HTTPS through a local proxy.  This seems to be counterproductive.  As far as delegate goes.
Squid doesn't seem to have any problem running proxy on HTTPS.


I may have to CONSOLE you about your usage of ridiculously easy graphical interfaces...
Look ma, no mouse.

Offline

#10 2016-04-18 14:33:44

nomorewindows
Member
Registered: 2010-04-03
Posts: 3,362

Re: [Solved] delegate proxy

Delegate seems to be complaining about libssl brokenness.  So it looks like for now until another update for delegate comes along, it'll be http_proxy=delegate and https_proxy=squid.


I may have to CONSOLE you about your usage of ridiculously easy graphical interfaces...
Look ma, no mouse.

Offline

#11 2016-04-29 15:32:06

nomorewindows
Member
Registered: 2010-04-03
Posts: 3,362

Re: [Solved] delegate proxy

I was running xfs filesystem for /var/spool/delegate separately from everything else.  Apparently it was good that I did so.  Apparently delegate locked up with some Defunct processes showing in top.  I tried to kill them with no avail.  I had several kernel oops related to xfs, so apparently this was the problem.  I couldn't mount the partition as xfs_repair said to do to clear the log as another kernel oops occured.  I ran badblocks on it just to be sure it wasn't a disk problem.  Nothing showed up with badblocks, so apparently it was filesystem corruption as a result of not being able to shutdown due to whatever locked it up in the first place.  So I tried mkfs.xfs to no avail, it would lock up on the same problem as others.  So I tried mkfs.ext4 and successfully cleared it with using a different formatted filesystem.  Xfs hasn't given me that much trouble before, so delegate is pushing it's limits or something.  Occasionally delegate would lock up for no reason and the last time I was able to break it with systemctl emergency and log back in, but not this time.  It also went to emergency shell on restart because it couldn't mount the affected partition.  Possibly this might have been the problem I was having.

Last edited by nomorewindows (2016-04-29 15:33:57)


I may have to CONSOLE you about your usage of ridiculously easy graphical interfaces...
Look ma, no mouse.

Offline

#12 2016-05-20 23:36:12

nomorewindows
Member
Registered: 2010-04-03
Posts: 3,362

Re: [Solved] delegate proxy

Squid has the better network stack, so I've made it the primary and things don't drag.
So I made squid use delegate as a cache_peer with the delegate proxy.
In squid.conf,

cache_peer <delegate IP> parent <delegate port> 0 proxy-only

I used the proxy-only option, so that squid doesn't cache, and using delegate for that.
So now my wpad points to squid, which will pass cache objects back and forth with delegate.
Squid's network stack, with delegates caching.  Looks like this might work.
Squid will work as a proxy for https, while any http cache objects will be caught with delegate.


I may have to CONSOLE you about your usage of ridiculously easy graphical interfaces...
Look ma, no mouse.

Offline

Board footer

Powered by FluxBB