AdblockPlus to Privoxy

Andrwe · 2010-07-09 11:18:02

Hi,

I've written a little script to convert AdblockPlus filterlists for Privoxy usage.
You can find it here.

If there are any suggestions feel free to post them here or on the site.

Regards,
Andrwe

Last edited by Andrwe (2010-09-09 18:13:07)

vacant · 2010-07-09 11:38:40

I'm using chrome and, as I understand it from various posts, the trouble with the adblock extension is that it downloads the adverts then decides not to display them? On my laptop with chrome I decided not to use the adblock extension but instead set up privoxy and polipo-git. Most adverts get killed.

So I was wondering why you decided to write your script e.g. if you had a specific problem with privoxy failing to block certain adverts? Or maybe you visit sites that cleverly get around privoxy?

Andrwe · 2010-07-09 11:49:20

I'm using privoxy I only want to extend the blocking lists of privoxy with the lists of AdblockPlus (which are IMO better maintained) and that is what this script does.

drcouzelis · 2010-07-09 12:50:07

AAAAAUUGH I LOVE YOU!!!!!!1

It was three weeks ago that I was looking for this. I Duck Duck Go'd a lot but didn't find anything. I'm not surprised something this awesome would come from someone involved in the Arch Linux community. I will give it a try when I get home.

Thank you!

vacant · 2010-07-09 12:52:18

Andrwe wrote:

AdblockPlus ... which are IMO better maintained

Fair enough, I'll keep a link to your script in my "linux notes" in case the sites I visit aren't kept clean enough by privoxy, thanks.

surfed · 2010-07-09 14:58:04

vacant wrote:

I'm using chrome and, as I understand it from various posts, the trouble with the adblock extension is that it downloads the adverts then decides not to display them?

Not any more, it now blocks before downloading them.

drcouzelis · 2010-07-09 15:31:36

surfed wrote:

vacant wrote:
I'm using chrome and, as I understand it from various posts, the trouble with the adblock extension is that it downloads the adverts then decides not to display them?
Not any more, it now blocks before downloading them.

That's the opposite of what I understand about Adblock for Chrome. Do you have a source for that information?

Last edited by drcouzelis (2010-07-09 15:50:53)

rebugger · 2010-07-09 16:25:08

https://chrome.google.com/extensions/de … idom?hl=en

Note that Chrome doesn't actually support this all the way, so a few resources might still load before AdBlock can get to them, in which case we'll remove those as usual.

There is still some stuff loaded and hidden...

Your script is awesome - just moved back to privoxy

Atragor · 2010-07-09 19:36:02

Don't AdBlock's lists use syntax that significantly differs from the one used in Privoxy?

For example, the following line from RuAdList AdBlock's subscription doesn't work:

\|\|b\.ddestiny\.ru^

In AdBlock two vertical lines in front of an expression mean the beginning of domain name, but in Privoxy they don't seem to have any special meaning, so this rule isn't applied. Maybe I've missed some configuration option?

Andrwe · 2010-07-09 20:33:31

You are right.
This and some other stuff like @@ = whitelist are things I'll implement correctly in the next version.
I just have started to analyze adblock lists and convert them into privoxy syntax.

Andrwe · 2010-07-21 17:24:00

Just for you to know, unfortunately the power supply of my main computer burned out (was nice fume).
I've written the script using that pc and hadn't commited the newest version to my git where I already had implemented the conversion of about 70 % of the adblock list.
But my vendor told me that I'll get a new power supply till friday so I'll release the next version next week after testing.

Ranguvar · 2010-07-21 18:59:43

sed '/^!.*/d;1,1 d;s/\./\\./g;s/\?/\\?/g;s/#/\\#/g;s/\*/.*/g;s/(/\$/g;s/)/\$/g;s/\[/\\[/g;s/\]/\\]/g;s/|/\\|/g' ${file} >> ${actionfile}

That's some sick sed work right there.
Cheers!

Andrwe · 2010-07-21 19:51:08

Ranguvar wrote:

sed '/^!.*/d;1,1 d;s/\./\\./g;s/\?/\\?/g;s/#/\\#/g;s/\*/.*/g;s/(/\$/g;s/)/\$/g;s/\[/\\[/g;s/\]/\\]/g;s/|/\\|/g' ${file} >> ${actionfile}
That's some sick sed work right there.
Cheers!

Thanks but that is nothing the newest version is more sick/complicated which is why I can't recall all of it and I have to wait for the new power supply.

peets · 2010-08-19 19:04:26

wandaful! Thank you.

zenix · 2010-08-26 19:10:22

Looking at your wiki, it seems like you haven't uploaded the updated version with || and @@ support yet.

I hope the vendor hasn't shorted you! (pun intended)

Andrwe · 2010-08-26 20:58:23

zenix wrote:

Looking at your wiki, it seems like you haven't uploaded the updated version with || and @@ support yet.
I hope the vendor hasn't shorted you! (pun intended)

You're right the new version isn't out.
I'm sorry for the delay but the vendor isn't responsible.
I just have some problems implementing domain-based filters but I've decided that I'll give that to you in the next version so it will be online after the weekend.

Edit: I've uploaded the new version. Fixed the last bug of version 0.2 already (just a little typo which removed the config file ).
To use this version correctly please remove the old action and filter files (**not** match-all.action, user.* and default.*) in your privoxy-config folder and in the config file.

Last edited by Andrwe (2010-08-26 21:13:47)

Army · 2010-09-08 23:12:03

I tried this again and it works perfectly! Thanks a lot man! I've been using firefox with noscript for the last couple of days and with these filters added to privoxy you can really see a huge difference regarding facebook shitness etc. Now I feel a bit safer with jumanji

Last edited by Army (2010-09-08 23:12:18)

jugs · 2010-11-23 14:00:05

I wanted to thank you for this awesome script.
I've moved to Privoxy because of it.
Thanks for such a valuable resource!

litemotiv · 2010-11-23 14:27:50

Very nice script indeed. Has anyone thought about creating an AUR package with a weekly cron update yet?

Andrwe · 2010-11-23 14:42:21

jugs wrote:

I wanted to thank you for this awesome script.
I've moved to Privoxy because of it.
Thanks for such a valuable resource!

No problem.

litemotiv wrote:

Very nice script indeed. Has anyone thought about creating an AUR package with a weekly cron update yet? smile

If you want I can write one and maintain it.

litemotiv · 2010-11-23 14:43:42

Andrwe wrote:

litemotiv wrote:
Very nice script indeed. Has anyone thought about creating an AUR package with a weekly cron update yet?
If you want I can write one and maintain it.

That would be great, thanks.

Andrwe · 2010-11-23 20:44:13

Hmm, I just finished the PKGBIULD but I don't really know which category I should use.
Could you suggest one?

Army · 2010-11-23 21:37:07

Network

Andrwe · 2010-11-23 21:44:30

Ok, thank you.

So here it is:
http://aur.archlinux.org/packages.php?ID=43861
And I've also added it to my repository.

If you encounter some bugs or have feature requests you can post themin the tracker I've just installed:
http://andrwe.org/doku.php/bugtracker/p … ocklist.sh

nXqd · 2010-12-27 10:32:09

Wow, great stuff. I think I won't use adblock anymore.
Privoxy for linux and proxomitron for windows.
Thanks again for great stuff

Arch Linux

#1 2010-07-09 11:18:02

AdblockPlus to Privoxy

#2 2010-07-09 11:38:40

Re: AdblockPlus to Privoxy

#3 2010-07-09 11:49:20

Re: AdblockPlus to Privoxy

#4 2010-07-09 12:50:07

Re: AdblockPlus to Privoxy

#5 2010-07-09 12:52:18

Re: AdblockPlus to Privoxy

#6 2010-07-09 14:58:04

Re: AdblockPlus to Privoxy

#7 2010-07-09 15:31:36

Re: AdblockPlus to Privoxy

#8 2010-07-09 16:25:08

Re: AdblockPlus to Privoxy

#9 2010-07-09 19:36:02

Re: AdblockPlus to Privoxy

#10 2010-07-09 20:33:31

Re: AdblockPlus to Privoxy

#11 2010-07-21 17:24:00

Re: AdblockPlus to Privoxy

#12 2010-07-21 18:59:43

Re: AdblockPlus to Privoxy

#13 2010-07-21 19:51:08

Re: AdblockPlus to Privoxy

#14 2010-08-19 19:04:26

Re: AdblockPlus to Privoxy

#15 2010-08-26 19:10:22

Re: AdblockPlus to Privoxy

#16 2010-08-26 20:58:23

Re: AdblockPlus to Privoxy

#17 2010-09-08 23:12:03

Re: AdblockPlus to Privoxy

#18 2010-11-23 14:00:05

Re: AdblockPlus to Privoxy

#19 2010-11-23 14:27:50

Re: AdblockPlus to Privoxy

#20 2010-11-23 14:42:21

Re: AdblockPlus to Privoxy

#21 2010-11-23 14:43:42

Re: AdblockPlus to Privoxy

#22 2010-11-23 20:44:13

Re: AdblockPlus to Privoxy

#23 2010-11-23 21:37:07

Re: AdblockPlus to Privoxy

#24 2010-11-23 21:44:30

Re: AdblockPlus to Privoxy

#25 2010-12-27 10:32:09

Re: AdblockPlus to Privoxy

Board footer