You are not logged in.

#76 2011-04-09 06:03:31

lolilolicon
Member
Registered: 2009-03-05
Posts: 1,722

Re: cower and burp: fast and simple AUR {up,down}loading

cower has evolved quite much since last time I checked. Good job falconindy.

Some features I'd like to see:

  1. Option to sort --search and --msearch results by number of votes (descendent).

  2. Add an indicator to signal "Out of Date" in search results, when color's off. Maybe just a simple * or [x] at the end.

  3. For --msearch option, print only "Out of Date" packages, making life easier for AUR package maintainers.

These are what I consider useful options (which I implemented in dzlad back when learning a bit of Ruby).

Thanks for your work.


This silver ladybug at line 28...

Offline

#77 2011-04-09 13:58:21

Mad Fish
Member
Registered: 2009-09-22
Posts: 295

Re: cower and burp: fast and simple AUR {up,down}loading

Bug report: cower doesn't respect http_proxy environment variable.

Offline

#78 2011-04-09 14:49:40

falconindy
Developer
From: New York, USA
Registered: 2009-10-22
Posts: 4,111
Website

Re: cower and burp: fast and simple AUR {up,down}loading

Mad Fish wrote:

Bug report: cower doesn't respect http_proxy environment variable.

Closed: not a bug.

connections by default use https, so you need to https_proxy or all_proxy. Alternatively, use --nossl or set NoSSL in the config.

Offline

#79 2011-04-09 14:54:33

falconindy
Developer
From: New York, USA
Registered: 2009-10-22
Posts: 4,111
Website

Re: cower and burp: fast and simple AUR {up,down}loading

lolilolicon wrote:

cower has evolved quite much since last time I checked. Good job falconindy.

Some features I'd like to see:

  1. Option to sort --search and --msearch results by number of votes (descendent).

  2. Add an indicator to signal "Out of Date" in search results, when color's off. Maybe just a simple * or [x] at the end.

  3. For --msearch option, print only "Out of Date" packages, making life easier for AUR package maintainers.

These are what I consider useful options (which I implemented in dzlad back when learning a bit of Ruby).

Thanks for your work.

Noted. The second I'm definitely interested in fixing. The first and the third can already be done with the --format flag and some other unix tools, so I'm not convinced I'll be adding those.

Offline

#80 2011-04-09 15:42:46

lolilolicon
Member
Registered: 2009-03-05
Posts: 1,722

Re: cower and burp: fast and simple AUR {up,down}loading

falconindy wrote:

...can already be done with the --format flag and some other unix tools...

Yes, --format is indeed a good idea! Thanks for the tip.
Before you officially implement any of my requests, I can just use this hack:

search_sort_by_votes()
{ 
    cower -s "${1}" --format='aur/%n %v (%o)%t%%%d\n' | sort -nr -k2 -t'(' | sed 's/no%/\n    /;s/yes%/ [x]\n    /'
}
list_flagged_pkgs() 
{ 
    cower -m "${1}" --format='%n %t\n' | grep --color=auto ' yes$' | cut -d\  -f1
}

Looking forward to seeing request 2 implemented in the next release smile


This silver ladybug at line 28...

Offline

#81 2011-04-09 21:30:21

falconindy
Developer
From: New York, USA
Registered: 2009-10-22
Posts: 4,111
Website

Re: cower and burp: fast and simple AUR {up,down}loading

lolilolicon wrote:

Looking forward to seeing request 2 implemented in the next release smile

Done. I'd like to tag a new release soon anyways, since -git currently has proper and'ed searching. Maybe by the end of the weekend, depending on how work goes tomorrow.

Last edited by falconindy (2011-04-09 21:30:41)

Offline

#82 2011-04-10 21:55:26

falconindy
Developer
From: New York, USA
Registered: 2009-10-22
Posts: 4,111
Website

Re: cower and burp: fast and simple AUR {up,down}loading

It's tagtacular sunday. Hrmm.. that would have been a lot more awesome on Tuesday. Anyways, new versions of burp and cower! Mostly bug fixes and some maintenance items...

Highlights

cower 3.0.2:

  • Searching is now and'ed, similar to how pacman works. Results will match all provided search terms.

  • A small tag <!> will be displayed when operating with color to denote an out of date package (thanks lolilolicon).

  • Some minor bug fixes and tweaks along the way as a result of the endless stream of questionable Bash that I unearth in the AUR.

burp 1.6.3

  • Nothing to see here. Just a lot of refactoring of old, bad code. Fixed a couple of bugs and a crash, too.

Enjoy! As always, bug reports can be posted on Github, or you might catch me on IRC in #archlinux.

Offline

#83 2011-04-15 01:16:51

skottish
Forum Fellow
From: Here
Registered: 2006-06-16
Posts: 7,942

Re: cower and burp: fast and simple AUR {up,down}loading

I apologize if this has been answered here, but long threads are a pain if search terms are too general.

bauerbill had the --aur-only switch was very useful in cases like cdrtools where cdrkit has cdrtools as a provides line. The options listed in the man page for cower don't seem to cover this in any convenient way. Either I'm missing something or this is a feature request.

Last edited by skottish (2011-04-15 01:17:20)

Offline

#84 2011-04-15 01:23:57

falconindy
Developer
From: New York, USA
Registered: 2009-10-22
Posts: 4,111
Website

Re: cower and burp: fast and simple AUR {up,down}loading

Whoa... that's fairly inconsistant on my part. 'cower -i cdrtools' will indeed show cdrtools in the AUR, but -d fails to grab it. I should be doing a direct query on the binary repos, not using a resolver.

In the meantime, you can get around this behavior by using 'cower -d cdrtools --ignorerepo extra'

Offline

#85 2011-04-15 01:30:58

skottish
Forum Fellow
From: Here
Registered: 2006-06-16
Posts: 7,942

Re: cower and burp: fast and simple AUR {up,down}loading

falconindy wrote:

Whoa... that's fairly inconsistant on my part. 'cower -i cdrtools' will indeed show cdrtools in the AUR, but -d fails to grab it. I should be doing a direct query on the binary repos, not using a resolver.

In the meantime, you can get around this behavior by using 'cower -d cdrtools --ignorerepo extra'

Thanks for the quick reply.

I saw that option and it's not a big deal to use because I know where things are coming from, but it would be cool to not have to think about it. cdrtools is one of the few AUR packages that I use that I haven't rewritten for my needs, so this is an edge case where I discover these things.

Offline

#86 2011-04-15 02:12:29

falconindy
Developer
From: New York, USA
Registered: 2009-10-22
Posts: 4,111
Website

Re: cower and burp: fast and simple AUR {up,down}loading

I realize now why cower behaves as it does for downloads, and it's a bit of a tricky situation. Instead, I think I'm going to change --ignorerepo to make the argument optional. If it's not specified, then all binary repos are ignored. This is only true of the command line option, and the config file option 'IgnoreRepo' remains unchanged. The command line opt will, of course, prevail over the config file.

Give me some time to test this to make sure I'm not breaking anything else in the process and I'll push it out.

edit: pushed

Last edited by falconindy (2011-04-15 12:39:32)

Offline

#87 2011-04-20 02:20:19

skottish
Forum Fellow
From: Here
Registered: 2006-06-16
Posts: 7,942

Re: cower and burp: fast and simple AUR {up,down}loading

The curl upgrade in testing has seemed to caused some issues. I don't know enough about either to suggest where the problem lies:

~ > cower -u
error: curl: Server returned nothing (no headers, no data)

The error message is repeated.

Last edited by skottish (2011-04-20 02:23:31)

Offline

#88 2011-04-20 02:26:31

falconindy
Developer
From: New York, USA
Registered: 2009-10-22
Posts: 4,111
Website

Re: cower and burp: fast and simple AUR {up,down}loading

hrmmm, cannot reproduce? That's really weird -- everything is kosher here. The only release day bug in curl was curl-config not reporting version correctly, but that definitely doesn't affect us. There was no soname bump either. Can you post an strace?

Offline

#89 2011-04-20 02:34:13

ngoonee
Forum Fellow
From: Between Thailand and Singapore
Registered: 2009-03-17
Posts: 7,354

Re: cower and burp: fast and simple AUR {up,down}loading

Works fine here as well, perhaps connectivity issue?


Allan-Volunteer on the (topic being discussed) mailn lists. You never get the people who matters attention on the forums.
jasonwryan-Installing Arch is a measure of your literacy. Maintaining Arch is a measure of your diligence. Contributing to Arch is a measure of your competence.
Griemak-Bleeding edge, not bleeding flat. Edge denotes falls will occur from time to time. Bring your own parachute.

Offline

#90 2011-04-20 03:07:49

skottish
Forum Fellow
From: Here
Registered: 2006-06-16
Posts: 7,942

Re: cower and burp: fast and simple AUR {up,down}loading

Another local phantom... I'll do some research and report my findings.

Offline

#91 2011-04-20 03:27:31

skottish
Forum Fellow
From: Here
Registered: 2006-06-16
Posts: 7,942

Re: cower and burp: fast and simple AUR {up,down}loading

falconindy wrote:

hrmmm, cannot reproduce? That's really weird -- everything is kosher here. The only release day bug in curl was curl-config not reporting version correctly, but that definitely doesn't affect us. There was no soname bump either. Can you post an strace?

Whoops, of course:

http://pastebin.com/AtpkcBVM

Offline

#92 2011-04-20 03:32:55

falconindy
Developer
From: New York, USA
Registered: 2009-10-22
Posts: 4,111
Website

Re: cower and burp: fast and simple AUR {up,down}loading

skottish wrote:
falconindy wrote:

hrmmm, cannot reproduce? That's really weird -- everything is kosher here. The only release day bug in curl was curl-config not reporting version correctly, but that definitely doesn't affect us. There was no soname bump either. Can you post an strace?

Whoops, of course:

http://pastebin.com/AtpkcBVM

Boring, since I didn't ask for strace -f (follow threads). Not sure it's going to yield anything anyways, but thanks for humoring me. If it happens again, keep something else nearby to see if maybe it's the AUR being silly, e.g.

aget () { 
    for pkg in "$@"; do
        if curl -s "https://aur.archlinux.org/packages/$pkg/$pkg.tar.gz" | tar xz 2> /dev/null; then
            echo ":: downloaded $pkg"
        else
            echo ":: $pkg not found"
        fi
    done
}

Offline

#93 2011-04-20 04:13:05

skottish
Forum Fellow
From: Here
Registered: 2006-06-16
Posts: 7,942

Re: cower and burp: fast and simple AUR {up,down}loading

http instead of https, no?

Offline

#94 2011-04-20 10:01:23

falconindy
Developer
From: New York, USA
Registered: 2009-10-22
Posts: 4,111
Website

Re: cower and burp: fast and simple AUR {up,down}loading

Well, adjust to your liking. If you're using --nossl with cower, then change it to http.

Offline

#95 2011-04-20 21:30:41

falconindy
Developer
From: New York, USA
Registered: 2009-10-22
Posts: 4,111
Website

Re: cower and burp: fast and simple AUR {up,down}loading

@skottish: are you behind a proxy? Found this on the curl ML just now

https://github.com/bagder/curl/commit/c … b1358a5988

and reported on our end: https://bugs.archlinux.org/task/23863. This is definitely the cause -- I fired up squid and can recreate this. Patched curl works as expected.

Last edited by falconindy (2011-04-20 23:51:49)

Offline

#96 2011-04-21 02:02:35

skottish
Forum Fellow
From: Here
Registered: 2006-06-16
Posts: 7,942

Re: cower and burp: fast and simple AUR {up,down}loading

falconindy wrote:

@skottish: are you behind a proxy? Found this on the curl ML just now

https://github.com/bagder/curl/commit/c … b1358a5988

and reported on our end: https://bugs.archlinux.org/task/23863. This is definitely the cause -- I fired up squid and can recreate this. Patched curl works as expected.

Beautiful. If I were to find out that yet another program that I use was doomed to brokenness by the world not cooperating with proxies (privoxy here), I would be forced barf violently. You stopped my impending violent barfing. I owe you a debt of gratitude my friend.

Thanks.

Offline

#97 2011-04-23 02:08:29

rekado
Member
From: Shanghai, China
Registered: 2009-01-13
Posts: 98
Website

Re: cower and burp: fast and simple AUR {up,down}loading

Just chiming in to say that I really enjoy using cower. I often find myself editing packages from the AUR, so cower with its clear restriction to downloading from the AUR is the best tool for the job. I never liked how pacman wrappers blurred the lines between the AUR and the official repos (as you can easily fall into the trap of dismissing warnings).
Thanks for sharing!

Offline

#98 2011-04-26 15:07:28

falconindy
Developer
From: New York, USA
Registered: 2009-10-22
Posts: 4,111
Website

Re: cower and burp: fast and simple AUR {up,down}loading

FYI, cower 3.0.3 is in the AUR to build against yajl 2.0.0. However, there's an ugly bug in yajl that pops up when the json parser receives no input. In cower, this means when curl hits a timeout and has no response JSON. Not everyone will hit this, but I suggest lowering your thread usage (below 10) until this gets fixed upstream.

I've a bug report in upstream.

update: Bug is fixed in yajl 2.0.0-2, and I've pushed a small adjustment for cower-git as well.

Last edited by falconindy (2011-04-26 16:12:06)

Offline

#99 2011-07-30 14:01:58

anonymous_user
Member
Registered: 2009-08-28
Posts: 3,059

Re: cower and burp: fast and simple AUR {up,down}loading

When I use cower to check AUR packages for updates, I get a lot of "Couldn't resolve host name" and "Timeout was reached" messages. After troubleshooting a bit, the cause seems to be the (high?) number of threads used by cower. I tweaked the cower config to have "MaxThreads = 1" (2 works too) and the errors went away.

I suppose this is why having a user config exists, however I have to ask if the default value works for everyone else (thus the problem is at my end) or if anyone else experienced this.

Offline

#100 2011-07-30 14:25:46

falconindy
Developer
From: New York, USA
Registered: 2009-10-22
Posts: 4,111
Website

Re: cower and burp: fast and simple AUR {up,down}loading

I've heard this before, but not frequently enough for me to be inclined to change it. This isn't something that you encounter often; it should, realistically, be only when checking updates. cower is smart enough to use less than --threads if it doesn't need to.

Offline

Board footer

Powered by FluxBB