arson - The HOT AUR search helper

zenix · 2008-06-02 23:24:21

Ya, ok, so it's agreed - add --foreign <repo> & --filter. Actually, the filter is set to the last parameter, but I say second because the shear number of possible results given two generic (when combined, specific) terms. (i.e. aur ruby)

@rson451: Already made it Look at the git log @ gitorious. Can you send me a link to your profile @ gitorious? You seem to be interested in helping development, so adding you as an official developer would be nice I'm taking a peek at aursh, too. Ruby isn't all that fast (for now, come on, 1.9, be declared stable!) but I'm holding out for Aaron/Simo or Matz (main Ruby dev)

@Spooky: Not sure how to get it incremental with the current search architecture. Searching itself is fast, but the downloading of the information isn't. The combined download of information is much, much, much faster. I'll see what I can do, though I'm not sure. The --foreign parameter is probably gonna be stolen after I make a version. Oh well, ya open source

SpookyET · 2008-06-02 23:28:35

zenix wrote:

Ya, ok, so it's agreed - add --foreign <repo> & --filter. Actually, the filter is set to the last parameter, but I say second because the shear number of possible results given two generic (when combined, specific) terms. (i.e. aur ruby)
@rson451: Already made it Look at the git log @ gitorious. Can you send me a link to your profile @ gitorious? You seem to be interested in helping development, so adding you as an official developer would be nice I'm taking a peek at aursh, too. Ruby isn't all that fast (for now, come on, 1.9, be declared stable!) but I'm holding out for Aaron/Simo or Matz (main Ruby dev)
@Spooky: Not sure how to get it incremental with the current search architecture. Searching itself is fast, but the downloading of the information isn't. The combined download of information is much, much, much faster. I'll see what I can do, though I'm not sure. The --foreign parameter is probably gonna be stolen after I make a version. Oh well, ya open source

Process as it downloads.
I've asked yaourt, arson, and aursh to implement '--foreign'. He who does it first wins.

It's pretty easy. I don't know if you use pacman or libpacman:
pacman -Slq "foreign-repo".
pacman -Qqm "real foreign packages"
Add them both to the list.

Last edited by SpookyET (2008-06-02 23:36:08)

zenix · 2008-06-03 00:43:21

@SpookyET: Go to my gitorious page, check out the latest head of my arson.git repo, test the --foreign parameter? I think it's working, but I don't have any candidates for testing it with. Please report back whenever about any bugs Also, as it stands, I'd need to do another recode of the search method to do a process-as-downloads mech. Not as a great of one, but it's still pretty decent in size. Tomorrow?

Anyone else that want's the pull the latest arson whenever is welcome to do so.

Last edited by zenix (2008-06-03 00:58:16)

SpookyET · 2008-06-03 01:03:03

Will do. I just have to figure out how to use git first. I myself prefer and use mercurial because it's multi-platform, written in python with many extensions, and mostly because it doesn't have 200 commands.

zenix · 2008-06-03 01:11:58

heh.

pacman -S git
git clone git://github.com/evaryont/arson.git

Done To update:

git pull

Edit: Using Github now

Last edited by zenix (2008-07-22 00:20:23)

rson451 · 2008-06-03 01:12:26

spooky, i wrote a package build to do the git stuff a while back, but i'm not 100% positive that it still works. there seems to be quite a few changes in the past day or so. if you want i can post it but i cant test right now unfortunately

tested, still works. here you go:

pkgname=arson-git
pkgver=20080602
pkgrel=1
pkgdesc='The HOT AUR search helper (git)'
arch=(i686 x86_64)
url='http://bbs.archlinux.org/viewtopic.php?pid=348138'
license=('GPL')
depends=('ruby' 'rubygems')
makedepends=('git')
conflicts=()
replaces=(arson)
backup=()
install='arson.install'
source=()
md5sums=()

_gitroot="git://gitorious.org/arson/mainline.git"
_gitname="mainline"
_gitfolder="bin"

build() {
  cd $startdir/src
  msg "Connecting to gitorious.org GIT server...."

  if [ -d $startdir/src/$_gitname ] ; then
    cd $_gitname && git-pull origin
    msg "The local files are updated."
  else
    git clone $_gitroot
  fi

  msg "GIT checkout done or server timeout"
  msg "Copying script..."

  cd $startdir

  cp src/$_gitname/$_gitfolder/arson .

  install -d $startdir/pkg/usr/bin
  install -m0755 -t $startdir/pkg/usr/bin/ arson

}

the replaces() thing doesnt work though, just a word of warning, i've never written one before this so there is probably alot wrong with it.

Last edited by rson451 (2008-06-03 01:22:05)

SpookyET · 2008-06-03 01:22:23

Yeah, it's almost identical to mercurial in operation.
Anyway, it's not working for me.
I do know that I have at least one package out of date.

./arson -U --foreign spookyet
Error: No result found

I'm not sure what the bash script is doing, but it's either freezing, or very slow.

Last edited by SpookyET (2008-06-03 01:28:07)

zenix · 2008-06-03 01:24:44

which package is out of date?

also, can you give the contents of /var/lib/pacman/sync/spookyet ? For quicker debugging, you can join rson & I in #archlinux-gamers on freenode

Last edited by zenix (2008-06-03 01:28:09)

SpookyET · 2008-06-03 01:28:31

zenix wrote:

which package is out of date?
also, can you give the contents of /var/lib/pacman/sync/spookyet ? For quicker debugging, you can join rson & I in #archlinux-gamers on freenode

gtk2-globalmenu
vmware-workstation-modules

Last edited by SpookyET (2008-06-03 01:29:09)

Daenyth · 2008-06-04 02:11:12

zenix: Just as a note, the release shell script on your server calls #!/bin/sh, but it uses the $() construct. Either call /bin/bash or use ``; sh doesn't support it. By default sh is a symlink to bash, but you shouldn't rely on it being so.

zenix · 2008-07-06 19:22:41

Alright, Download still isn't fast but now it doesn't spew as much. Yay! Anyways, for those who are still using Arson (thanks!) here is an update, v0.8.6!

Changelog:

arson v0.8.6 (6July2008)
- Added --filter/--foreign options.
- Fixed download: If the package doesn't exist the first time, attempt to 
use the pattern: /packages/<pkg>/<pkg>.tar.gz
- Fixed download: If there are multiple results for a given term, only say
"Not found" if none of the results match the package name.
- Finshed development of arson until AUR JSON is updated (patches are in
testing) unless another bug is found. I still need to create a web site for
arson...

As the log says, I'm done devlopment of arson unless I missed a bug BUT I will continue development after AUR has been updated! The patches are in testing, so it shouldn't be too long but still, don't expect rapid progress (arson is pretty complete for me anyways...)

zenix · 2008-07-21 11:04:09

Yay! Double post! The Vacation release is here!
ChangeLog:

arson v0.8.7 (21July2008)
- I got the development bug, sigh... :)
- Fixed Search: Arson incorrectly displayed the total search result count.
Before, it included results from community (which is still in AUR DB...) and
now it doesn't! This also happens to increase search speed (marginally...)
- Updated error message for 'existing dir' to actually mean something more
instead of being so idioticly general. /me hates himself for stupid error
message
- Return of TODO list! I'm just not using RTM...wow I hate the fact that it
doesn't have nestable todos!
- Shifted the existence check to be the first. No more querying AUR to check
if a package exists THEN checking if we already downloaded it!
- Added a catch for ambiguous options. Primary example: -s vs -S, they are
mostly different, but OptionParser gets confused when I haven't actually
specified the differenced them. Baby.
- Switched search to a progressive search. It was relatively easy. Silly me.
- Count is now at the end of the results.
- Rewrite of search. MUCH faster now, would be even faster with the AUR
patches.
- Color changes for search result notifiers.
- Recursive downloads! Arson checks for dependencies that don't exist within
the pacman cache and checks AUR. It's silent if it can't find it in AUR as
well. If it's in AUR, arson downloads it.
- Generates a list of repositories from /etc/pacman.conf (== Pacman_Conf).
Used with the recursive downloads, soon to be more.
- Removed --filter, now it completeley follows AUR's search engine. If a
keyword pair doesn't work as expected, test in AUR itself before complaining
to me!
- Added long output to Info!
- Misc changes

ogronom · 2008-12-23 04:49:46

PKGBUILD in AUR is broken
looks like everything I needed for working with aur...

rson451 · 2008-12-23 12:15:33

All you need to do is update the md5sums.

Open the PKGBUILD in a text editor and move delete the old md5sums.
Then run makepkg -g >> PKGBUILD

Then makepkg and install.

patroclo7 · 2008-12-23 12:56:47

Arson is nice, thanks for it.
However I have an issue with --foreign [REPO] -U. When i run:

arson --foreign giorgio -U

I get the following:

Searching /var/lib/pacman/sync/giorgio for updates in AUR...
/usr/lib/ruby/gems/1.8/gems/facets-2.5.0/lib/more/facets/version.rb:64:in `<=>': undefined method `<=>' for nil:NilClass (NoMethodError)
        from /usr/lib/ruby/gems/1.8/gems/facets-2.5.0/lib/more/facets/version.rb:63:in `times'
        from /usr/lib/ruby/gems/1.8/gems/facets-2.5.0/lib/more/facets/version.rb:63:in `<=>'
        from /usr/bin/arson:395:in `>'
        from /usr/bin/arson:395:in `pacman_check_aur_updates'
        from /usr/bin/arson:385:in `each'
        from /usr/bin/arson:385:in `pacman_check_aur_updates'
        from /usr/bin/arson:383:in `each'
        from /usr/bin/arson:383:in `pacman_check_aur_updates'
        from /usr/bin/arson:486

'giorgio' is a local repo which actually includes, besides my personal packages, all the packages I build from AUR, so I would be interested to know if there are upgrades for them. 'giorgio' is listed in pacman.conf and all the stuff in /var/lib/pacman/sync/giorgio/ seems to be there. Any tip?

Last edited by patroclo7 (2008-12-23 12:58:53)

mentallaxative · 2008-12-23 15:36:42

patroclo7, try this patch:

*** arson    2008-12-24 00:21:33.000000000 +0900
--- arsonbuggy    2008-12-24 00:31:41.000000000 +0900
***************
*** 402,408 ****
              end
              found_toggle = true
              instver = VersionNumber.new(cache[:v])
!             aurver = VersionNumber.new(aur['Version'])
              puts "#{colorful(name,:bold)} has an update available: #{colorful(version,:red)} -> #{colorful(aur['Version'],:green)}" if aurver > instver
  
          end
--- 402,408 ----
              end
              found_toggle = true
              instver = VersionNumber.new(cache[:v])
!             aurver = VersionNumber.new(aur['results']['Version'])
              puts "#{colorful(name,:bold)} has an update available: #{colorful(version,:red)} -> #{colorful(aur['Version'],:green)}" if aurver > instver
  
          end

I'm new to patching, so I'm not sure if I made that right... in case it doesn't work, you just have to edit the line in the check_aur_updates function. There's one block that starts with pacman -Qm and another that starts with 'for repo in $Options'. aurver is missing the 'results' key just before 'Version'.

Last edited by mentallaxative (2008-12-23 15:37:00)

patroclo7 · 2008-12-23 23:45:51

I added ['results'] in both the blocks and now the error message is shorter:

Searching /var/lib/pacman/sync/giorgio for updates in AUR...
/usr/bin/arson:394:in `pacman_check_aur_updates': undefined method `[]' for nil:NilClass (NoMethodError)
        from /usr/bin/arson:385:in `each'
        from /usr/bin/arson:385:in `pacman_check_aur_updates'
        from /usr/bin/arson:383:in `each'
        from /usr/bin/arson:383:in `pacman_check_aur_updates'
        from /usr/bin/arson:486

mentallaxative · 2008-12-24 04:27:11

Sorry patroclo, I don't think I was clear.... you only add ['results'] to the block that starts with 'for repo in $Options[:foreign]'.

patroclo7 · 2008-12-24 04:40:37

Ok, now my two blocks are as follows:

        `pacman -Qm`.each_line do |line|                                                                                                                                  
                name, version = line.chomp.split                                                                                                                          
                aur = json_open(Aur_Info % name)['results']                                                                                                               
                if aur.kind_of?(Hash) and aur['Version'] != version                                                                                                       
                        found_toggle = true                                                                                                                               
                        instver = VersionNumber.new(version)                                                                                                              
                        aurver = VersionNumber.new(aur['Version'])                                                                                                                                
                        puts "#{colorful(name,:bold)} has an update available: #{colorful(version,:red)} -> #{colorful(aur['Version'],:green)}" if aurver > instver       
                end                                                                                                                                                       
        end                                                                                                                                                               
                                                                                                                                                                          
        for repo in $Options[:foreign]                                                                                                                                    
                puts "Searching #{repo} for updates in AUR..."                                                                                                            
                Dir["#{repo}/*"].each do |pkg|                                                                                                                            
                        desc = File.read("#{pkg}/desc")                                                                                                                   
                        cache = {:v => desc[/^%VERSION%\n(.*)/, 1], :n => desc[/^%NAME%\n(.*)/, 1]}                                                                       
                        aur = json_open(Aur_Info % cache[:n])                                                                                                             
                        if aur['type'] == 'error'                                                                                                                         
                                next                                                                                                                                      
                        end                                                                                                                                               
                        found_toggle = true                                                                                                                               
                        instver = VersionNumber.new(cache[:v])                                                                                                            
                        aurver = VersionNumber.new(aur['Results']['Version'])                                                                                             
                        puts "#{colorful(name,:bold)} has an update available: #{colorful(version,:red)} -> #{colorful(aur['Version'],:green)}" if aurver > instver       
                                                                                                                      
                end

But i get again the following error with 'arson -U --foreign giorgio:

Searching /var/lib/pacman/sync/giorgio for updates in AUR...
/usr/bin/arson:394:in `pacman_check_aur_updates': undefined method `[]' for nil:NilClass (NoMethodError)
        from /usr/bin/arson:385:in `each'
        from /usr/bin/arson:385:in `pacman_check_aur_updates'
        from /usr/bin/arson:383:in `each'
        from /usr/bin/arson:383:in `pacman_check_aur_updates'
        from /usr/bin/arson:486

mentallaxative · 2008-12-24 04:46:16

It's case sensitive. It's 'results', not 'Results'. The json hash is very specific about this.

patroclo7 · 2008-12-24 04:53:45

Ok, now I have 'results' but I get the same error.

ogronom · 2009-02-06 14:55:39

Hi, great program. Everything that I wanted from the program that should work with aur. Still has lots of bugs. Does arson have some website with bugzilla or something like this?

Last edited by ogronom (2009-02-06 15:18:28)

rson451 · 2009-02-06 15:20:04

AFAIK zenix is uing this thread as his 'bugtracker'. If I catch him on irc i'll let him know more posts have been made here.

ogronom · 2009-02-06 19:21:28

Issue with version 0.8.11

$arson -Dk vlc-embed
Downloading package to <skipped>
Found package vlc-embed! Downloading it now...
/usr/bin/arson:260:in `aur_download': undefined method `[]' for nil:NilClass (NoMethodError)
from /usr/bin/arson:260:in `map'
from /usr/bin/arson:260:in `aur_download'
from /usr/lib/ruby/1.8/fileutils.rb:121:in `chdir'
from /usr/lib/ruby/1.8/fileutils.rb:121:in `chdir'
from /usr/bin/arson:207:in `aur_download'
from /usr/bin/arson:200:in `each'
from /usr/bin/arson:200:in `aur_download'
from /usr/bin/arson:197:in `each'
from /usr/bin/arson:197:in `aur_download'
from /usr/bin/arson:482

ogronom · 2009-02-06 19:48:34

version 0.8.11

$ arson -Dkf midori-git
Downloading package to /home/illarion/packages
Found package midori-git! Downloading it now...
Error: No results found

Why Error? Everything downloaded.

Arch Linux

#76 2008-06-02 23:24:21

Re: arson - The HOT AUR search helper

#77 2008-06-02 23:28:35

Re: arson - The HOT AUR search helper

#78 2008-06-03 00:43:21

Re: arson - The HOT AUR search helper

#79 2008-06-03 01:03:03

Re: arson - The HOT AUR search helper

#80 2008-06-03 01:11:58

Re: arson - The HOT AUR search helper

#81 2008-06-03 01:12:26

Re: arson - The HOT AUR search helper

#82 2008-06-03 01:22:23

Re: arson - The HOT AUR search helper

#83 2008-06-03 01:24:44

Re: arson - The HOT AUR search helper

#84 2008-06-03 01:28:31

Re: arson - The HOT AUR search helper

#85 2008-06-04 02:11:12

Re: arson - The HOT AUR search helper

#86 2008-07-06 19:22:41

Re: arson - The HOT AUR search helper

#87 2008-07-21 11:04:09

Re: arson - The HOT AUR search helper

#88 2008-12-23 04:49:46

Re: arson - The HOT AUR search helper

#89 2008-12-23 12:15:33

Re: arson - The HOT AUR search helper

#90 2008-12-23 12:56:47

Re: arson - The HOT AUR search helper

#91 2008-12-23 15:36:42

Re: arson - The HOT AUR search helper

#92 2008-12-23 23:45:51

Re: arson - The HOT AUR search helper

#93 2008-12-24 04:27:11

Re: arson - The HOT AUR search helper

#94 2008-12-24 04:40:37

Re: arson - The HOT AUR search helper

#95 2008-12-24 04:46:16

Re: arson - The HOT AUR search helper

#96 2008-12-24 04:53:45

Re: arson - The HOT AUR search helper

#97 2009-02-06 14:55:39

Re: arson - The HOT AUR search helper

#98 2009-02-06 15:20:04

Re: arson - The HOT AUR search helper

#99 2009-02-06 19:21:28

Re: arson - The HOT AUR search helper

#100 2009-02-06 19:48:34

Re: arson - The HOT AUR search helper

Board footer