tupac (TUrbo PACman) - a cached pacman implementation. UPDATED 0.5.6.1

Pajaro · 2007-10-16 22:06:27

Now if I'd have an alias file for pacman to use always the fastest option (yaourt, tupac, pacman for aur, searching, installing) I'd be happy ^^

I wouldn't do that, since tupac only does searches and finds package owners, you would loose many pacman functionalities. It could be updated to passthrough when it receives unkown parameters, but i like the idea of you knowing what does pacman do, what does yaourt do, and what does tupac do.

But, of course, if you convince me i could implement it

Pajaro · 2007-10-17 08:41:41

0.2.5 UPDATE:
- Removed unnecessary prompts.
- Added --checkdir functionality:
* it checks if in the the provided directory any packages misses any file.
* It is intended to help you recover your system from mistakes/errors.
* It has a progress indicator.
* Following tupac philosophy, it is incredibly fast

[franki@patito abs.local]$ time tupac --checkdir /
==> Reusing existing TUPAC_CACHE
==> Reusing existing file list
==> Looking for missing files in directory /
/usr/share/soundfonts/ is missing in fluidr3
/usr/share/soundfonts/fluidr3/ is missing in fluidr3
/usr/share/soundfonts/fluidr3/FluidR3-Readme.doc is missing in fluidr3
/usr/share/soundfonts/fluidr3/FluidR3GM.SF2 is missing in fluidr3
/var/cache/pdnsd/pdnsd.cache is missing in pdnsd
/usr/share/icons/hicolor/16x16/stock/navigation/ is missing in hicolor-icon-theme
/usr/share/icons/hicolor/22x22/actions/ is missing in hicolor-icon-theme
/usr/share/icons/hicolor/32x32/actions/ is missing in hicolor-icon-theme
/usr/share/icons/hicolor/64x64/actions/ is missing in hicolor-icon-theme
/var/lib/openldap/openldap-data/ is missing in openldap
/var/lib/openldap/openldap-data/DB_CONFIG.example is missing in openldap
/var/lib/openldap/openldap-slurp/ is missing in openldap
/var/lib/openldap/run/ is missing in openldap
/tmp/ttf-ms-fonts/ is missing in ttf-ms-fonts
/tmp/ttf-ms-fonts/andale32.exe is missing in ttf-ms-fonts
/tmp/ttf-ms-fonts/arial32.exe is missing in ttf-ms-fonts
/tmp/ttf-ms-fonts/arialb32.exe is missing in ttf-ms-fonts
/tmp/ttf-ms-fonts/comic32.exe is missing in ttf-ms-fonts
/tmp/ttf-ms-fonts/courie32.exe is missing in ttf-ms-fonts
/tmp/ttf-ms-fonts/georgi32.exe is missing in ttf-ms-fonts
/tmp/ttf-ms-fonts/impact32.exe is missing in ttf-ms-fonts
/tmp/ttf-ms-fonts/times32.exe is missing in ttf-ms-fonts
/tmp/ttf-ms-fonts/trebuc32.exe is missing in ttf-ms-fonts
/tmp/ttf-ms-fonts/verdan32.exe is missing in ttf-ms-fonts
/tmp/ttf-ms-fonts/wd97vwr32.exe is missing in ttf-ms-fonts
/tmp/ttf-ms-fonts/webdin32.exe is missing in ttf-ms-fonts
99.9%%
real    0m6.184s
user    0m3.533s
sys     0m1.597s

As you see, it helped me find some issues in my filesystem.

Last edited by Pajaro (2007-10-17 08:43:03)

Pajaro · 2007-10-17 09:21:03

UPDATE 0.2.6:
- Added a message recommending you to run tupac --checkdir as root to get real information.

Pajaro · 2007-10-18 10:43:07

0.2.7 UPDATES:
- Added --orphans option that finds files with no owner in a directory.
- Fixed symlinks processing.

Pajaro · 2007-10-18 10:55:26

--orphans performance test (once system cached)

i have around 127K files in /usr and it finds around 478 orphans.

[franki@patito ~]$ time tupac --orphans /usr>/dev/null

real    0m7.680s
user    0m5.313s
sys     0m1.397s

Pajaro · 2007-10-18 11:18:54

Found a bug when filenames have an interrogation sign (?).

pacman also has this bug.

Nothing is going to be done about it until i get some answer from archlinux bug tracker (i want to keep tupac consistent with pacman).

Mikko777 · 2007-10-18 14:18:51

Pajaro wrote:

Now if I'd have an alias file for pacman to use always the fastest option (yaourt, tupac, pacman for aur, searching, installing) I'd be happy ^^
I wouldn't do that, since tupac only does searches and finds package owners, you would loose many pacman functionalities. It could be updated to passthrough when it receives unkown parameters, but i like the idea of you knowing what does pacman do, what does yaourt do, and what does tupac do.
But, of course, if you convince me i could implement it

Will pretty please be enough or do i need to offer girls and money too?

Pajaro · 2007-10-18 15:16:59

Well, since i already achieved my initial objectives, i will work on the alias transparency.

Pajaro · 2007-10-19 11:44:28

UPDATE 0.2.8:
- Fixed external programs behaivour. Now pacman progress bars and vi behave normally.

Pajaro · 2007-10-19 13:35:35

NEXT STEP: Implement the possibility of using tupac as an alias for pacman.

Pajaro · 2007-10-20 12:01:36

0.2.9 UPDATE:
- Support for "alias pacman=tupac"
- Show in search results what packages of AUR are SAFE.
- Improved subprocess handling (now control+c actually kills the child process).
- Slightly improved performance.
BUG FIXES:
- Fix filename handling when it contains ? or $ (it treats them properly, but it stills shows strange output when one if this files is to be printed).
- Fix symbolic links recognition when searching for file owner.

Pajaro · 2007-10-20 12:11:04

0.2.9.1 UPDATE:
- fix typo errors in child program calling function.

Mikko777 · 2007-10-20 16:17:54

Huge thanks! Finally I got pacman on steroids (pacman, yaourt, tupac ^^) AND
it works as it should, like this:

mikko@desktop:~$ alias pacman='tupac'
mikko@desktop:~$ pacman -Ss pallavi
==> Reusing existing TUPAC_CACHE
1 aur/pallavi 0.6b1-1 (SAFE) - This is the installed version
    Extensible Text Editor
mikko@desktop:~$ pacman -S pallavi
==> Resuming previous build

==> Downloading pallavi PKGBUILD from AUR...

Thanks and keep up the good work!

Pajaro · 2007-10-20 16:29:28

you are welcome

Pajaro · 2007-12-02 21:12:18

New beta version with incremental cache. You can find it here:
http://lapacaloca.com/arch/tupac-beta

After some time away form tupac i continued its development a bit. I decided to add incremental cache because in the moments in which you would feel more the need of the cache (checking which of the games was the coolest to play in that moment ) it keep updating cache after each installation, and i got annoyed.

I am gonna be using it for some days before updating AUR. Meanwhile, you can try it using the previous link.

On any issues you may find give me some feedback

Pajaro · 2007-12-02 21:22:58

I added a page on the wiki:
http://wiki.archlinux.org/index.php/TuPac

toofishes · 2007-12-03 02:44:12

Just wanted to set the record straight here- pacman is not all that slow once you allow it to load its file cache.

pacman 3.1/git search for kde:

$ time pacman -Ss kde > /dev/null

real    0m0.658s
user    0m0.337s
sys     0m0.273s

pacman 3.1/git file ownership:

$ time pacman -Qo $(find /bin -type f) > /dev/null

real    0m2.567s
user    0m2.340s
sys     0m0.067s

pacman 3.1/git (oh, and 3.0.X and earlier too) regexp search:

"3d game"
$ pacman -Ss "3d game" | grep '^[a-z]' | wc -l
1

"3d" OR "game"
$ pacman -Ss 3d game | grep '^[a-z]' | wc -l
133

"3d" AND "game"
$ pacman -Ss "(3d.*game|game.*3d)" | grep '^[a-z]' | wc -l
10

Pajaro · 2007-12-03 09:54:45

Just wanted to set the record straight here- pacman is not all that slow once you allow it to load its file cache.

The point of tupac is that it has a single file for database cache, and a single file for file_list cache. So it is fast even if you have few ram or you are working with heavy tasks.

the 0.658 seconds of pacman searches when database is in disk cache is nothing new. When i developed tupac i didn't want to make it slower than pacman, so that was my time reference. tupac is 3 times faster and also shows you if the program is installed in the same results.

the finding file owners is very good news. Based on your information it will get faster than tupac. Let's see what i get when the development version comes out

i wanted to make tupac simple. Let me give an example:

tupac 3d battle game
V.S.
pacman -Ss "(3d.*battle.*game|3d.*game.*battle|game.*3d.*battle|game.*battle.*3d|battle.*3d.*game|battle.*game.*3d)"

In the first versions of tupac you also could use regular expressions. I will give it back if somebody asks for it.

EDIT: I had to type the word battle so many times in the pacman example that i had made a misspelling

Last edited by Pajaro (2007-12-03 10:10:16)

Pajaro · 2007-12-03 10:51:31

Beta updated:
http://lapacaloca.com/arch/tupac-beta
There was a bug setting the installation information in incremental cache update.

ibendiben · 2007-12-07 13:06:33

Pajaro wrote:

PS: I am open to any comments/issues/improvements you may have/suggest.

Great work man! Good thing one tiny package corruption doesn't nessesarily quit the whole installation of other packages.
My suggestion:
Couldn't you implement (some sort of) pacmenu in there? I know talking about a gui is not-done with archlinux, but with speed and keep it simple thoughts in mind I think a konsole driven menu would make things better. Espessially after fresh install, when you need to install a whole lot of packages and would have to type in (and remember) every single packagename. It would be a great option to have some sort of category menulist to select multiple packages from (like with installing the base packages, plus some packages of support and lib in the current installer). The same counts for removing packages. A simple list of installed packages where you can select the ones you want to remove would be quicker in my opinion then query a list first and then type in the packages you don't like from it anymore.

I read through you pajman topic too. There I read a todo post where you mention something about a gui... That plus a further comment that you are convincable to implement other options aswell made me have the balls to do the menu request here. Where I asked if you couldn't, I actually thought you could but needed the right arguments... I hope I can convince you somehow the menu thing would make tupac even better

regards and keep up the good work!
Ben

Pajaro · 2007-12-07 13:41:26

ibendiben,

Thank you very much!

One of the ideas around tupac is to create something like "tupac-gui-helper", that would be an implemetation of tupac the is made to communicate comfortably with gui applications. This would imply the creation of a lib directory for tupac, so that both gui-helper and command line tool use the same code. By now, creating the gui by myself is not in my plans. I am still concentrating on more basic features (like how to speed up cache updates when a packages was installed/uninstalled).

Also, about erasing, i plan to create the equivalent behaivour we have in searches. Example: "tupac -R [word] [word] ..." and then choose from the list what packages to erase (or "tupac -Rs [word] [word] [word]").

Last edited by Pajaro (2007-12-07 13:41:53)

Pajaro · 2007-12-07 14:05:00

0.3.2 UPDATE (beta is not beta anymore).
- Incremental cache. Now it is much faster.
- Changed tupac behaivour when running it with no arguments. Now it updates cache. I made this because it shows repo changes, and i found out that sometimes i wanted to check what changed on every "pacman -Sy" without wanting to do a search. In example, i saw that it came out a new xorg driver driver for RadeonHD.

kishd · 2007-12-07 15:20:21

Is it possible to add an option for light background like --lightbg in yaourt?

Pajaro · 2007-12-07 16:32:33

kishd,

I am going to do it first. I only have to decide if i should follow yaourt style (--lightbg) or if i should set what i find more logic (--color=lightbg | --color=off | --color=darkbg)... or implement --lightbg as an alias for --color=lightbg... probably last one

Pajaro · 2007-12-30 17:27:17

tupac update:
0.3.3:
- Added an option to change color scheme

Arch Linux

#26 2007-10-16 22:06:27

Re: tupac (TUrbo PACman) - a cached pacman implementation. UPDATED 0.5.6.1

#27 2007-10-17 08:41:41

Re: tupac (TUrbo PACman) - a cached pacman implementation. UPDATED 0.5.6.1

#28 2007-10-17 09:21:03

Re: tupac (TUrbo PACman) - a cached pacman implementation. UPDATED 0.5.6.1

#29 2007-10-18 10:43:07

Re: tupac (TUrbo PACman) - a cached pacman implementation. UPDATED 0.5.6.1

#30 2007-10-18 10:55:26

Re: tupac (TUrbo PACman) - a cached pacman implementation. UPDATED 0.5.6.1

#31 2007-10-18 11:18:54

Re: tupac (TUrbo PACman) - a cached pacman implementation. UPDATED 0.5.6.1

#32 2007-10-18 14:18:51

Re: tupac (TUrbo PACman) - a cached pacman implementation. UPDATED 0.5.6.1

#33 2007-10-18 15:16:59

Re: tupac (TUrbo PACman) - a cached pacman implementation. UPDATED 0.5.6.1

#34 2007-10-19 11:44:28

Re: tupac (TUrbo PACman) - a cached pacman implementation. UPDATED 0.5.6.1

#35 2007-10-19 13:35:35

Re: tupac (TUrbo PACman) - a cached pacman implementation. UPDATED 0.5.6.1

#36 2007-10-20 12:01:36

Re: tupac (TUrbo PACman) - a cached pacman implementation. UPDATED 0.5.6.1

#37 2007-10-20 12:11:04

Re: tupac (TUrbo PACman) - a cached pacman implementation. UPDATED 0.5.6.1

#38 2007-10-20 16:17:54

Re: tupac (TUrbo PACman) - a cached pacman implementation. UPDATED 0.5.6.1

#39 2007-10-20 16:29:28

Re: tupac (TUrbo PACman) - a cached pacman implementation. UPDATED 0.5.6.1

#40 2007-12-02 21:12:18

Re: tupac (TUrbo PACman) - a cached pacman implementation. UPDATED 0.5.6.1

#41 2007-12-02 21:22:58

Re: tupac (TUrbo PACman) - a cached pacman implementation. UPDATED 0.5.6.1

#42 2007-12-03 02:44:12

Re: tupac (TUrbo PACman) - a cached pacman implementation. UPDATED 0.5.6.1

#43 2007-12-03 09:54:45

Re: tupac (TUrbo PACman) - a cached pacman implementation. UPDATED 0.5.6.1

#44 2007-12-03 10:51:31

Re: tupac (TUrbo PACman) - a cached pacman implementation. UPDATED 0.5.6.1

#45 2007-12-07 13:06:33

Re: tupac (TUrbo PACman) - a cached pacman implementation. UPDATED 0.5.6.1

#46 2007-12-07 13:41:26

Re: tupac (TUrbo PACman) - a cached pacman implementation. UPDATED 0.5.6.1

#47 2007-12-07 14:05:00

Re: tupac (TUrbo PACman) - a cached pacman implementation. UPDATED 0.5.6.1

#48 2007-12-07 15:20:21

Re: tupac (TUrbo PACman) - a cached pacman implementation. UPDATED 0.5.6.1

#49 2007-12-07 16:32:33

Re: tupac (TUrbo PACman) - a cached pacman implementation. UPDATED 0.5.6.1

#50 2007-12-30 17:27:17

Re: tupac (TUrbo PACman) - a cached pacman implementation. UPDATED 0.5.6.1

Board footer