pkgstats round two: take your vote and help improving Arch

mencargo · 2011-04-01 22:19:48

How can I make sure that my pkgstats is working properly?
What happened to the .de -> .org migration?

Is there any chance that the platform for each user could be added to a pkgstats upgrade?

Klenje · 2011-06-27 19:06:27

Just contributed my packages! Any idea why opera is not among browsers?

Evilandi666 · 2011-09-19 12:50:11

[x] Done.

I hope some of the devs really use these stats to "prioritize their efforts" and it is not just a fancy statspage..

Last edited by Evilandi666 (2011-09-19 12:50:46)

sdoerner · 2012-07-31 22:15:57

Please add 'awesome' to the window managers list.

derhil · 2012-08-01 14:16:22

Can you add 'Geany' to the Editors list? Thanks Pierre.

cybertimber2009 · 2012-08-01 16:30:53

I added it to my arch linux install which is arm based (pogoplug) and pgkstats returns with the following error:

# ./pkgstats
Collecting data...
Submitting data...
Failure: armv6l is not a known architecture.

Can that architecture be added?

Pierre · 2012-08-01 16:38:33

Atm Arch Linux itself only supports i686 and x86_64. I don't think adding support for other Arch based distros would be good; it could change the statistics in a way that wont represent Arch Linux and render them kind of useless. It'll be best to ask your distro to ship their own version/instance of pkgstats if needed.

x33a · 2012-08-01 17:59:57

A minor edit suggestion:

On this page

https://www.archlinux.de/?page=FunStatistics

all the category names on the right side are written in plural except "Browser". Maybe you can change it to "Browsers" for the sake of consistency.

kra64 · 2012-08-06 07:59:42

Hello,

For my home network, I have a single IP with NAT, and Arch is running on a handful of machines (a server and some old|new desktops/laptops).
As the collected stats are stored on the base of the IP address, is it useful to install 'pkgstats' on each machine?
If not, what to do?

Last edited by kra64 (2012-08-07 16:31:07)

RealGecko · 2012-08-07 16:00:14

My provider gives me new IP each time I connect to Internet, do you think installation of pkgstats on my system will be useful to you?

xrchz · 2012-08-09 16:20:55

Is the server behind pkgstats free software?
Can we see the code?
Can we do our own processing on the data? (This could be helpful, for example, for Arch derivatives to piggyback on the statistics.)

x33a · 2012-08-10 06:44:09

You can do

pkgstats -d

to see what data is being sent.

xrchz · 2012-08-19 15:43:16

Thanks. But that does not help with data already sent to the pkgstats servers (which are where?) or with the possibilities of unwanted processing of that data (since it seems to be not publicly known what is done).

x33a · 2012-08-19 18:04:55

The data collected isn't publicly available in raw form, afaik. Maybe Pierre can elaborate on that.

ratcheer · 2012-08-19 19:00:54

I wonder, when I run pkgstats weekly, is my old data replaced or is the new data simply added? The latter makes no sense, but the former would seem to be highly complicated unless there was some kind of system id with which to identify and remove the old data.

Tim

Last edited by ratcheer (2012-08-19 19:01:44)

unsieved · 2012-08-28 15:39:43

It'd be nice if pkgstats would provide a pkgstats.timer for people running systemd without crond.

abarbarian · 2012-08-31 11:13:06

Is it possible to include "spacefm" and "parole" to the lists ? Thanks. Nice to see Window Maker in the lists.

Freso · 2012-09-06 20:28:04

About statistics:
- Repository: Perhaps add an "unknown" section after "multilib" for packages not in the official repositories? (This would include AUR, custom repositories, and "home made" PKGBUILDs) - This could be added to the package statistics' "Installed packages per repository" as well.
- Fun: Please add XBMC to media players? Also, perhaps make a VCS-section (git, cvs, subversion, darcs, bzr, ...)? And if you don't mind adding more: cron daemons or terminal emulators or mail clients (and/or MTAs) or, hm... JRE/JDK's? Those are the ones I could think of right now.

About kernel modules:
- What's the purpose of collecting this info? Couldn't you as well collect the .config? I'm personally compiling my most essential and always used modules (evdev, ext4, ...) into the kernel itself. I agree that even so, the majority of people won't do this, so it doesn't completely invalidate the data - but it is something to keep in mind that skewers the stats. Also, I doubt 79.13% of Arch users really rely on a PS/2 mouse... (Heck, it was auto-loaded on my system too, until I changed the "m" to "n" in the config.) Hohum. But then, I guess a lot of this criticism is pretty much the same that's been directed at the package data collection. Ah well.

(Also, nice to see fish in the list of shells. Oh, how I miss thee.)

(Also also, it'd be nice if some of the previous questions were answered - I'd like to know the answer to some of them too.)

felixonmars · 2012-12-27 03:18:04

I've written a service and a timer systemd unit for pkgstats, submitted to AUR on https://aur.archlinux.org/packages/pkgstats-systemd/

It's my first time to write a systemd.timer unit, please correct me if I'm doing it wrong

browntown · 2013-01-28 22:42:40

The pkgstats-systemd timer method seems preferable now that everything is officially moved over to systemd. Don't think cronie has much use anymore. Is there an official position on this?

Freso · 2013-01-28 22:49:26

Last I heard, systemd's timer wasn't able to deal with calendar events, so you can't use the timer to send stats e.g. every Sunday, but only every X days. This may have been implemented since though, but if not, that's a good reason to keep a cron script around. (cron can be other daemons than cronie. )

Jristz · 2013-01-29 04:04:49

Freso wrote:

Last I heard, systemd's timer wasn't able to deal with calendar events, so you can't use the timer to send stats e.g. every Sunday, but only every X days. This may have been implemented since though, but if not, that's a good reason to keep a cron script around. (cron can be other daemons than cronie. )

Calendar event alike triagged for systemd in probably version 198 (if not delay happend)

I tink that IS NOW time to begin move cron based jobs to timer for systemd and prevent problems on future

and talking about the pkgstats, what happend with the migration to archlinux.org???

ackalker · 2013-01-29 05:01:27

Freso wrote:

About kernel modules:
- What's the purpose of collecting this info? Couldn't you as well collect the .config?

Definitely not! Maybe not me or you, but people could conceivably store sensitive info in kernel config variables like a compiled-in kernel commandline for embedded use, etc.

Freso wrote:

I'm personally compiling my most essential and always used modules (evdev, ext4, ...) into the kernel itself. I agree that even so, the majority of people won't do this, so it doesn't completely invalidate the data - but it is something to keep in mind that skewers the stats.

That depends on how the information is collected. I haven't looked at the source yet, but there's a difference between `ls /sys/module` and `cat /proc/modules`. The former also includes 'modules' built into the kernel.

$ comm <(ls /sys/module) <(cat /proc/modules | cut -f1 -d' ' | sort)

EDIT: Checked the source, and yup, it uses /proc/modules . I think it would be better to use a variation of the above command to separate in-kernel modules from loaded modules. Interesting information for possible future kernel configs for the linux package perhaps.

Last edited by ackalker (2013-01-29 05:33:38)

graysky · 2013-02-03 16:33:32

@Pierre - Since the IP of users is obscured, are there any plans to make the data available to users? I would like to view the data in different ways that the outputs on https://www.archlinux.de/?page=PackageStatistics for example.

Spyhawk · 2013-02-19 09:21:48

ratcheer wrote:

I wonder, when I run pkgstats weekly, is my old data replaced or is the new data simply added? The latter makes no sense, but the former would seem to be highly complicated unless there was some kind of system id with which to identify and remove the old data.
Tim

I'm also wondering if the stats generated on the basis of the the last X months. I see that the actual most used "unknown" package is nss-myhostname, because it was removed from the binary repositories. I guess this high percentage mostly reflect past usage.

Arch Linux

#101 2011-04-01 22:19:48

Re: pkgstats round two: take your vote and help improving Arch

#102 2011-06-27 19:06:27

Re: pkgstats round two: take your vote and help improving Arch

#103 2011-09-19 12:50:11

Re: pkgstats round two: take your vote and help improving Arch

#104 2012-07-31 22:15:57

Re: pkgstats round two: take your vote and help improving Arch

#105 2012-08-01 14:16:22

Re: pkgstats round two: take your vote and help improving Arch

#106 2012-08-01 16:30:53

Re: pkgstats round two: take your vote and help improving Arch

#107 2012-08-01 16:38:33

Re: pkgstats round two: take your vote and help improving Arch

#108 2012-08-01 17:59:57

Re: pkgstats round two: take your vote and help improving Arch

#109 2012-08-06 07:59:42

Re: pkgstats round two: take your vote and help improving Arch

#110 2012-08-07 16:00:14

Re: pkgstats round two: take your vote and help improving Arch

#111 2012-08-09 16:20:55

Re: pkgstats round two: take your vote and help improving Arch

#112 2012-08-10 06:44:09

Re: pkgstats round two: take your vote and help improving Arch

#113 2012-08-19 15:43:16

Re: pkgstats round two: take your vote and help improving Arch

#114 2012-08-19 18:04:55

Re: pkgstats round two: take your vote and help improving Arch

#115 2012-08-19 19:00:54

Re: pkgstats round two: take your vote and help improving Arch

#116 2012-08-28 15:39:43

Re: pkgstats round two: take your vote and help improving Arch

#117 2012-08-31 11:13:06

Re: pkgstats round two: take your vote and help improving Arch

#118 2012-09-06 20:28:04

Re: pkgstats round two: take your vote and help improving Arch

#119 2012-12-27 03:18:04

Re: pkgstats round two: take your vote and help improving Arch

#120 2013-01-28 22:42:40

Re: pkgstats round two: take your vote and help improving Arch

#121 2013-01-28 22:49:26

Re: pkgstats round two: take your vote and help improving Arch

#122 2013-01-29 04:04:49

Re: pkgstats round two: take your vote and help improving Arch

#123 2013-01-29 05:01:27

Re: pkgstats round two: take your vote and help improving Arch

#124 2013-02-03 16:33:32

Re: pkgstats round two: take your vote and help improving Arch

#125 2013-02-19 09:21:48

Re: pkgstats round two: take your vote and help improving Arch

Board footer