profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

kozaki · 2014-01-20 11:28:27

Hi, OK, yes I will.

Just for the record I checked on my working station: same situation though at different dates
Note they were created by root at the very same moment, on a per user whatever the profile.

user1:

ls -l .mozilla/firefox/{cbaljzc8.testing,wlmt0hsh.default,wlmt0hsh.default}
lrwxrwxrwx 1 kozaki users   33 30 janv.  2013 archie-firefox-cbaljzc8.testing -> /tmp/archie-firefox-cbaljzc8.testing
lrwxrwxrwx 1 root   root    33  5 janv. 18:21 kozaki-firefox-cbaljzc8.testing -> /tmp/kozaki-firefox-cbaljzc8.testing

lrwxrwxrwx  1 root   root    35  5 janv. 18:21 kozaki-firefox-yfmlmz5a.webdev -> /tmp/kozaki-firefox-yfmlmz5a.webdev

lrwxrwxrwx  1 root   root    36  5 janv. 18:21 user1-firefox-wlmt0hsh.default -> /tmp/user1-firefox-wlmt0hsh.default

user2:

ls -l /.mozilla/firefox/wlmt0hsh.default/
lrwxrwxrwx 1 user2 group2       32 14 déc.   2012 user2-firefox-wlmt0hsh.default -> /tmp/user2-firefox-wlmt0hsh.default

lelele · 2014-02-06 18:06:45

Anyone else experiencing slow boot times because of this?

$ systemd-analyze blame
   28.988s psd.service

Is my harddrive slowing down? How do you test exactly?

Tried profile-cleaner, not exactly helped.

$ profile-cleaner c
profile-cleaner v2.26

 Cleaning profile for chromium
 Cleaning Safe Browsing Cookies                done  -0 Mbytes
 Cleaning Web Data                             done  -0 Mbytes
 Cleaning Top Sites                            done  -.14 Mbytes
 Cleaning Shortcuts                            done  -0 Mbytes
 Cleaning QuotaManager                         done  -0 Mbytes
 Cleaning Origin Bound Certs                   done  -0 Mbytes
 Cleaning Network Action Predictor             done  -.08 Mbytes
 Cleaning Login Data                           done  -0 Mbytes
 Cleaning History                              done  -0 Mbytes
 Cleaning Favicons                             done  -0 Mbytes
 Cleaning Extension Cookies                    done  -0 Mbytes
 Cleaning Cookies                              done  -.03 Mbytes
 Cleaning Archived History                     done  -0 Mbytes

 Profile(s) for chromium reduced by .27 Mbytes.

Anyways, any help will be gladly appreciated and be given digital hugs.

el mariachi · 2014-02-06 19:27:06

11.256s psd.service

but firefox takes a lot of time to startup, which didn't happen before, so maybe psd is not doing something right

graysky · 2014-02-06 19:54:30

Guessing your profile(s) are just large and/or your disk is slow. Post the output of `psd p`

Example on my system:

Profile-sync-daemon v5.45.1 on Arch Linux.

 Systemd service is currently active.
 Systemd resync service is currently active.

Psd will manage the following per /etc/psd.conf settings:

 browser/psname:  chromium/chromium
 owner/group id:  facade/100
 sync target:     /home/facade/.config/chromium
 tmpfs dir:       /tmp/facade-chromium
 profile size:    79M

And

% systemd-analyze blame | grep psd
           459ms psd.service
            56ms psd-resync.service

lelele · 2014-02-07 12:11:16

Here's the output of psd p.

Profile-sync-daemon v5.45.1 on Arch Linux.

 Systemd service is currently active.
 Systemd resync service is currently active.

Psd will manage the following per /etc/psd.conf settings:

 browser/psname:  chromium/chromium
 owner/group id:  bimbi/10
 sync target:     /home/bimbi/.config/chromium
 tmpfs dir:       /tmp/bimbi-chromium
 profile size:    104M

 browser/psname:  firefox/firefox
 owner/group id:  bimbi/10
 sync target:     /home/bimbi/.mozilla/firefox/mwad0hks.default
 tmpfs dir:       /tmp/bimbi-firefox-mwad0hks.default
 profile size:    41M

 browser/psname:  opera/opera
 owner/group id:  bimbi/10
 sync target:     /home/bimbi/.opera
 tmpfs dir:       /tmp/bimbi-opera
 profile size:    13M

104m? Never thought it was that big. Is that normal?

For systemd-analyze blame| grep psd

         27.550s psd.service
           215ms psd-resync.service

Last edited by lelele (2014-02-07 12:12:30)

graysky · 2014-02-07 13:14:41

No that is not too large. Is this an ssd or hdd? If hdd, is it 5400 rpm or 7200 rpm? Could just be that systemd is maxing out your IO bandwidth with psd and other daemons all running in parallel. If you allow the system to stabilize, log in, and stop psd, then start psd, how long does that take? I believe the blame command will update. You can compare the two times to see if my saturation idea is at play.

lelele · 2014-02-07 13:42:59

I believe it's an HDD.
This was all I could find about the rpm thing.

WD10EADX 	1 TB 	SATA 6 Gb/s 	IntelliPower 	N/A 	32 MB 	x

It's mostly rumours, but they say it's around 5000 to 5400 rpm.

system to stabilize, log in, and stop psd, then start psd, how long does that take

Ok, I didn't understand that. But how do I do it?
...
I wonder if I just start it after the display manager, will that help?

Ok, so here's the chain thing. I don't really know how to read it. Hope it helps though.

graphical.target @39.539s
└─multi-user.target @39.323s
  └─psd.service @11.772s +27.550s
    └─basic.target @11.761s
      └─timers.target @11.757s
        └─systemd-tmpfiles-clean.timer @11.757s
          └─sysinit.target @10.581s
            └─systemd-update-utmp.service @10.447s +132ms
              └─systemd-tmpfiles-setup.service @10.307s +136ms
                └─local-fs.target @10.301s
                  └─var.mount @10.131s +169ms
                    └─systemd-fsck@dev-sda7.service @6.450s +3.680s
                      └─dev-sda7.device @6.450s

EDIT: Yup, psd is really slow on my pc. Started it manually, took it's sweet time. If it's a hard drive issue, I wonder why and what I can do about it.

Last edited by lelele (2014-02-07 14:14:06)

graysky · 2014-02-07 14:42:53

I don't know what that 11+27 sec thing means... If they hdd is slow and it is parallel processing other IO events I don't think you can do much short of upgrading it to an SSD. Maybe others will have helpful suggestions.

FarStar07 · 2014-03-27 14:02:27

Hello graysky,

Please, could you support Maxthon? -> https://aur.archlinux.org/packages/maxthon-browser

The default profile folder is ~/.config/maxthon/

Thank you!

Last edited by FarStar07 (2014-03-27 14:13:07)

amitk_iitm · 2014-03-28 08:18:22

Hey,
I'm facing a minor problem with psd.
I'm using it to sync my firefox profile. I use KDE and have added an autostart option for "profile-sync-daemon".

What happens is, every time I log in, it opens firefox and when I close it, firefox is relaunched. So I have to close it twice when I use psd.
When I close firefox for the second time, the daemon exits.

I'm sure I'm doing something wrong here. Could you help?
Thanks!

graysky · 2014-03-28 08:57:30

Psd will not open a browser. If you have a browser open when you call the service to stop it will force the browser to close so the profile can be rotated back out of tmpfs.

...Autostart entry for the service? Do you have a special setup like an encrypted /home? If not, it is best to allow systemd to start the service at boot time.

bezirg · 2014-04-08 08:18:15

Hi people,

I really like your work on psd. Unfortunately, skype and psd do not play along well.

I am using profile-sync-daemon 5.45.1-2 , skype 4.2.0.13-3
and I have systemd enable psd and psd-resync.

After I start skype, the skype application eats my CPU, up until I close skype.
If I systemd stop psd and start again skype, skype behaves fine.

After some googling, I think it is related to this: https://bbs.archlinux.org/viewtopic.php?id=145250

Based on the above thread, Skype tries to read (for some reason) the ~/.mozilla/profile folder.
When psd is running, this profile is symlinked to /tmp/profile. If you go into /tmp/profile, there is
a symlink cycle back to ~/.mozilla/profile.

So skype tries to enter this symlink, resulting in a loop.

Is there a workaround for this?

graysky · 2014-04-08 09:16:31

First update psd to the latest version... Your version is a bit dated. There should not be circular symlinks. Stop psd. Look in ~/.mozilla/firefox where you should see no symlinks. Start it. Now look in ~/.mozilla/firefox where you should see a symlink to the profile(s) you defined. If you ls the symlink target, it should cleanly be the profile name only. Is this I not the case?

bezirg · 2014-04-08 12:49:39

I updated to version 5.47.1-1 . Problem remains.

I stop psd. Inside ~/.mozilla/profile, there is a broken symlink named username-profile pointing to /tmp/username-profile

Should I remove this broken symlink?

bezirg · 2014-04-08 12:54:29

Ok, I removed this broken symlink. Now, psd+skype work fine.

I don't remember generating this strange symlink: ~/.mozilla/profile/username-profile.default -> /tmp/username-profile/

Might be the cause of a bug in earlier version of psd?
I will let you know if this happens again.

Thank you!

rob.dean · 2014-04-19 07:27:37

Hi All

I run a kubuntu box and have used PSD with firefox without problem for about 9 months. Yesterday I upgraded to the new version (trusty) and now when I try and run firefox with PSD running I get the message

"Firefox is already running, but is not responding. To open a new window, you must first close the existing Firefox process, or restart your system."

If I shut down PSD

"sudo service psd stop"

I can run firefox as normal then if I close firefox, start PSD again

 "sudo service psd start"

and try and run firefox I get the "firefox is already running" message.
I've deleted all the ".parentlock" files I can find and I can't find any "lock" files so I'm thinking it's a permissions issue? The profile folder that is in /run/shm/ seems to have the right permissions however (I have read and write access to it). Running firefox from the terminal with PSD running doesn't give any unusual errors, where do I go from here??

Cheers
Rob

graysky · 2014-04-19 10:27:32

Looking into now in a VM (spinning up a 14.04 VM is more accurate).

graysky · 2014-04-19 10:59:57

Not sure what to make of it; no problems for me.

Profile-sync-daemon v5.47.1 on Ubuntu 14.04 LTS.

 Daemon pid file is present.
 Resync cronjob is present.

Psd will manage the following per /var/run/psd.conf settings:

 browser/psname:  firefox/firefox
 owner/group id:  facade/1000
 sync target:     /home/facade/.mozilla/firefox/vd1iqcbn.default-1395954548178
 tmpfs dir:       /run/shm/facade-firefox-vd1iqcbn.default-1395954548178
 profile size:    13M

And

#
# /etc/psd.conf
#
# For documentation, refer to the psd man page or the wiki page
# https://wiki.archlinux.org/index.php/Profile-sync-daemon

## WARNING Do NOT edit anything in this file while psd is running!
## To protect data from corruption, in the event that you do make an edit
## while psd is active, any changes made will be applied the next time
## you start-up psd.

# List users separated by spaces whose browser(s) profile(s) will get symlinked
# and sync'ed to tmpfs
# Do NOT list a user twice!
#
# Example
# USERS="facade graysky"
USERS="facade"

# List browsers separated by spaces to include in the sync. Useful if you do not
# wish to have all possible browser profiles sync'ed
#
# Possible values:
#  chromium
#  chromium-dev
#  conkeror.mozdev.org
#  epiphany
#  firefox
#  firefox-trunk
#  google-chrome
#  google-chrome-beta
#  google-chrome-unstable
#  heftig-aurora
#  luakit
#  midori
#  opera
#  opera-next
#  qupzilla
#  rekonq
#  seamonkey
#
# Uncomment and select which browsers to manage if you wish
# Otherwise all available/supported browsers will be managed
# which is NOT recommended if users have many browser profiles
#BROWSERS=""

# Define where browser profiles will reside in tmpfs
# This location must be mounted to tmpfs and MUST have permissions of 777
# Use NO trailing backslash!
#
# Suggested locations based on distro defaults:
#   Arch Linux/Chakra, Fedora, and Gentoo leave this commented out
#   Debian 6 and below use a setting of "/dev/shm"
#   Debian 7+  use a setting of "/run/shm"
VOLATILE="/run/shm"

# Define where the pid file for psd will reside
#   Arch Linux/Chakra, Debian 7+, Fedora, and Gentoo leave this commented out
#   Debian 6 and below/Mint/Ubuntu use a setting of "/var/run/psd"
DAEMON_FILE="/var/run/psd"

Last edited by graysky (2014-04-19 14:44:13)

rob.dean · 2014-04-19 11:31:21

Sorry to waste your time (maybe someone else will be silly enough to do this, then read my comments and realise what they have done) - somehow in the upgrade process the AppArmor profile for Firefox got turned on. Turning it off as per http://www.howtogeek.com/118222/htg-exp … tu-system/ solved the problem.Again, sorry for the hassle and thanks for a most useful program.

graysky · 2014-04-19 14:43:56

No problem, glad you fixed it.

Viper_Scull · 2014-04-29 13:51:36

Hi graysky.

Version : 5.47.1-1

I wonder why psd.service takes so long (on an SSD):

systemd-analyze blame | grep psd
2.605s psd.service
100ms psd-resync.service

Just compare:

when psd.service enabled:
systemd-analyze
Startup finished in 2.026s (kernel) + 3.093s (userspace) = 5.120s

when psd.service disabled:
systemd-analyze
Startup finished in 1.884s (kernel) + 567ms (userspace) = 2.451s

The other thing is that when I reboot the computer when the browser (chromium) is open, when I open it again after reboot I have to press restore (sounds as if it didn't write the profile back before rebooting)
If the browser is closed at the moment of reboot, then it opens fine.
If what I do is power it off, it doesn't matter if it was open or closed, it opens fine.

So the problem only happens when the browser is open and you reboot the system.

The time that psd.service takes happens always, no matter if you reboot or shutdown with the browser open or closed.

Last edited by Viper_Scull (2014-04-29 14:03:40)

graysky · 2014-04-29 19:55:02

@VS - The time reported presumably corresponds to the size of your profiles, speed of ssd, processor (maybe), amount of other paralleled startup stuff, etc. You can use profile-cleaner to keep your profile cleaned and/or manually go through the profile and delete stuff you don't care about to minimize the amount of data to sync.

Your 2nd issue is news to me... if you are rebooting via the init system (systemd right?) this should not happen since systemd knows to wait for psd to finish syncing before it brings the system down.

Viper_Scull · 2014-04-29 20:57:39

@graysky - You're definitely right, my chromium profile is 160MB (like 15 tabs open).

Yes, I'm rebooting via systemd ( 'systemctl reboot'). It happens every time.
Can anyone else confirm this (rebooting with chromium open) ?

Last edited by Viper_Scull (2014-04-30 16:55:16)

ZellSF · 2014-04-30 09:50:29

I'm trying to use this, but I have a problem: my Firefox profile is encrypted. slim unencrypts it via pam at login, but at that point psd has already run and failed to sync the profile to tmpfs.

Only way I can get it to work is manually invoking it as root after login (which is really not ideal). Any suggestions?

Viper_Scull · 2014-04-30 15:03:51

ZellSF wrote:

I'm trying to use this, but I have a problem: my Firefox profile is encrypted. slim unencrypts it via pam at login, but at that point psd has already run and failed to sync the profile to tmpfs.
Only way I can get it to work is manually invoking it as root after login (which is really not ideal). Any suggestions?

You could use a timer to delay the service:
http://www.freedesktop.org/software/sys … timer.html

You could play with After in the .service (maybe local-fs.target or graphical.target) Just try and see.

Arch Linux

#476 2014-01-20 11:28:27

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#477 2014-02-06 18:06:45

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#478 2014-02-06 19:27:06

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#479 2014-02-06 19:54:30

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#480 2014-02-07 12:11:16

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#481 2014-02-07 13:14:41

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#482 2014-02-07 13:42:59

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#483 2014-02-07 14:42:53

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#484 2014-03-27 14:02:27

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#485 2014-03-28 08:18:22

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#486 2014-03-28 08:57:30

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#487 2014-04-08 08:18:15

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#488 2014-04-08 09:16:31

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#489 2014-04-08 12:49:39

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#490 2014-04-08 12:54:29

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#491 2014-04-19 07:27:37

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#492 2014-04-19 10:27:32

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#493 2014-04-19 10:59:57

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#494 2014-04-19 11:31:21

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#495 2014-04-19 14:43:56

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#496 2014-04-29 13:51:36

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#497 2014-04-29 19:55:02

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#498 2014-04-29 20:57:39

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#499 2014-04-30 09:50:29

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#500 2014-04-30 15:03:51

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

Board footer