profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

Mindstormscreator · 2013-06-30 02:06:41

graysky wrote:

Mindstormscreator wrote:
Any plans for dwb support soon?
Never heard of it...

Hmp, I alway thought it was a really popular browser on this forum.

graysky wrote:

how large is its profile dir? Frankly, I added support for another 'obscure' browser and realized while testing that its profile was tiny and not really worthy of syncing.

I just looked and ~/.config/dwb is roughly 25 kB for me... but then again, I have no extensions installed and haven't used it for too long so far, so I don't know how much it could grow as history piles up. So I guess it's up to you whether you think it's worth adding support for it.

graysky · 2013-07-02 00:45:27

For tiny sizes like < 1MB there is no advantage to using it.

Mr Green · 2013-07-02 07:06:55

Everything runs faster from ram only thinking out loud but what if psd ran browser entirely from ram?

graysky · 2013-07-02 08:43:06

Moving bins and libs would be too tricky.

Mr Green · 2013-07-02 08:46:10

It was just a thought, it is more of an all or nothing deal. Know you can sandbox (do not think my ideas through!)

orschiro · 2013-07-17 20:47:30

[orschiro@thinkpad ~]$ sudo systemd-analyze blame
    1min 36.029s psd.service

Is it normal for psd to have such long startup times?

I am using it together with Chromium.

graysky · 2013-07-17 21:07:26

@orschiro - Depends on the size of your profile, speed of your system/HDD/SSD, how many other things are starting in parallel, etc. Post the output of `psd p` which will show the size of your profile(s). Example on my workstation:

% psd p
Profile-sync-daemon v5.36.3 on Arch Linux.

Daemon file /run/psd is present.
Service is currently active.

Psd will manage the following per /etc/psd.conf settings:

 browser/psname:  chromium/chromium
 owner/group:     graysky/users
 sync target:     /home/graysky/.config/chromium
 tmpfs dir:       /tmp/graysky-chromium
 profile size:    110M

orschiro · 2013-07-17 21:10:19

Ah well, so this is due to my slow HDD. Is there then any benefit for me using psd at all?

[orschiro@thinkpad ~]$ psd p
Profile-sync-daemon v5.36.3 on Arch Linux.

Daemon file /run/psd is present.
Service is currently active.

Psd will manage the following per /etc/psd.conf settings:

 browser/psname:  chromium/chromium
 owner/group:     orschiro/users
 sync target:     /home/orschiro/.config/chromium
 tmpfs dir:       /tmp/orschiro-chromium
 profile size:    232M

graysky · 2013-07-17 21:51:09

All access to the profile in tmpfs is more or less instantaneous (i.e. no disk seek to look up data). You will have to deceide if that is of any value to you. My original reason for writing it was not so much access speed... it was more about reducing writes to my SSD. You can try to trim down your profile by deleting some history and/or by running profile-cleaner.

boast · 2013-07-21 04:22:36

what do I do if on every boot I have to keep deleting ~/.config/chromium and making the symlink to /tmp/user-chromium ?

graysky · 2013-07-21 07:57:27

boast wrote:

what do I do if on every boot I have to keep deleting ~/.config/chromium and making the symlink to /tmp/user-chromium ?

Post the output of:

psd p

ls -l /etc/systemd/system/multi-user.target.wants | grep psd`

Markus00000 · 2013-07-21 09:17:26

I have been using psd for months without issues. Even after crashes I always had a very current profile because I'm using the syncing timer set to a couple of minutes.

Today, standby failed and afterwards I had lost all profile changes from about the last 24 hours. Ouch.

Anything I can do to identify the cause?

Last edited by Markus00000 (2013-07-21 09:35:32)

graysky · 2013-07-21 11:20:00

When you rebooted following th failure, what state was psd in? Dias that tmpfs copy of your profile in tmpfs? Symlink created? Did you change the interval of syncing from 1 h to 24 h? At most, you would lose 1 h of changes.

Markus00000 · 2013-07-21 13:22:52

Found the problem. psd-resync.service was not enabled and therefore not started. Without the resync service psd is not meant to sync at all?

I am not sure why I hadn't enabled psd-resync.service. Maybe I messed up the transition from a cron job for syncing to the service, but if that was the case, I wonder why it took so long to notice.

Wouldn't it be nice if

profile-sync-daemon parse

listed the current sync interval as well?

graysky · 2013-07-21 15:32:53

Markus00000 wrote:

Wouldn't it be nice if
profile-sync-daemon parse
listed the current sync interval as well?

This is a good idea. In the interest of KISS, I don't want to start parsing timer files and /etc/cron.d dirs for those not running systemd, so I have you a simple on/off display in v5.38 which is now live in the AUR.

% psd p
Profile-sync-daemon v5.38 on Arch Linux.

 Systemd service is currently active.
 Systemd resync service is currently active.

Psd will manage the following per /etc/psd.conf settings:

 browser/psname:  chromium/chromium
 owner/group:     graysky/users
 sync target:     /home/graysky/.config/chromium
 tmpfs dir:       /tmp/graysky-chromium
 profile size:    90M

Last edited by graysky (2013-07-21 15:34:17)

boast · 2013-07-22 18:51:51

graysky wrote:

boast wrote:
what do I do if on every boot I have to keep deleting ~/.config/chromium and making the symlink to /tmp/user-chromium ?
Post the output of:
psd p
ls -l /etc/systemd/system/multi-user.target.wants | grep psd`

psd p had

psd p
Profile-sync-daemon v5.38.1 on Arch Linux.

 Systemd service is currently active.
 Systemd resync service is currently active.

Psd will manage the following per /etc/psd.conf settings:

 browser/psname:  chromium/chromium
 owner/group:     boast/users
 sync target:     /home/boast/.config/chromium
 tmpfs dir:       /tmp/boast-chromium
 profile size:    888M

I ended up uninstalling it. I don't think it works with google hangouts plugin that automatically loads on login before psd finishes syncing

~/.config/chromium would not point to tmp and would contain just a basic clean profile

Last edited by boast (2013-07-22 18:53:01)

graysky · 2013-07-22 19:41:19

No idea about google hangouts plugin... your profile is 888 MB which is huge. I would think the problem would stem from the likely long sync times?

orschiro · 2013-08-06 19:54:24

What actually happens if the cache of my Chromium browser exceeds the size of tmpfs?

tmpfs                        800M  800M     0 100% /home/orschiro/.cache

Do I risk data loss?

graysky · 2013-08-06 20:07:42

@orschiro - Not sure. Never happened to me before. Since you are at 100 % now, what is happening with the browser?

tmpfs           120M   18M  103M  15% /home/graysky/.cache

Just for folks unaware know, psd does not manage chromium browser cache by design. See the man page for advice:

man psd wrote:

*Note that some browsers such as Chrome/Chromium, Firefox (since v21), Midori, and Rekonq actually keeps their cache
directories separately from their browser profile directory. It is not within the scope of profile-sync-daemon to
modify this behavior; users wishing to relocate this directory, may refer to the following url for several work-
arounds: https://wiki.archlinux.org/index.php/Ch … e_in_tmpfs

Last edited by graysky (2013-08-06 20:08:28)

orschiro · 2013-08-06 20:28:18

Not sure. Never happened to me before. Since you are at 100 % now, what is happening with the browser?

I have the feeling it becomes much slower now.

Just for folks unaware know, psd does not manage chromium browser cache by design. See the man page for advice:

Correct me if I am wrong but for exactly that reason I created the following entry in /etc/fstab as suggested:

tmpfs	/home/orschiro/.cache	tmpfs	noatime,nodev,nosuid,size=800M	0	0

Is that not sufficient?

masnormen · 2013-09-11 11:42:20

Hi, I have a problem with psd. Chrome profile's not sync'ed. However, Firefox runs well.

sudo systemctl status psd psd-resync:

psd.service - Profile-sync-daemon
   Loaded: loaded (/usr/lib/systemd/system/psd.service; enabled)
   Active: active (exited) since Wed 2013-09-11 18:21:08 WIT; 16min ago
     Docs: man:psd(1)
           man:profile-sync-daemon(1)
           https://wiki.archlinux.org/index.php/Profile-sync-daemon
  Process: 218 ExecStart=/usr/bin/profile-sync-daemon sync (code=exited, status=0/SUCCESS)


psd-resync.service - Timed Profile-resync
   Loaded: loaded (/usr/lib/systemd/system/psd-resync.service; enabled)
   Active: inactive (dead) since Wed 2013-09-11 18:22:58 WIT; 14min ago
     Docs: man:psd(1)
           man:profile-sync-daemon(1)
           https://wiki.archlinux.org/index.php/Profile-sync-daemon
  Process: 1185 ExecStart=/usr/bin/profile-sync-daemon resync (code=exited, status=0/SUCCESS)

Sep 11 18:22:58 archlinux profile-sync-daemon[1185]: /home/masnormen/.config/chromium does not exist or is a broken symlink! Is /home or /tmp unmounted?
Sep 11 18:22:58 archlinux profile-sync-daemon[1185]: /home/masnormen/.conkeror.mozdev.org does not exist or is a broken symlink! Is /home or /tmp unmounted?
Sep 11 18:22:58 archlinux profile-sync-daemon[1185]: mv: cannot move ‘/home/masnormen/.config/google-chrome’ to ‘/home/masnormen/.config/google-chrome-backup/google-chrome’: Directory not empty
Sep 11 18:22:58 archlinux profile-sync-daemon[1185]: cannot delete non-empty directory: google-chrome
Sep 11 18:22:58 archlinux profile-sync-daemon[1185]: /home/masnormen/.config/midori does not exist or is a broken symlink! Is /home or /tmp unmounted?
Sep 11 18:22:58 archlinux profile-sync-daemon[1185]: /home/masnormen/.opera does not exist or is a broken symlink! Is /home or /tmp unmounted?
Sep 11 18:22:58 archlinux profile-sync-daemon[1185]: /home/masnormen/.opera-next does not exist or is a broken symlink! Is /home or /tmp unmounted?
Sep 11 18:22:58 archlinux profile-sync-daemon[1185]: /home/masnormen/.local/share/luakit does not exist or is a broken symlink! Is /home or /tmp unmounted?
Sep 11 18:22:58 archlinux systemd[1]: Started Timed Profile-resync.

These lines are strange:

Sep 11 18:22:58 archlinux profile-sync-daemon[1185]: mv: cannot move ‘/home/masnormen/.config/google-chrome’ to ‘/home/masnormen/.config/google-chrome-backup/google-chrome’: Directory not empty
Sep 11 18:22:58 archlinux profile-sync-daemon[1185]: cannot delete non-empty directory: google-chrome

/etc/psd.conf:

USERS="masnormen"
#BROWSERS=""

psd parse:

Profile-sync-daemon v5.39 on Arch Linux.

 Systemd service is currently active.
 Systemd resync service is currently active.

Psd will manage the following per /etc/psd.conf settings:

 browser/psname:  firefox/firefox
 owner/group id:  masnormen/100
 sync target:     /home/masnormen/.mozilla/firefox/7ioq11v0.default
 tmpfs dir:       /tmp/masnormen-firefox-7ioq11v0.default
 profile size:    16M

 browser/psname:  google-chrome/chrome
 owner/group id:  masnormen/100
 sync target:     /home/masnormen/.config/google-chrome
 tmpfs dir:       /tmp/masnormen-google-chrome
 profile size:    13M

My last chrome profile size is about 80-90 MB. Did my Chrome profile lost?

Anyway, in my last reboot, systemd-analyze said that psd takes 1 minute to start. Now, it's normal, and Chrome profile still can't get sync'ed. WTF?

Thank you.

Last edited by masnormen (2013-09-11 11:48:35)

orschiro · 2013-09-11 11:45:27

If you want to sync Chrome, why don't you add that to the config then?

BROWSERS="google-chrome"

masnormen · 2013-09-11 11:51:15

orschiro wrote:

If you want to sync Chrome, why don't you add that to the config then?
BROWSERS="google-chrome"

However, the config file says:

# Uncomment and select which browsers to manage if you wish
# Otherwise all available/supported browsers will be managed

So I'm sure I'm doing anything right.

yuszuv · 2013-09-11 12:28:15

I don't know if it's my fault, a systemd bug or one of profile-sync-daemon or if it has anything to do with my lvm setup, but anyhow I think this is the most according spot to post my problem.

Today my laptop freezed and because I don't know any magic sysreq shortcuts I turned it off the hard way by pressing the power button. After the reboot, the last available firefox bookmark backups are from Sep, 6th or one week ago resp. And `journalctl` tells me

Sep 11 13:58:18 teeei systemd-fsck[214]: /dev/mapper/sys--vg-lvhome: recovering journal
...
Sep 11 13:58:19 teeei systemd-fsck[214]: /dev/mapper/sys--vg-lvhome: Clearing orphaned inode 563318 (uid=1000, gid=100, mode=0100644, size=3574)
Sep 11 13:58:19 teeei systemd-fsck[214]: /dev/mapper/sys--vg-lvhome: Clearing orphaned inode 567889 (uid=1000, gid=100, mode=0100644, size=32768)
Sep 11 13:58:19 teeei systemd-fsck[214]: /dev/mapper/sys--vg-lvhome: Clearing orphaned inode 562199 (uid=1000, gid=100, mode=0100600, size=19384)
Sep 11 13:58:19 teeei systemd-fsck[214]: /dev/mapper/sys--vg-lvhome: Clearing orphaned inode 587643 (uid=1000, gid=100, mode=0100644, size=32768)
Sep 11 13:58:19 teeei systemd-fsck[214]: /dev/mapper/sys--vg-lvhome: Clearing orphaned inode 566781 (uid=1000, gid=100, mode=0100600, size=9020)
Sep 11 13:58:19 teeei systemd-fsck[214]: /dev/mapper/sys--vg-lvhome: Clearing orphaned inode 567900 (uid=1000, gid=100, mode=0100644, size=32768)
Sep 11 13:58:19 teeei systemd-fsck[214]: /dev/mapper/sys--vg-lvhome: Clearing orphaned inode 567894 (uid=1000, gid=100, mode=0100600, size=8876)
Sep 11 13:58:19 teeei systemd-fsck[214]: /dev/mapper/sys--vg-lvhome: Clearing orphaned inode 567162 (uid=1000, gid=100, mode=0100600, size=4096)
Sep 11 13:58:19 teeei systemd-fsck[214]: /dev/mapper/sys--vg-lvhome: Clearing orphaned inode 566794 (uid=1000, gid=100, mode=0100644, size=32768)
Sep 11 13:58:19 teeei systemd-fsck[214]: /dev/mapper/sys--vg-lvhome: Clearing orphaned inode 561468 (uid=1000, gid=100, mode=0100600, size=19384)
Sep 11 13:58:19 teeei systemd-fsck[214]: /dev/mapper/sys--vg-lvhome: Clearing orphaned inode 561628 (uid=1000, gid=100, mode=0100644, size=3574)
Sep 11 13:58:19 teeei systemd-fsck[214]: /dev/mapper/sys--vg-lvhome: Clearing orphaned inode 579014 (uid=1000, gid=100, mode=0100644, size=32768)
Sep 11 13:58:19 teeei systemd-fsck[214]: /dev/mapper/sys--vg-lvhome: Clearing orphaned inode 569363 (uid=1000, gid=100, mode=0100600, size=18120)
Sep 11 13:58:19 teeei systemd-fsck[214]: /dev/mapper/sys--vg-lvhome: Clearing orphaned inode 575883 (uid=1000, gid=100, mode=0100644, size=3574)
Sep 11 13:58:19 teeei systemd-fsck[214]: /dev/mapper/sys--vg-lvhome: clean, 549800/4259840 files, 16269210/17039360 blocks

I think, firefox normally updates it's bookmark backups on a daily base, so it think some of this "cleared orphaned nodes" are my bookmarks. Any idea how to prevent this in the future? Or how to trace back what happened?

orschiro · 2013-09-11 13:10:24

@masnormen

I would suggest that you just give it a try what I mentioned above.

Last edited by orschiro (2013-09-11 13:10:38)

Arch Linux

#401 2013-06-30 02:06:41

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#402 2013-07-02 00:45:27

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#403 2013-07-02 07:06:55

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#404 2013-07-02 08:43:06

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#405 2013-07-02 08:46:10

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#406 2013-07-17 20:47:30

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#407 2013-07-17 21:07:26

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#408 2013-07-17 21:10:19

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#409 2013-07-17 21:51:09

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#410 2013-07-21 04:22:36

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#411 2013-07-21 07:57:27

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#412 2013-07-21 09:17:26

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#413 2013-07-21 11:20:00

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#414 2013-07-21 13:22:52

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#415 2013-07-21 15:32:53

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#416 2013-07-22 18:51:51

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#417 2013-07-22 19:41:19

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#418 2013-08-06 19:54:24

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#419 2013-08-06 20:07:42

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#420 2013-08-06 20:28:18

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#421 2013-09-11 11:42:20

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#422 2013-09-11 11:45:27

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#423 2013-09-11 11:51:15

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#424 2013-09-11 12:28:15

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#425 2013-09-11 13:10:24

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

Board footer