profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

OdinEidolon · 2017-06-21 08:45:12

graysky wrote:

@OdinEidolon - Not sure... the oldest recovery snapshot should give the last-known-good profile. I updated to 59 without issue

I replaced "chromium" with all snapshots, but all present this problem. I suspect it might be chromium-related, and not PSD-related? Do you have any suggestion on what to look for?

graysky · 2017-06-21 09:02:04

If you're rebuilding the profile,, keep psd out of the mix while you do it. Get it setup the way you want and verify that it is working as expected. Make a backup of it (tarball or whatever), and start psd. Works as expected?

OdinEidolon · 2017-06-21 14:41:29

graysky wrote:

If you're rebuilding the profile,, keep psd out of the mix while you do it. Get it setup the way you want and verify that it is working as expected. Make a backup of it (tarball or whatever), and start psd. Works as expected?

Nope, I know I have to stop and restart PSD when I rename backups, I always do this. I am lost at this.

graysky · 2017-06-21 14:55:54

I am saying to rebuild the profile with all extensions, bookmarks, etc. verify it works, backup, then try it with psd.

OdinEidolon · 2017-06-21 19:32:45

graysky wrote:

I am saying to rebuild the profile with all extensions, bookmarks, etc. verify it works, backup, then try it with psd.

Ok so you mean redoing the profile from scratch. Ok, I'll experiment more and then eventually end up doing that, probably. Thanks in the meantime.

kihanos · 2017-08-28 09:43:07

Hey all,

I've been using psd for a while now, but I'm still having an issue I cannot solve on my own. Whenever psd is on, and a browser is opened (I tried Qupzilla, Firefox and Chomium), and the computer goes to sleep (suspend), then, on wake up, the browser has crashed.
Has anyone else experienced this kind of behaviour? I have tried both with and without overlayfs, with the same result. Note that if psd is not running, everything works fine.

Concerning usual outputs, the systemctl status is still nominal. A "psd p" just shows a lot of recovery folders (34 for Firefox, 3 for Qupzilla).

There is probably a more relevant output I could show you, but I don't know where to look exactly...

Thanks for your help :-)

Last edited by kihanos (2017-08-28 09:55:54)

OdinEidolon · 2017-08-28 10:05:56

kihanos wrote:

Hey all,
I've been using psd for a while now, but I'm still having an issue I cannot solve on my own. Whenever psd is on, and a browser is opened (I tried Qupzilla, Firefox and Chomium), and the computer goes to sleep (suspend), then, on wake up, the browser has crashed.
Has anyone else experienced this kind of behaviour? I have tried both with and without overlayfs, with the same result. Note that if psd is not running, everything works fine.
Concerning usual outputs, the systemctl status is still nominal. A "psd p" just shows a lot of recovery folders (34 for Firefox, 3 for Qupzilla).
There is probably a more relevant output I could show you, but I don't know where to look exactly...
Thanks for your help :-)

Suspend works without a glitch for me. Firefox and chromium.

buttcake · 2017-09-08 00:01:08

Does psd have an option to never touch the physical disk ?

Neven · 2017-09-09 19:25:38

buttcake wrote:

Does psd have an option to never touch the physical disk ?

Look here:
https://bbs.archlinux.org/viewtopic.php?pid=1733118

The second script there (called 'tb') does what you want (if I understood you correctly). And the other ones should also be useful for a Chrom{e,ium} user (there's a wrapper to open the bookmark manager and a script that sends Unix signals to root processes in a Chromium process tree, to kill it safely).

Last edited by Neven (2017-09-09 19:26:38)

Batou · 2017-11-14 06:41:33

I've been running psd for few months and absolutely love it! Thank you, graysky and rest of the devs!

I have a question about the cache. My cache is currently in ~/.cache/chromium/Default and I've noticed that it's not being moved to RAM by psd. I've looked at the wiki and noticed that there are suggestions about moving the cache to tmpfs. Well, how about using psd to handle the cache as well? I've been thinking about moving it to ~/.config/chromium by using something like: chromium --disk-cache-dir=~/.config/chromium and then letting the psd to handle it as well.

Any harm in doing that? Has anyone done this?

graysky · 2017-11-14 08:52:34

man psd wrote:

*Note that some browsers such as Chrome/Chromium, Firefox (since v21), Midori, and Rekonq actually keeps their cache directories separately from their browser profile directory. It is not within the scope of profile-sync-daemon to modify this behavior; users wishing to relocate this directory, may refer to the following url for several work-arounds: https://wiki.archlinux.org/index.php/Ch … e_in_tmpfs

Batou · 2017-11-14 09:46:38

graysky wrote:

man psd wrote:
*Note that some browsers such as Chrome/Chromium, Firefox (since v21), Midori, and Rekonq actually keeps their cache directories separately from their browser profile directory. It is not within the scope of profile-sync-daemon to modify this behavior; users wishing to relocate this directory, may refer to the following url for several work-arounds: https://wiki.archlinux.org/index.php/Ch … e_in_tmpfs

Yep, I read that. Issue is that if I mount it on a tmpfs, cache won't be preserved between reboots. Since psd uses rsync, I was thinking about moving it to the same folder and just letting psd rsync everything over.

Last edited by Batou (2017-11-14 09:47:06)

adesh · 2017-11-14 10:59:47

or you can use asd for the cache.

graysky · 2017-11-14 20:17:41

I never cared to nor noticed an ill effect of having ~/.cache as tmpfs. Your use case might be different.

Batou · 2017-11-15 01:04:54

I've looked at the psd's source and the way it syncs and don't see any reasons why it wouldn't sync properly some extra folders inside of the "Default". I'm actually tempted to do this but Chromium (the Arch build from extras anyway) has been extremely buggy for me lately and plan on abandoning it for another browser so I probably won't bother with it for now.

graysky · 2017-11-15 01:11:02

Again, I recommend just using tmpfs and trashing it between boots.

Batou · 2017-11-17 13:29:34

graysky wrote:

Again, I recommend just using tmpfs and trashing it between boots.

Alright, I've been running Chromium for the past day with cache on a tmpfs and haven't had any issues. Thanks for the advice graysky.

Mr Green · 2017-11-23 17:10:35

Running systemd --user does not seem to work

Profile-sync-daemon v6.31 on Arch Linux

 /usr/bin/psd [option]
  preview	Parse config file (/home/mrgreen/.config/psd/.psd.conf) to see which profiles will be managed.
  clean		Clean (delete without prompting) ALL crashrecovery dirs for all profiles.

 It is HIGHLY DISCOURAGED to directly call /usr/bin/psd to sync, resync, or to unsync.

 Instead, use systemd to start/stop profile-sync-daemon.

 systemctl --user [option] psd
  start		Turn on daemon; make symlinks and actively manage targets in tmpfs.
  stop		Turn off daemon; remove symlinks and rotate tmpfs data back to disc.
  enable	Autostart daemon when system comes up.
  disable	Remove daemon from the list of autostart daemons.
[mrgreen@arch ~]$ systemctl --user enable psd
[mrgreen@arch ~]$ systemctl | grep psd
[mrgreen@arch ~]$ systemctl --user start psd
[mrgreen@arch ~]$ systemctl | grep psd
[mrgreen@arch ~]$

Am I doing something wrong?

carlitos · 2017-11-29 21:08:30

Mr Green wrote:

Am I doing something wrong?

You probably are, try querying as --user:

systemctl --user|grep psd

Cheers

graysky · 2017-11-29 22:19:57

@Mr Green - Sorry, I did not see your reply. I believe that carlitos is correct. Try his command as simple: `psd p`

% psd p
Profile-sync-daemon v6.31 on Arch Linux

 Systemd service is currently active.
 Systemd resync-timer is currently active.
 Overlayfs v23 is currently active.

Psd will manage the following per /home/facade/.config/psd/.psd.conf:

 browser/psname:  chromium/chromium
 owner/group id:  facade/100
 sync target:     /home/facade/.config/chromium
 tmpfs dir:       /run/user/1000/facade-chromium
 profile size:    160M
 overlayfs size:  68M
 recovery dirs:   none

Or

% systemctl --user status psd
● psd.service - Profile-sync-daemon
   Loaded: loaded (/usr/lib/systemd/user/psd.service; enabled; vendor preset: enabled)
   Active: active (exited) since Wed 2017-11-29 14:59:16 EST; 2h 20min ago
     Docs: man:psd(1)
           man:profile-sync-daemon(1)
           https://wiki.archlinux.org/index.php/Profile-sync-daemon
  Process: 544 ExecStart=/bin/true (code=exited, status=0/SUCCESS)
 Main PID: 544 (code=exited, status=0/SUCCESS)
   CGroup: /user.slice/user-1000.slice/user@1000.service/psd.service

Nov 29 14:59:16 ease systemd[538]: Starting Profile-sync-daemon...
Nov 29 14:59:16 ease systemd[538]: Started Profile-sync-daemon.

Mr Green · 2017-11-30 16:45:24

Look like it is running:

[mrgreen@arch ~]$ psd d
Profile-sync-daemon v6.31 on Arch Linux

 /usr/bin/psd [option]
  preview	Parse config file (/home/mrgreen/.config/psd/.psd.conf) to see which profiles will be managed.
  clean		Clean (delete without prompting) ALL crashrecovery dirs for all profiles.

 It is HIGHLY DISCOURAGED to directly call /usr/bin/psd to sync, resync, or to unsync.

 Instead, use systemd to start/stop profile-sync-daemon.

 systemctl --user [option] psd
  start		Turn on daemon; make symlinks and actively manage targets in tmpfs.
  stop		Turn off daemon; remove symlinks and rotate tmpfs data back to disc.
  enable	Autostart daemon when system comes up.
  disable	Remove daemon from the list of autostart daemons.
[mrgreen@arch ~]$ systemctl --user status psd
● psd.service - Profile-sync-daemon
   Loaded: loaded (/usr/lib/systemd/user/psd.service; enabled; vendor preset: enabled)
   Active: active (exited) since Thu 2017-11-30 16:33:50 GMT; 4min 22s ago
     Docs: man:psd(1)
           man:profile-sync-daemon(1)
           https://wiki.archlinux.org/index.php/Profile-sync-daemon
  Process: 454 ExecStart=/bin/true (code=exited, status=0/SUCCESS)
 Main PID: 454 (code=exited, status=0/SUCCESS)
   CGroup: /user.slice/user-1000.slice/user@1000.service/psd.service

Nov 30 16:33:50 arch systemd[447]: Starting Profile-sync-daemon...
Nov 30 16:33:50 arch systemd[447]: Started Profile-sync-daemon.

c00ter · 2017-12-02 18:05:14

Mr Green, did you change /home/user/.config/psd/psd.conf to reflect the browser(s) you will be using with PSD? And did you change /etc/sudoers to use the overlayfs mode as the PSD wiki suggests? https://wiki.archlinux.org/index.php/Pr … fs_mode.3F

Mr Green · 2017-12-02 18:53:44

  seamonkey
#  surf
#  vivaldi
#  vivaldi-snapshot
#
BROWSERS="firefox"

# Uncomment and set to "no" to completely disable the crash recovery feature.
#

Have not got overlay set....

PBS · 2018-01-05 14:16:14

@graysky Is there an advantage of this approach as opposed to just blocking fsync? As far as I can see, mounting the filesystem with commit=(some large number) and turning on libeatmydata has exactly the same benefits as psd does in overlayfs mode. (Granted, psd has a backup system, and some users may only want this enabled for browsers.)

Mr Green · 2018-01-14 09:29:26

I have tried to get psd running again but output I get seems to show psd has stopped?

[mrgreen@arch system]$ systemctl --user status psd.service
● psd.service - Profile-sync-daemon
   Loaded: loaded (/usr/lib/systemd/user/psd.service; enabled; vendor preset: enabled)
   Active: active (exited) since Sun 2018-01-14 09:20:55 GMT; 2min 37s ago
     Docs: man:psd(1)
           man:profile-sync-daemon(1)
           https://wiki.archlinux.org/index.php/Profile-sync-daemon
  Process: 446 ExecStart=/bin/true (code=exited, status=0/SUCCESS)
 Main PID: 446 (code=exited, status=0/SUCCESS)

Jan 14 09:20:55 arch systemd[440]: Starting Profile-sync-daemon...
Jan 14 09:20:55 arch systemd[440]: Started Profile-sync-daemon.
[mrgreen@arch system]$

Arch Linux

#801 2017-06-21 08:45:12

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#802 2017-06-21 09:02:04

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#803 2017-06-21 14:41:29

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#804 2017-06-21 14:55:54

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#805 2017-06-21 19:32:45

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#806 2017-08-28 09:43:07

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#807 2017-08-28 10:05:56

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#808 2017-09-08 00:01:08

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#809 2017-09-09 19:25:38

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#810 2017-11-14 06:41:33

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#811 2017-11-14 08:52:34

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#812 2017-11-14 09:46:38

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#813 2017-11-14 10:59:47

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#814 2017-11-14 20:17:41

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#815 2017-11-15 01:04:54

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#816 2017-11-15 01:11:02

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#817 2017-11-17 13:29:34

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#818 2017-11-23 17:10:35

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#819 2017-11-29 21:08:30

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#820 2017-11-29 22:19:57

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#821 2017-11-30 16:45:24

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#822 2017-12-02 18:05:14

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#823 2017-12-02 18:53:44

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#824 2018-01-05 14:16:14

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#825 2018-01-14 09:29:26

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

Board footer