profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

graysky · 2016-07-12 11:01:25

Well, if you don't want the backups, run `psd c` to delete them. You also truncated the output so I don't know what version you're using or if you trying to use overlayfs. Running `psd p` in autostart won't accomplish anything since the parse mode just displays output.

zaxdan69 · 2016-07-12 11:10:27

here is the output:

Profile-sync-daemon v6.24 on Arch Linux

 Systemd service is currently inactive.
 Systemd resync-timer is currently inactive.
 Overlayfs technology is currently inactive.

Psd will manage the following per /home/archuser/.config/psd/psd.conf:

 browser/psname:  firefox/firefox
 owner/group id:  archuser/100
 sync target:     /home/archuser/.mozilla/firefox/g89ltmxv.default
 tmpfs dir:       /run/user/1000/archuser-firefox-g89ltmxv.default
 profile size:    17M
 recovery dirs:   none

 browser/psname:  google-chrome/chrome
 owner/group id:  archuser/100
 sync target:     /home/archuser/.config/google-chrome
 tmpfs dir:       /run/user/1000/archuser-google-chrome
 profile size:    233M
 recovery dirs:   none

I haven't anything else.

Last edited by zaxdan69 (2016-07-12 11:11:34)

graysky · 2016-07-12 11:14:48

So that looks normal... try this:
1) systemctl --user start psd
2) psd p

zaxdan69 · 2016-07-12 11:21:02

Profile-sync-daemon v6.24 on Arch Linux

 Systemd service is currently active.
 Systemd resync-timer is currently active.
 Overlayfs technology is currently inactive.

Psd will manage the following per /home/archuser/.config/psd/psd.conf:

the rest are the same

graysky · 2016-07-12 11:37:05

OK... if you enable the service now (systemctl --user enable psd), and reboot

1) Do you experience the delays?
2) Do you experience any prompts for authentication?
3) Are there any new crash recovery dirs (psd p)?

zaxdan69 · 2016-07-12 11:48:15

Ok, now I dont get aythentication dialog, but I still have a 30sec delay on boot.
There aren't any crash recovery dirs.

EDIT:
systemd-analyze blame shows
23.878s user@1000.service
which is the delay I have(almost 30secs).

Last edited by zaxdan69 (2016-07-12 11:50:13)

graysky · 2016-07-12 12:02:04

Anything special about your setup? Encryption?

zaxdan69 · 2016-07-12 12:03:31

No

graysky · 2016-07-12 12:32:45

I'm not sure what could be causing the delay unless it is due to the copying of your ~250M of profile data... is your machine very slow or using a spinning HDD? Have you tried the overlayfs mode?

zaxdan69 · 2016-07-12 14:58:13

No, I recently get an SSD disk 250GB and I moved the OS there. Also I have 8GB memory 1866MHZ from which is used about 15-45% usually.
I haven't tried overlayfs mode yet, but I will try it now.

EDIT:
Use of overlayfs improved the boot time(~7s user@1000.service), but the same as before happens when I logout and reloging(23.878s user@1000.service again).
No delays when disable the service and start it from xfce autostart though(~33ms user@1000.service).

Last edited by zaxdan69 (2016-07-12 15:25:38)

Minbari · 2016-08-11 08:48:15

Since last update (psd update) my firefox had a crazy behave. It freeze my bookmarks. If I save a page to bookmarks it save her for actual session but if I restart my PC the saved bookmard is gone. I disable all add-ons, then I check every single one or in pairs the same result. When I disable psd things go back to the normal way and saved bookmarks are where is suppose to be.

graysky · 2016-08-11 10:01:12

Post the output of 'psd p'

Minbari · 2016-08-11 11:39:56

This is the psd p output. Everythig seems to work fine but it freeze bookmarks.

 psd p
Profile-sync-daemon v6.25 on Arch Linux

 Systemd service is currently active.
 Systemd resync-timer is currently active.
 Overlayfs v23 is currently active.

Psd will manage the following per /home/anbu/.config/psd/.psd.conf:

 browser/psname:  firefox/firefox
 owner/group id:  anbu/100
 sync target:     /home/anbu/.mozilla/firefox/3i5plxe0.default
 tmpfs dir:       /run/user/1000/anbu-firefox-3i5plxe0.default
 profile size:    14M
 overlayfs size:  12M
 recovery dirs:   none

dodo3773 · 2016-09-30 02:57:27

Hey graysky. Glad to see you are still around. I have a question for you. When this project was very new wasn't it possible to use a mount point that had noexec as one of it's mount options? I realized recently that this cannot be done now (or was it always that way?). If I am correct about this; then what changed?

graysky · 2016-09-30 07:13:45

@dodo - I think so... try searching the git history for 'noexec' to verify.

dodo3773 · 2016-09-30 20:25:11

graysky wrote:

@dodo - I think so... try searching the git history for 'noexec' to verify.

Unsure how to search github history. I found 700 in the .conf page. Although looking into it further my /tmp directory is 1777. When I uncomment VOLATILE="/tmp" from .config/psd/psd.conf (not using overlayfs) nothing goes into /tmp when I resync. My mount options there are: "tmpfs on /tmp type tmpfs (rw,nosuid,nodev,noexec,relatime)". This probably changed a long time ago but I noticed only recently. The profile is still synced in tmpfs under /run/user/1000/ so everything is working as intended. I just remember part of the appeal being that I could remove exec permission from the profile. Although, I suppose that would probably break things for some people? My guess is that I would have to change some things in the script itself in /usr/bin. Just going to leave it alone for now. Thanks graysky

graysky · 2016-09-30 21:35:35

dodo3773 wrote:

Unsure how to search github history. I found 700 in the .conf page.

I would just grep 'noexec' out of the .git directory

dodo3773 wrote:

When I uncomment VOLATILE="/tmp" from .config/psd/psd.conf (not using overlayfs) nothing goes into /tmp when I resync.

Correct. You haven't diffed your psd.conf against /usr/share/psd/psd.conf I suspect. The VOLATILE variable in the config has been deprecated for a while now in favor of the systemd generated /run/user/xxxx location (700 by default). If you're wanting the 'noexec' flag on that, I'm not sure without googling how to do it. On my system the mount options are:

rw,nosuid,nodev,relatime,size=3271748k,mode=700,uid=1000,gid=100

dodo3773 · 2016-09-30 21:43:28

graysky wrote:

Correct. You haven't diffed your psd.conf against /usr/share/psd/psd.conf I suspect. The VOLATILE variable in the config has been deprecated for a while now in favor of the systemd generated /run/user/xxxx location (700 by default). If you're wanting the 'noexec' flag on that, I'm not sure without googling how to do it. On my system the mount options are:
rw,nosuid,nodev,relatime,size=3271748k,mode=700,uid=1000,gid=100

Your suspicion was right! No wonder that variable didn't work hahahaha. Thanks, I should be able to figure it out from here.

graysky · 2016-10-02 15:21:40

I made some internal changes to psd in an effort to clean up the code base (the diffs between v6.26 stable and my latest commit can be seen here).
These changes have been committed to master but not yet tagged for release.

I'd like to ask for some broader testing (beyond what I have done). Please direct comments to the github page rather than to this thread (just open an issue).

You can build using profile-sync-daemon-git from the AUR. Like any *-git package, it conflicts with the stable version so pacman will remove psd and replace it with psd-git which will close any managed browsers by design.

Always recommended that you BACKUP your managed profiles before using psd.

Thanks!

jpjenkins · 2016-10-22 16:55:16

Hi graysky, trying to get this up and running but my efforts hit a wall straight away when I execute 'psd':

ERROR: Cannot find XDG_RUNTIME_DIR which should be set by systemd.

I asked around on the irc channel but nobody has answers and had a quick browse through these threads but nothing pops up.

Any ideas?

Cheers

EDIT: I've just come across this post - https://bbs.archlinux.org/viewtopic.php?id=217666 - apparently someone else had problems. I am also dealing with +30s delays when logging in but thought this was a separate issue. Any insights would be appreciated, would love to get psd set up properly without login delays Thanks!

Last edited by jpjenkins (2016-10-22 17:03:11)

graysky · 2016-10-22 17:04:00

Are you using systemd? What is the output of:

echo $XDG_RUNTIME_DIR

and of

ls -l /run/user

jpjenkins · 2016-10-22 17:33:35

Hi graysky,

Thanks for your quick reply.

After some digging, I realised that all my current issues was because of the psd.service in default.target.wants.

I deleted psd, installed the git version, removed it from default.target.wants and so far so good, checking user1000 returns no fails and psd is now loaded.

Just a quick question: is it simply systemctl enable psd to get it running at startup?

Thanks!

jpjenkins · 2016-10-22 17:53:14

It looks like everything is going nicely, ridiculous speed improvements, thank you

However, I have another question, just to make sure everything is properly set up.

I have this:

Profile-sync-daemon vr648.18955ef on Arch Linux

 Systemd service is currently inactive.
 Systemd resync-timer is currently inactive.
 Overlayfs v23 is currently active.

Psd will manage the following per /home/jamie/.config/psd/psd.conf:

 browser/psname:  chromium/chromium
 owner/group id:  jamie/100
 sync target:     /home/jamie/.config/chromium
 tmpfs dir:       /run/user/1000/jamie-chromium
 profile size:    426M
 overlayfs size:  
 recovery dirs:   none

I checked /run/user/1000/jamie-chromium but it doesn't exist and it shows up in red in 'psd p' too. Should I be concerned?

EDIT: Okay, the next sentence I read was on https://wiki.archlinux.org/index.php/Pr … erlayfs.3F

It answered my question. But how come no size appears on the 'overlayfs size' section provided above?

Sorry for all the questions, this is the last stretch of a few weeks of issues

Last edited by jpjenkins (2016-10-22 17:56:05)

jpjenkins · 2016-10-22 18:35:39

Sorry to bother you again, so, it turns out, that no, psd is not running. Since the xdg was fixed and logind initialised everything properly, it enabled a few programs that had been installed and lying dormant, now caching a few things which made it faster, tricking me.

I have a psd.service file in the following locations

/home/jamie/.config/systemd/user/default.target.wants/psd.service
/usr/lib/systemd/user/psd.service

Yet when I try to start/enable psd it tells me that it cannot be found.

Any insights?

Thanks

graysky · 2016-10-22 19:04:02

jpjenkins wrote:

After some digging, I realised that all my current issues was because of the psd.service in default.target.wants.
I deleted psd, installed the git version, removed it from default.target.wants and so far so good, checking user1000 returns no fails and psd is now loaded.
Just a quick question: is it simply systemctl enable psd to get it running at startup?

I don't understand what you mean by psd.service sentence... you don't need the git package, although right now the stable version is in sync with the git version. Yes, see the man page

man psd wrote:

START AND STOP PSD
With the release of the version 6.x series of psd, the only init system that is officially supported is systemd. Psd ships with a systemd user service to start or stop it (psd.service). Additionally, a provided resync-timer will run an hourly resync from tmpfs back to the disk. The resync-timer is started automatically with psd.service so there is no need to attempt to start the timer.
$ systemctl --user [option] psd.service
Available options:
start
stop
enable
disable

jpjenkins wrote:

But how come no size appears on the 'overlayfs size' section provided above?

Based on your `psd p` output, you have not initialized the user service and therefore have not created the overflayfs mount. See above.

jpjenkins wrote:

Yet when I try to start/enable psd it tells me that it cannot be found.

You likely are calling systemctl to start a system service (ie without the --user switch); again see above or the man page.

Arch Linux

#751 2016-07-12 11:01:25

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#752 2016-07-12 11:10:27

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#753 2016-07-12 11:14:48

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#754 2016-07-12 11:21:02

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#755 2016-07-12 11:37:05

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#756 2016-07-12 11:48:15

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#757 2016-07-12 12:02:04

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#758 2016-07-12 12:03:31

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#759 2016-07-12 12:32:45

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#760 2016-07-12 14:58:13

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#761 2016-08-11 08:48:15

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#762 2016-08-11 10:01:12

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#763 2016-08-11 11:39:56

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#764 2016-09-30 02:57:27

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#765 2016-09-30 07:13:45

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#766 2016-09-30 20:25:11

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#767 2016-09-30 21:35:35

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#768 2016-09-30 21:43:28

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#769 2016-10-02 15:21:40

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#770 2016-10-22 16:55:16

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#771 2016-10-22 17:04:00

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#772 2016-10-22 17:33:35

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#773 2016-10-22 17:53:14

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#774 2016-10-22 18:35:39

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#775 2016-10-22 19:04:02

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

Board footer