profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

nomorewindows · 2014-05-13 20:01:26

Should I even be running psd if I'm using proxy server? Would this be contradictory or double work load?

graysky · 2014-05-13 20:18:18

Doesn't matter... proxy just means your routing your traffic through someone else's connection. Your profile doesn't care if the traffic is local or otherwise.

nomorewindows · 2014-05-13 20:21:22

I think I went through FF preferences under cache and it said it was using 0 disk space as if the squid proxy caches all of the files instead of FF.

graysky · 2014-05-13 20:24:31

Caching files is one aspect of the browser profile, there are others including databases like history. Guess if you really want to know, run `iotop -Pao` while browsing and see after an hour or so much many read/writes got racked up (do not use psd for this as I don't think iotop watches tmpfs).

bbarcher · 2014-05-24 13:26:52

Graysky, could you please take a look at this?
Basically, I'm not sure PSD and ASD actually sync the files to RAM. When I check memory usage using Gnome System Monitor it shows 500 MB used with PSD+ASD enabled and the same amount with them disabled. But:
PSD+ASD disabled

# free -m
             total       used       free     shared    buffers     cached
Mem:          7883        951       6931        119         75        373
-/+ buffers/cache:        502       7381
Swap:            0          0          0

PSD+ASD enabled

# free -m
             total       used       free     shared    buffers     cached
Mem:          7883       1260       6623        342         76        776
-/+ buffers/cache:        407       7476
Swap:            0          0          0

It seems that GSM does not show the "used" and everything's ok, right?

# profile-sync-daemon parse
Profile-sync-daemon v5.45.1 on Arch Linux.

 Systemd service is currently active.
 Systemd resync service is currently active.

Psd will manage the following per /etc/psd.conf settings:

 browser/psname:  firefox/firefox
 owner/group id:  xxx/1000
 sync target:     /home/xxx/.mozilla/firefox/yyyy.default
 tmpfs dir:       /tmp/xxx-firefox-yyyy.default
 profile size:    107M

# anything-sync-daemon debug
Anything-sync-daemon v3.21 on Arch Linux.

 Systemd service is currently active.
 Systemd resync service is currently active.

Asd will manage the following per /run/asd.conf settings:

 owner/group id:     xxx/1000
 target to manage:   /home/xxx/.cache
 sync target:        /home/xxx/..cache-backup_asd
 tmpfs target:       /dev/shm/asd-xxx/home/xxx/.cache
 dir size:           141M

Q2: Can I launch Firefox right after my system starts without waiting for PSD to do its thing?

Q3: If I e.g. install a new Firefox extension it will actually first install to the profile in the RAM and then get synced into the profile on disk?
I'm asking this question because *I think* at one time when I was doing some cleanup through Firefox > History some files disappeared from disk first, right after I ordered cleanup.

Last edited by bbarcher (2014-05-24 13:28:22)

Markus00000 · 2014-06-09 10:31:45

graysky, can you explain what the following messages mean?

During boot:

[ SKIP ] Ordering cycle found, skipping Timers

From the systemd journal:

systemd[1]: Job timers.target/start deleted to break ordering cycle starting with basic.target/start

They disappear as soon as psd.service is disabled.

Last edited by Markus00000 (2014-06-12 13:25:46)

FarStar07 · 2014-06-23 11:50:47

Hello graysky,

Please, could PSD support the new Opera for Linux?
http://blogs.opera.com/desktop/2014/06/ … er-stream/

The profile directory is: ~/.config/opera-developer/

Thank you ;-)

Last edited by FarStar07 (2014-06-23 15:58:40)

mbab · 2014-06-23 16:59:50

FarStar07 wrote:

Hello graysky,
Please, could PSD support the new Opera for Linux?

And also If You be so kind Palemoon browser

with profile located at $HOME/.moonchild productions/pale moon

Thanks in advance

graysky · 2014-06-23 20:19:40

@Farstar - I don't use opera... I am currently supporting 'opera' and 'opera-next' ... what you're asking for 'opera-developer' I suppose?
@mbab - Yeah, I meant to look into it, but haven't had the time.

EDIT: wishes granted long live jambi. I haven't had time to fully test so I need you guys to do that for me. You may build profile-sync-daemon-git which pulls from my unstable branch. As always, backup your profiles before you continue. Please test out with the two new browsers you asked me to include.

Last edited by graysky (2014-06-23 21:24:12)

FarStar07 · 2014-06-24 04:27:46

@graysky: yes, it's opera-developer.
I just tried profile-sync-daemon-git and it seems to work perfectly. Many thanks to you!

Fadi · 2014-06-25 02:04:19

Hello @gray-sky,

should i add psd.cron.hourly to in crontab?

graysky · 2014-06-25 11:28:20

Fadi wrote:

Hello @gray-sky,
should i add psd.cron.hourly to in crontab?

See the man page or wiki: the package ships with a systemd timer which is enabled automatically when you start the service if using psd >=5.50-1. Verify this:

% systemctl list-timers
NEXT                         LEFT       LAST                         PASSED    UNIT                         ACTIVATES
Wed 2014-06-25 08:12:37 EDT  3s left    n/a                          n/a       systemd-tmpfiles-clean.timer systemd-tmpfiles-cle
Wed 2014-06-25 09:12:32 EDT  19min left n/a                          n/a       psd-resync.timer             psd-resync.service
Thu 2014-06-26 00:00:00 EDT  15h left   Wed 2014-06-25 07:57:41 EDT  14min ago logrotate.timer              logrotate.service
Thu 2014-06-26 00:00:00 EDT  15h left   Wed 2014-06-25 07:57:41 EDT  14min ago man-db.timer                 man-db.service
Thu 2014-06-26 00:00:00 EDT  15h left   Wed 2014-06-25 07:57:41 EDT  14min ago shadow.timer                 shadow.service

5 timers listed.
Pass --all to see loaded but inactive timers, too.
lines 1-9/9 (END)

Last edited by graysky (2014-06-25 12:14:05)

nomorewindows · 2014-07-10 16:02:46

I was using FoxyProxy extension on FF (so I can switch proxies quickly), and with using sqtop-git (from AUR), FF wasn't even using the proxy. This might be a bug in the FoxyProxy extension as if it was using cache instead. I was starting to wonder why sites like my search engine took forever to load up. It wasn't even using the proxy. Maybe a bug I need to file with the maintainer of the FoxyProxy extension. Anything I would've done with the iotop would have been all of the cache, and not on proxy.

Last edited by nomorewindows (2014-07-14 16:22:58)

nomorewindows · 2014-08-06 13:38:11

It seems FF acts differently when it's using it's cache versus when it uses the proxy. Usually FF pages from cache aren't always updated to the most recent, but when it gets its pages from the proxy they are updated.

graysky · 2014-08-15 07:44:25

This doesn't seems like an issue related to psd...

nomorewindows · 2014-08-15 12:17:22

I probably need to clean out my FF cache to see if it'll boot psd quicker now that I'm using proxy.

whompus · 2014-09-18 14:46:52

Hello graysky,

Please, could PSD support the new Opera-beta for Linux? (formerly known as Opera Next).
http://blogs.opera.com/desktop/2014/09/ … a-beta-25/

The profile directory is: ~/.config/opera-beta/

Thank you.

graysky · 2014-09-18 19:00:52

@whompus - you're saying that renamed opera-next to opera-beta? Is opera-next around any more? Plz try v5.52-1 which has this change.
https://github.com/graysky2/profile-syn … 51...v5.52

Last edited by graysky (2014-09-18 19:12:05)

whompus · 2014-09-19 10:00:28

Yes there is only Opera, Opera beta and Opera developer now. Update works great, thanks.

Last edited by whompus (2014-09-19 10:01:47)

Lockheed · 2014-11-03 13:16:16

Has there been any progress in adding support for encrypted $HOME directory to psd?

graysky · 2014-11-03 19:54:11

@Lockheed - No, nothing without using a systemd user session.

whompus · 2014-12-04 16:04:11

Hello graysky,
Please, could PSD support the new Opera 26 stable for Linux it uses a different profile directory.
The new profile directory is: ~/.config/opera/
Thank you.

graysky · 2014-12-04 18:27:43

Sure, try v5.53-1.

graysky · 2014-12-15 20:08:39

v5.54-1 has been released which has optional support for overlayfs to improve sync/unsync operations as well as lower the memory footprint. Typical speed ups are modest based on this HDD-based system. These times are on a fresh boot while systemd is loading up all other services, YMMV.

WIthout overlayfs:

% systemd-analyze blame | grep psd
          6.560s psd.service
           177ms psd-resync.service

With overlayfs:

% systemd-analyze blame | grep psd
          1.388s psd.service
           283ms psd-resync.service

The lower memory footprint is due how overlayfs works, only syncing to tmpfs what has changed in the profile. Here is an example running psd in parse mode, note the "overlayfs size" report compared to the total "profile size" report for each profile:

% psd p
Profile-sync-daemon v5.54 on Arch Linux.

 Systemd service is currently active.
 Systemd resync service is currently active.
 Overlayfs technology is currently active.

Psd will manage the following per /run/psd.conf settings:

 browser/psname:  chromium/chromium
 owner/group id:  facade/100
 sync target:     /home/facade/.config/chromium
 tmpfs dir:       /tmp/facade-chromium
 profile size:    93M
 overlayfs size:  7.3M

 browser/psname:  firefox/firefox
 owner/group id:  facade/100
 sync target:     /home/facade/.mozilla/firefox/f8cv8bfu.default
 tmpfs dir:       /tmp/facade-firefox-f8cv8bfu.default
 profile size:    145M
 overlayfs size:  13M

These numbers will change depending on just how much data is written to the profile, but you get the idea. In order to use this new feature, a kernel version >=3.18 is needed and as of today the Arch devs have not yet updated the linux package to the 3.18 series. Just wanted to make users aware of it.

geo909 · 2014-12-16 19:00:00

Hi,

First off, thanks for this great tool, it has made my browsing experience extremely better on my old laptop.

I have a problem; psd seems to keep too many backups of older snapshots. In particular, this is how things look right now:

jorge@flamingo:~$ cd .mozilla/firefox
jorge@flamingo:~/.mozilla/firefox$ du -sh 
2.8G	.
jorge@flamingo:~/.mozilla/firefox$ du -sh *
18M	eff1mp7s.Default User
4.0K	profiles.ini
0	s38ms72r.default
217M	s38ms72r.default-backup
53M	s38ms72r.default-backup-crashrecovery-20140227_115737
66M	s38ms72r.default-backup-crashrecovery-20140621_194907
65M	s38ms72r.default-backup-crashrecovery-20140622_174956
64M	s38ms72r.default-backup-crashrecovery-20140622_205708
66M	s38ms72r.default-backup-crashrecovery-20140623_215232
330M	s38ms72r.default-backup-crashrecovery-20140914_161840
212M	s38ms72r.default-backup-crashrecovery-20140926_195100
213M	s38ms72r.default-backup-crashrecovery-20141009_211612
210M	s38ms72r.default-backup-crashrecovery-20141109_044220
212M	s38ms72r.default-backup-crashrecovery-20141124_185143
214M	s38ms72r.default-backup-crashrecovery-20141129_153650
211M	s38ms72r.default-backup-crashrecovery-20141130_142925
210M	s38ms72r.default-backup-crashrecovery-20141207_095831
217M	s38ms72r.default-backup-crashrecovery-20141210_094126
217M	s38ms72r.default-backup-crashrecovery-20141210_094617

Is there a way to change this behaviour of psd and keep only one backup?

Sorry in advance if this is discussed elsewhere, but I was not able to find it.

Arch Linux

#501 2014-05-13 20:01:26

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#502 2014-05-13 20:18:18

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#503 2014-05-13 20:21:22

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#504 2014-05-13 20:24:31

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#505 2014-05-24 13:26:52

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#506 2014-06-09 10:31:45

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#507 2014-06-23 11:50:47

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#508 2014-06-23 16:59:50

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#509 2014-06-23 20:19:40

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#510 2014-06-24 04:27:46

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#511 2014-06-25 02:04:19

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#512 2014-06-25 11:28:20

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#513 2014-07-10 16:02:46

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#514 2014-08-06 13:38:11

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#515 2014-08-15 07:44:25

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#516 2014-08-15 12:17:22

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#517 2014-09-18 14:46:52

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#518 2014-09-18 19:00:52

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#519 2014-09-19 10:00:28

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#520 2014-11-03 13:16:16

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#521 2014-11-03 19:54:11

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#522 2014-12-04 16:04:11

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#523 2014-12-04 18:27:43

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#524 2014-12-15 20:08:39

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

#525 2014-12-16 19:00:00

Re: profile-sync-daemon - keep browser profiles in tmpfs and sync'ed

Board footer