anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

graysky · 2013-10-20 20:32:33

orschiro wrote:

You were correct. It runs as user. Should I report that upstream or might that be intentional?

Your call.

Nattgew · 2013-11-14 23:21:53

I searched and couldn't find anything about using this with BOINC, so I thought I'd post my experience.
I tried to get this to sync the /var/lib/boinc/slots directory and it didn't go so well (I already have /var/lib/boinc mounted with bind to somewhere else, but that shouldn't be a problem?). At first I tried moving an existing setup, then I wiped it out and tried starting over with it. Same results, tasks kept giving errors (file size, no output file, etc.)

Output file PA0089_002A1_46_0_1 for task PA0089_002A1_46_0 absent

I see that asd creates a link between the directory and /dev/shm. I tried it using a tmpfs mount instead, and that seems to be working fine.
I'm not sure what it is about BOINC that doesn't work here. Ownership seemed to be fine, and permissions seemed to be fine. If BOINC doesn't like links, maybe asd could have an option to use tmpfs mount instead?
Just thought I'd share this. Not sure if anyone has any experience with this or knows what's going on.

graysky · 2013-11-14 23:30:12

@Nattgew - Never used BOINC or tested asd with it. In principal, I can't see why it wouldn't work as-is. I don't understand what you mean by "I see that asd creates a link between the directory and /dev/shm. I tried it using a tmpfs mount instead, and that seems to be working fine." /dev/shm is a tmpfs mount. Stop asd and post the output of

ls -l /var/lib/boinc

Nattgew · 2013-11-22 19:00:39

What I meant is that it looks like asd creates a link from /var/lib/boinc/slots to /dev/shm/whatever and this wouldn't work right.
If I just mount /var/lib/boinc/slots directly as tmpfs, it works.
This is how the slots directory looks without messing with it:

drwxrwx--x 8 boinc boinc    4096 Nov 19 20:53 slots

After more research and testing I decided I might try to do the whole /var/lib/boinc directory, I may be up for that in a week or so.

gee · 2013-12-01 04:57:43

Hello graysky,
thanks for the asd and psd!

I started using psd yesterday on a machine with a usb drive for hd and it helped a lot with Chromium!
I am thinking of usind asd now, but I am not sure on what... it pretty much only runs Xorg, KDE.
Is there any way to use it for X or KDE? or is it useless in that sense?

graysky · 2013-12-01 11:10:39

Unless you have a specific target dir in mind, I wouldn't use it. I use it for /var/lib/monitorix

gee · 2013-12-01 11:42:26

That's probably why I couldn't find how to use it then, thanks!

joximus · 2014-03-11 09:34:45

After reading this thread I got the impression that using asd on /var/log is a bad idea. Am I right? Maybe thing have changed and there are no problems for this now?

graysky · 2014-03-11 09:58:57

I haven't tried in a long time. Unclear how it will play with systemd. Maybe I need to install to a test partition and see. The volatile setting in journal.conf kind of makes it pointless now, unless you have other programs hitting /var/log hard.

joximus · 2014-03-11 10:46:55

graysky wrote:

I haven't tried in a long time. Unclear how it will play with systemd. Maybe I need to install to a test partition and see. The volatile setting in journal.conf kind of makes it pointless now, unless you have other programs hitting /var/log hard.

If I use volatile setting my journal will be lost in case of reboot which is not desired.

graysky · 2014-03-11 18:50:35

@jox - If you are able to spin up a test case, either in a vbox or physical partition and try it, please report back.

joximus · 2014-03-13 12:15:23

graysky wrote:

@jox - If you are able to spin up a test case, either in a vbox or physical partition and try it, please report back.

I have tried it on my cubieboard [ARM] and I'not satisfied with results. It seems that although I have started asd service journald keeps writing to the old journal file on file system instead of one relocated to memory.

graysky · 2014-03-13 13:41:10

Good to know; thanks for testing.

graysky · 2014-03-27 20:59:11

I just pushed v3.20-1 which brings the code base in asd in sync (no pun intended) with psd. Seems good on my test machines but please test and post if you find problems.

bbarcher · 2014-05-24 10:25:16

Is there a way to simply exlude a directory from being synced? I plan on syncing entire ~/.cache but the 900 MB Evolution email client cache is rarely used by me. And big.

graysky · 2014-05-24 10:50:46

Not currently and not without making configuration more complex.

bbarcher · 2014-05-24 11:55:26

Why does ASD use /dev/shm/... while PSD uses /tmp/... ?

graysky · 2014-05-24 12:22:44

Due to the behavior of bleachbit nastily deleting files some in /tmp ... it does not hurt the naming scheme psd uses, but i have suffered data loss from it + asd in the past syncing to /tmp which is why I moved it.

bbarcher · 2014-05-24 12:38:15

This is what I don't understand. If /tmp is more prone to bleachbit why use it for PSD which holds more sensitive data?

graysky · 2014-05-24 12:44:50

graysky wrote:

it does not hurt the naming scheme psd uses, but i have suffered data loss from it + asd in the past syncing to /tmp which is why I moved it.

bbarcher · 2014-05-24 13:09:26

Ah, OK. I guess I'm not able to fully understand what it means. Please don't mind me.

Markus00000 · 2014-05-24 17:09:39

Is it not supported to sync /var/log? I've noticed logrotate.service failing to start when asd.service is enabled.

graysky · 2014-05-24 18:48:23

Initially, I found syncing /var/log was a bad idea, but then other users have reported no ill effects of doing it. I use it for /srv/http these days.

Nordic89 · 2014-08-05 11:15:45

Thanks graysky, psd works great for me already. (And thank you for your work with linux-ck as well). I don't know what directories to sync with asd though. Where do the different programs usually store that data that would make sense to be synced with asd?

graysky · 2014-08-05 18:53:49

I run monitorix so I sync out the databases dir.

Arch Linux

#226 2013-10-20 20:32:33

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#227 2013-11-14 23:21:53

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#228 2013-11-14 23:30:12

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#229 2013-11-22 19:00:39

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#230 2013-12-01 04:57:43

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#231 2013-12-01 11:10:39

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#232 2013-12-01 11:42:26

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#233 2014-03-11 09:34:45

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#234 2014-03-11 09:58:57

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#235 2014-03-11 10:46:55

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#236 2014-03-11 18:50:35

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#237 2014-03-13 12:15:23

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#238 2014-03-13 13:41:10

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#239 2014-03-27 20:59:11

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#240 2014-05-24 10:25:16

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#241 2014-05-24 10:50:46

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#242 2014-05-24 11:55:26

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#243 2014-05-24 12:22:44

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#244 2014-05-24 12:38:15

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#245 2014-05-24 12:44:50

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#246 2014-05-24 13:09:26

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#247 2014-05-24 17:09:39

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#248 2014-05-24 18:48:23

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#249 2014-08-05 11:15:45

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#250 2014-08-05 18:53:49

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

Board footer