You are not logged in.

#226 2013-10-20 20:32:33

graysky
Member
From: The worse toilet in Scotland
Registered: 2008-12-01
Posts: 8,648
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

orschiro wrote:

You were correct. It runs as user. Should I report that upstream or might that be intentional?

Your call.


CPU-optimized Linux-ck packages @ Repo-ck  • AUR packagesZsh and other configs

Offline

#227 2013-11-14 23:21:53

Nattgew
Member
Registered: 2013-10-09
Posts: 30

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

I searched and couldn't find anything about using this with BOINC, so I thought I'd post my experience.
I tried to get this to sync the /var/lib/boinc/slots directory and it didn't go so well (I already have /var/lib/boinc mounted with bind to somewhere else, but that shouldn't be a problem?). At first I tried moving an existing setup, then I wiped it out and tried starting over with it. Same results, tasks kept giving errors (file size, no output file, etc.)

Output file PA0089_002A1_46_0_1 for task PA0089_002A1_46_0 absent

I see that asd creates a link between the directory and /dev/shm. I tried it using a tmpfs mount instead, and that seems to be working fine.
I'm not sure what it is about BOINC that doesn't work here. Ownership seemed to be fine, and permissions seemed to be fine. If BOINC doesn't like links, maybe asd could have an option to use tmpfs mount instead?
Just thought I'd share this. Not sure if anyone has any experience with this or knows what's going on.

Offline

#228 2013-11-14 23:30:12

graysky
Member
From: The worse toilet in Scotland
Registered: 2008-12-01
Posts: 8,648
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

@Nattgew - Never used BOINC or tested asd with it.  In principal, I can't see why it wouldn't work as-is.  I don't understand what you mean by "I see that asd creates a link between the directory and /dev/shm. I tried it using a tmpfs mount instead, and that seems to be working fine."  /dev/shm is a tmpfs mount.  Stop asd and post the output of

ls -l /var/lib/boinc

CPU-optimized Linux-ck packages @ Repo-ck  • AUR packagesZsh and other configs

Offline

#229 2013-11-22 19:00:39

Nattgew
Member
Registered: 2013-10-09
Posts: 30

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

What I meant is that it looks like asd creates a link from /var/lib/boinc/slots to /dev/shm/whatever and this wouldn't work right.
If I just mount /var/lib/boinc/slots directly as tmpfs, it works.
This is how the slots directory looks without messing with it:

drwxrwx--x 8 boinc boinc    4096 Nov 19 20:53 slots

After more research and testing I decided I might try to do the whole /var/lib/boinc directory, I may be up for that in a week or so.

Offline

#230 2013-12-01 04:57:43

gee
Member
Registered: 2006-11-29
Posts: 242

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

Hello graysky,
thanks for the asd and psd!

I started using psd yesterday on a machine with a usb drive for hd and it helped a lot with Chromium!
I am thinking of usind asd now, but I am not sure on what... it pretty much only runs Xorg, KDE.
Is there any way to use it for X or KDE? or is it useless in that sense?

Offline

#231 2013-12-01 11:10:39

graysky
Member
From: The worse toilet in Scotland
Registered: 2008-12-01
Posts: 8,648
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

Unless you have a specific target dir in mind, I wouldn't use it.  I use it for /var/lib/monitorix


CPU-optimized Linux-ck packages @ Repo-ck  • AUR packagesZsh and other configs

Offline

#232 2013-12-01 11:42:26

gee
Member
Registered: 2006-11-29
Posts: 242

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

That's probably why I couldn't find how to use it then, thanks!

Offline

#233 2014-03-11 09:34:45

joximus
Member
Registered: 2014-03-11
Posts: 7

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

After reading this thread I got the impression that using asd on /var/log is a bad idea. Am I right? Maybe thing have changed and there are no problems for this now?

Offline

#234 2014-03-11 09:58:57

graysky
Member
From: The worse toilet in Scotland
Registered: 2008-12-01
Posts: 8,648
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

I haven't tried in a long time.  Unclear how it will play with systemd.  Maybe I need to install to a test partition and see.  The volatile setting in journal.conf kind of makes it pointless now, unless you have other programs hitting /var/log hard.


CPU-optimized Linux-ck packages @ Repo-ck  • AUR packagesZsh and other configs

Offline

#235 2014-03-11 10:46:55

joximus
Member
Registered: 2014-03-11
Posts: 7

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

graysky wrote:

I haven't tried in a long time.  Unclear how it will play with systemd.  Maybe I need to install to a test partition and see.  The volatile setting in journal.conf kind of makes it pointless now, unless you have other programs hitting /var/log hard.

If I use volatile setting my journal will be lost in case of reboot which is not desired.

Offline

#236 2014-03-11 18:50:35

graysky
Member
From: The worse toilet in Scotland
Registered: 2008-12-01
Posts: 8,648
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

@jox - If you are able to spin up a test case, either in a vbox or physical partition and try it, please report back.


CPU-optimized Linux-ck packages @ Repo-ck  • AUR packagesZsh and other configs

Offline

#237 2014-03-13 12:15:23

joximus
Member
Registered: 2014-03-11
Posts: 7

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

graysky wrote:

@jox - If you are able to spin up a test case, either in a vbox or physical partition and try it, please report back.

I have tried it on my cubieboard [ARM] and I'not satisfied with results. It seems that although I have started asd service journald keeps writing to the old journal file on file system instead of one relocated to memory.

Offline

#238 2014-03-13 13:41:10

graysky
Member
From: The worse toilet in Scotland
Registered: 2008-12-01
Posts: 8,648
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

Good to know; thanks for testing.


CPU-optimized Linux-ck packages @ Repo-ck  • AUR packagesZsh and other configs

Offline

#239 2014-03-27 20:59:11

graysky
Member
From: The worse toilet in Scotland
Registered: 2008-12-01
Posts: 8,648
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

I just pushed v3.20-1 which brings the code base in asd in sync (no pun intended) with psd.  Seems good on my test machines but please test and post if you find problems.


CPU-optimized Linux-ck packages @ Repo-ck  • AUR packagesZsh and other configs

Offline

#240 2014-05-24 10:25:16

bbarcher
Member
From: Poland
Registered: 2014-02-27
Posts: 174
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

Is there a way to simply exlude a directory from being synced? I plan on syncing entire ~/.cache but the 900 MB Evolution email client cache is rarely used by me. And big.


Put up or shut up. 
--Austin Meyer, the lead developer of X-Plane
[ url=http://... ]  Text  [ /url ]

Offline

#241 2014-05-24 10:50:46

graysky
Member
From: The worse toilet in Scotland
Registered: 2008-12-01
Posts: 8,648
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

Not currently and not without making configuration more complex.


CPU-optimized Linux-ck packages @ Repo-ck  • AUR packagesZsh and other configs

Offline

#242 2014-05-24 11:55:26

bbarcher
Member
From: Poland
Registered: 2014-02-27
Posts: 174
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

Why does ASD use /dev/shm/... while PSD uses /tmp/... ?


Put up or shut up. 
--Austin Meyer, the lead developer of X-Plane
[ url=http://... ]  Text  [ /url ]

Offline

#243 2014-05-24 12:22:44

graysky
Member
From: The worse toilet in Scotland
Registered: 2008-12-01
Posts: 8,648
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

Due to the behavior of bleachbit nastily deleting files some in /tmp ... it does not hurt the naming scheme psd uses, but i have suffered data loss from it + asd in the past syncing to /tmp which is why I moved it.


CPU-optimized Linux-ck packages @ Repo-ck  • AUR packagesZsh and other configs

Offline

#244 2014-05-24 12:38:15

bbarcher
Member
From: Poland
Registered: 2014-02-27
Posts: 174
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

This is what I don't understand. If /tmp is more prone to bleachbit why use it for PSD which holds more sensitive data?


Put up or shut up. 
--Austin Meyer, the lead developer of X-Plane
[ url=http://... ]  Text  [ /url ]

Offline

#245 2014-05-24 12:44:50

graysky
Member
From: The worse toilet in Scotland
Registered: 2008-12-01
Posts: 8,648
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

graysky wrote:

it does not hurt the naming scheme psd uses, but i have suffered data loss from it + asd in the past syncing to /tmp which is why I moved it.


CPU-optimized Linux-ck packages @ Repo-ck  • AUR packagesZsh and other configs

Offline

#246 2014-05-24 13:09:26

bbarcher
Member
From: Poland
Registered: 2014-02-27
Posts: 174
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

Ah, OK. I guess I'm not able to fully understand what it means. Please don't mind me.


Put up or shut up. 
--Austin Meyer, the lead developer of X-Plane
[ url=http://... ]  Text  [ /url ]

Offline

#247 2014-05-24 17:09:39

Markus00000
Member
Registered: 2011-03-27
Posts: 302

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

Is it not supported to sync /var/log? I've noticed logrotate.service failing to start when asd.service is enabled.

Offline

#248 2014-05-24 18:48:23

graysky
Member
From: The worse toilet in Scotland
Registered: 2008-12-01
Posts: 8,648
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

Initially, I found syncing /var/log was a bad idea, but then other users have reported no ill effects of doing it.  I use it for /srv/http these days.


CPU-optimized Linux-ck packages @ Repo-ck  • AUR packagesZsh and other configs

Offline

#249 2014-08-05 11:15:45

Nordic89
Member
Registered: 2014-05-07
Posts: 49

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

Thanks graysky, psd works great for me already. (And thank you for your work with linux-ck as well). I don't know what directories to sync with asd though. Where do the different programs usually store that data that would make sense to be synced with asd?

Offline

#250 2014-08-05 18:53:49

graysky
Member
From: The worse toilet in Scotland
Registered: 2008-12-01
Posts: 8,648
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

I run monitorix so I sync out the databases dir.


CPU-optimized Linux-ck packages @ Repo-ck  • AUR packagesZsh and other configs

Offline

Board footer

Powered by FluxBB