anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

DarioP · 2012-09-18 05:30:24

Mr Green wrote:

last night system would not power down correctly

This is one my biggest worry about it. Indeed I always stop the daemon manually and check everything's fine before starting the shut down procedure.

Mr Green · 2012-09-18 05:45:33

Hopefully latest version solves the problem.,...

graysky · 2012-09-18 09:21:21

DarioP wrote:

Mr Green wrote:
last night system would not power down correctly
This is one my biggest worry about it. Indeed I always stop the daemon manually and check everything's fine before starting the shut down procedure.

Odd, systemd should allow time to sync before powering down. If there are any systemd experts reading this, please let me know if the service file asd uses is kosher:

[Unit]
Description=Symlinks and syncs user defined dirs to RAM thus reducing HDD/SDD calls and speeding-up the system
Wants=local-fs.target

[Service]
Type=oneshot
RemainAfterExit=yes
ExecStart=/usr/bin/anything-sync-daemon sync
ExecStop=/usr/bin/anything-sync-daemon unsync

[Install]
WantedBy=multi-user.target

Mr Green · 2012-09-18 10:45:20

I get dropped to login prompt when booting, am using systemd... systemd does take a few goes before it settles down. If you need any output let me know in the mean time I will keep testing.

graysky · 2012-09-18 12:38:32

So you're still meeting with failures? Can you post your asd.conf and how large are the dirs you are asking it to sync?

Mr Green · 2012-09-18 12:47:33

#
# /etc/asd.conf
#
# For documentation, see: https://wiki.archlinux.org/index.php/Anything-sync-daem
on

# Define the target(s) directories in the WHATTOSYNC array 
# Do NOT define a file! These MUST be directories with an absolute path!
#
# Note that the target DIRECTORIES and all subdirs under them will be included
# In other words, this is recursive
#
# Below is an example to wet your appetite
#WHATTOSYNC=('/var/log' '/srv/http' '/home/foo/bar')
WHATTOSYNC=('/var/log')

# Define where data will reside in tmpfs
# Think hard about this if using utils like bleachbit as it has a nasty habit
# of nuking files it identifies as junk in /tmp
# 
# A safer location for things is actually /dev/shm
#
# This location must be mounted to tmpfs and MUST be writable and executable
# for the user
# Use NO trailing backslash!
#VOLATILE="/dev/shm"

# Define the permissions of the prefix subdirectory
# Must at least be writable, readable and executable for the user
#PREFIX_PERMISSIONS=700

/var/log [du -h .]

0	./old
0	./libvirt/uml
0	./libvirt/qemu
0	./libvirt/lxc
4.0K	./libvirt
0	./hp/tmp
4.0K	./hp
92K	./cups
34M	.

graysky · 2012-09-18 15:09:07

Do not sync /var/log or bad things will happen.

Mr Green · 2012-09-18 15:32:56

Would have been real handy to sync /var/log when using an SSD drive....

thewall · 2012-09-18 17:31:02

@graysky: everything working fine today... Can I safely uninstall anything-sync-daemon package now?

@Mr Green: Check my post on page 5 to see what kind of sh*t happens with asd syncing /var/log on a SSD

karol · 2012-09-18 17:38:04

thewall wrote:

@Mr Green: Check my post on page 5 to see what kind of sh*t happens with asd syncing /var/log on a SSD

You can and should link to the posts you're referring to, as users can set the number of posts per page - for me this thread is only 2 pages long.

The post in question: https://bbs.archlinux.org/viewtopic.php … 9#p1162699

Mr Green · 2012-09-18 17:55:16

@graysky never have no fatal problems running asd, going to read up ssd wiki

graysky · 2012-09-18 21:11:50

@karol - Thanks for the reference for users to see. I t is too bad that systemd gets pissed off when syncing the dir in question. If I knew more about it, perhaps delaying the start of asd would remedy the problem.

MFserver · 2012-09-18 21:29:16

I keep /var/log synced to RAM, and I don't have any problems (as far as I know). I have no idea why, though, I guess my system isn't supposed to like this...

Mr Green · 2012-09-19 06:06:38

@graysky I think that sysd shuts down so fast nothing has time to do anything. Not tried init version.... yet

Mr Green · 2012-09-19 06:16:23

http://patrakov.blogspot.co.uk/2011/01/ … files.html

Not sure if that will help, noticed 'After' and he writes about restarting event on error...

DarioP · 2012-09-19 07:32:43

On the 3.4 I noticed that if I stop the daemon manually then the cron job still sync my folders. Have this been solved on 3.6?

Now I've upgraded to 3.6 and still have to test. Regard the installation pacman said me:

WARNING:
You MUST compare your existing /etc/asd.conf to the one provided
by this package or else new features will not work and you risk breakage
of the software in general!

But no /etc/asd.conf.pacnew was there...

graysky · 2012-09-19 09:05:42

Mr Green wrote:

@graysky I think that sysd shuts down so fast nothing has time to do anything. Not tried init version.... yet

Interesting hypothesis. Seems like systemd would not halt the machine until the processes it starts finished though. Do you want to take the lead on following up this in an email with one of the systemd devs? Perhaps post to their mailing lost on behalf of the project?

DarioP wrote:

On the 3.4 I noticed that if I stop the daemon manually then the cron job still sync my folders. Have this been solved on 3.6?
Now I've upgraded to 3.6 and still have to test. Regard the installation pacman said me:
WARNING:
You MUST compare your existing /etc/asd.conf to the one provided
by this package or else new features will not work and you risk breakage
of the software in general!
But no /etc/asd.conf.pacnew was there...

1) Yes, solved. Please see the change log on github or in the source tarball for details.
2) This is only true if pacman detects a change from your version. I do not understand how this situation is not true though since you certainly have defined something in the WHATTOSYNC array.

Last edited by graysky (2012-09-19 09:12:32)

DarioP · 2012-09-19 09:25:23

2) It's simple because yesterday, after many unwanted sync I decided to empty the WHATTOSYNC array, so everything's fine

I'll go on testing the new version

About the shutdown: since the last pacman -Syu sending SIGTERM to all processes fails in my system and I still haven't detect why. This was before start to trying asd, but I'm not sure if it may effect also asd. So that's why I prefer sync and turn off asd before halting. I also noticed that if I copy one or two GB to ram and heavy modify them, sync take quite much time (naturally due to the HDD writing speed) and as Mr Green said there may be no such time available during the shut down procedure.

I'm also having some troubles to make asd sync the same folders that services like Dropbox do. It seems that Dropbox doesn't like too much the backups and the symlinks.. I don't know if something can be made for this..

graysky · 2012-09-19 10:22:05

No idea how Dropbox works. Are you pointing it to sync the source or the linked source that asd creates?

DarioP · 2012-09-19 10:38:27

DB and similar cloud services keep the contents of a folder synced with their servers so your files are always backed up and you can access them from everywhere.

Now asd is syncing some subfolders that Dropbox already checks creating symlinks and backups. When doing this DB drives crazy with great CPU and disk usage. Moreover during shut down the removed backups can't be synced by DB as obviously there's no time. Surely a solution will include to move the backups to an asd system directory, but I have to investigate how DB works with symlinks.

thewall · 2012-09-19 11:34:00

@karol: Sorry, I didn't know about the feature to set the post number per page.

@graysky: Sorry, but you didn't answer my question... can I uninstall anything-sync-daemon safely now?

Mr Green · 2012-09-19 12:46:31

@graysky

http://freedesktop.org/wiki/Software/sy … n_Problems

Joining mailing list got a the 'RTFM' reply.....

graysky · 2012-09-19 13:15:13

thewall wrote:

@graysky: Sorry, but you didn't answer my question... can I uninstall anything-sync-daemon safely now?

You can uninstall it anytime. I gave it a post remove function to unsync thus restoring your synced dirs automatically.

Mogger · 2012-09-20 12:40:35

MFserver wrote:

I keep /var/log synced to RAM, and I don't have any problems (as far as I know). I have no idea why, though, I guess my system isn't supposed to like this...

Same here, nothing bad has happened here... yet.

If it's shutdown that's the problem, it could be because my shutdown is delayed by my external hard drive - it takes a few seconds to unmount since it's usually on power save.

graysky · 2012-09-20 15:04:06

@Mogger - systemd or sysv?

Arch Linux

#126 2012-09-18 05:30:24

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#127 2012-09-18 05:45:33

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#128 2012-09-18 09:21:21

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#129 2012-09-18 10:45:20

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#130 2012-09-18 12:38:32

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#131 2012-09-18 12:47:33

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#132 2012-09-18 15:09:07

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#133 2012-09-18 15:32:56

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#134 2012-09-18 17:31:02

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#135 2012-09-18 17:38:04

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#136 2012-09-18 17:55:16

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#137 2012-09-18 21:11:50

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#138 2012-09-18 21:29:16

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#139 2012-09-19 06:06:38

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#140 2012-09-19 06:16:23

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#141 2012-09-19 07:32:43

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#142 2012-09-19 09:05:42

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#143 2012-09-19 09:25:23

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#144 2012-09-19 10:22:05

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#145 2012-09-19 10:38:27

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#146 2012-09-19 11:34:00

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#147 2012-09-19 12:46:31

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#148 2012-09-19 13:15:13

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#149 2012-09-20 12:40:35

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#150 2012-09-20 15:04:06

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

Board footer