anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

PReP · 2013-01-29 20:58:15

I just tried this very nice (i believe) program/deamon-script.

The main subject was my minecraft server world

WHATTOSYNC=('/home/prep/.server_minecraft')

I left the voilatile at the default shm.

I started it with: sudo systemctl start asd.service.
then i enabled it with: sudo systemctl enable asd.service.

Then I started the minecraft server - once for testing, and stopped it again when all seemed ok.

Then i rebooted (sudo reboot), to see if all was well when ending systemd and asd.

. But now.. i can no longer boot, i get this message:

"Betriebssystem fehlt"

I reckon that to be german! - and i run a completely english system...

So my worries and possible conclusion are that systemd (german devs/devs?) ended to quickly and did not let asd sync and stop nicely when it raced on to reboot?

If not, i must have missed some logical step or other vital thing in my setup.

This is very sad, but i will go and troubleshoot as best i can now, and update when i know more
- any tips from any of you helpful archers are most welcome.

Last edited by PReP (2013-01-29 21:02:28)

graysky · 2013-01-29 21:07:05

Google translator says that means ' missing operating system' and I have no idea why you would see that. What you're syncing is totally in user space. I can't think of any possible connection between asd and your problem.

PReP · 2013-01-29 21:13:59

graysky wrote:

Google translator says that means ' missing operating system' and I have no idea why you would see that. What you're syncing is totally in user space. I can't think of any possible connection between asd and your problem.

I didn't really correlate it with asd either, but i did suspect systemd - since it's too-quick stop and start worries my slow mind.
But i was at fault with my suspicions it turns out.

I had a thought about it being grub - since it did happen before i even got into booting arch or anything
- i just could not phantom that failing all of a sudden.

As it turns out, my servers motherboard just randomly switched primary/secondary drive among the SATA and the IDE disk just after the reboot,
thus it tried to boot a non-bootable drive.

Sorry for the noise, and thanks again for the script/application

Last edited by PReP (2013-01-29 21:14:46)

graysky · 2013-01-29 23:01:42

Glad your stuff is working. Just to confirm: asd is working as advertised with the directory in your homedir?

PReP · 2013-01-30 11:01:00

graysky wrote:

Glad your stuff is working. Just to confirm: asd is working as advertised with the directory in your homedir?

It seems to yes.

the .server_minecraft is a hidden folder in my users homedir.
- and looking up shm with a df shows it used by that folders amount.

I did the same on my client-computer, with .minecraft, and it seems to work fine in both cases thus far : )

ERiS · 2013-02-09 04:09:54

WHATTOSYNC=

If a path has spaces, what do I do? I've tried:

'/path/to/my folder'
"/path/to/my folder"
'/path/to/my\ folder'

And by running debug I see that the folder isn't being parsed properly. It says:

'/path/to/my': no such file or directory
'folder': no such file or directory

But then on the config file, it says:

"Use NO trailing backslash!"

So does that mean I can't escape the spaces? What is the correct way to go about this then?

Last edited by ERiS (2013-02-09 04:30:59)

ERiS · 2013-02-09 05:20:31

This might be a silly question but Linux is so smart that it does things I sometimes think impossible.

Do I need to have enough RAM for the folder I want to sync? Say I have 6GB and my folder is 20GB...

graysky · 2013-02-09 11:17:43

@E -
*No idea about paths with spaces. That is a UNIX no-no in general.
*You cannot put 20 gallons of gas in a 6 gallon tank.

ERiS · 2013-02-09 14:57:40

Yeah, I hate spaces, but it was a program that made it like that, not me.

Well, I tried making a symlink to the folder but making the symlink without spaces, that didn't work either. Oh well.

Mindstormscreator · 2013-07-03 20:23:20

Could there be an option to change the general path of the backup directories? For example, right now I sync ~/build which I makepkg in and what-not and the backup dir is ~/build-backup_asd, which is annoying to have lying around in the open in my home directory. I'd like to at least be able to, for example, add a dot at the beginning of the backup directory name.

graysky · 2013-07-03 21:39:08

@Mindstormscreator - The dot prefix sounds reasonable, let me play a bit.

graysky · 2013-07-03 21:55:00

EDIT: Implemented. Update in the AUR --> https://aur.archlinux.org/packages/anyt … nc-daemon/

Last edited by graysky (2013-07-04 16:36:38)

Mindstormscreator · 2013-07-04 16:15:44

Here's my output:

Packages (1): anything-sync-daemon-3.16-1

Total Installed Size:   0.09 MiB
Net Upgrade Size:       0.00 MiB

:: Proceed with installation? [Y/n] 
(1/1) checking keys in keyring                     [######################] 100%
(1/1) checking package integrity                   [######################] 100%
(1/1) loading package files                        [######################] 100%
(1/1) checking for file conflicts                  [######################] 100%
(1/1) checking available disk space                [######################] 100%
--> Pacman must stop psd before it can upgrade.
--> Please start it manually once the upgrade is complete.
(1/1) upgrading anything-sync-daemon               [######################] 100%
warning: /etc/asd.conf installed as /etc/asd.conf.pacnew

Seems to do as you say, except it says it must stop psd, not asd, for some reason. I don't even have profile-sync-daemon installed on my system.

After restarting asd, the backup dir is now ~/.build-backup_asd, great!

graysky · 2013-07-04 16:27:31

My bad, just a typo in the echo command. Fixed and thanks. Edited post #212 to keep things simple now that the new version is live in the AUR.

Last edited by graysky (2013-07-04 16:37:33)

orschiro · 2013-07-06 05:41:25

I read through the previous pages and now I am wondering what the use case for this daemon would be on my laptop. I am running a normal Desktop Gnome on my conventional HDD without any server, database or equivalent set-up. Now, the only one I can think of keeping synced is /var/log. What else should I sync since Chromium should explicitly not be synced with asd?

Mox · 2013-09-10 12:41:25

Well I don't know what else you do with your computer, but for me, these are the things I end up synching:
- Software projects that I rebuild regularly.
- One folder in ~ where I edit all my stuff
- Last, but not least: The folder, where all my downloads go. Consider for example a slow torrent: Data cripples in kilobyte by kilobyte and your filesystem is usualy set to write back data quite regularly (3 seconds unless I am mistaken or you changed it). So one block on your hard drive has to be rewritten and rewritten. With asd, it is only written once, or, if you decide later, that you do not really need the file, it even never gets rewritten.

graysky · 2013-09-10 19:14:18

I use it in concert w/ monitorix:

% grep WHATTOSYNC /etc/asd.conf 
# Define the target(s) directories in the WHATTOSYNC array
#WHATTOSYNC=('/srv/http' '/var/lib/monitorix' '/foo/bar')
WHATTOSYNC=('/var/lib/monitorix')

magnifico · 2013-09-30 01:23:50

teateawhy wrote:

[...]
This seems to be in accordance with the manpage about journald.conf :
man journald.conf wrote:
Storage=
Controls where to store journal data. One of volatile, persistent, auto and none. If volatile journal log data will be
stored only in memory[..] If persistent data will be stored [..] below the /var/log/journal hierarchy [...]
ZekeSulastin wrote:
Did any of you happen to try setting Storage=volatile (or none) in /etc/systemd/journald.conf so that journald doesn't actually do anything with /var/log/?
exactly

Hello,

Sorry for maybe stupid question but I'm new to Arch and systemd and not so advanced with Linux in general

Won't I lost all journal logs after reboot/poweroff if I set Storage to "volatile"? As much as I would love to use asd for /var/logs I still want to be able to check my logs

zoevkl · 2013-10-12 15:52:43

Is the a way to add folders with spaces? like "/home/zoe/my folder" it does not want to take "/home/zoe/my\ folder\" and I cant change the name of the folder I want to load.

graysky · 2013-10-12 15:58:17

@zoevkl - Never tested specifically for this use case... spaces are taboo for *nix in general. Post your /etc/asd.conf

zoevkl · 2013-10-12 16:40:22

Here it is.
And the game will not start if it is not in that folder(it is the expected behaviour)

#
# /etc/asd.conf
#

# Define the target(s) directories in the WHATTOSYNC array
# Do NOT define a file! These MUST be directories with an absolute path!
#
# Note that the target DIRECTORIES and all subdirs under them will be included
# In other words, this is recursive
#
# Below is an example to wet your appetite
#WHATTOSYNC=('/srv/http' '/var/lib/monitorix' '/foo/bar')
WHATTOSYNC=("/home/zoe/.local/share/Steam/SteamApps/common/Crusader Kings II/gfx/")

# Define where data will reside in tmpfs
# Think hard about this if using utils like bleachbit as it has a nasty habit
# of nuking files it identifies as junk in /tmp
#
# A safer location for things is actually /dev/shm
#
# This location must be mounted to tmpfs and MUST be writable and executable
# for the user
# Use NO trailing backslash!
#VOLATILE="/dev/shm"

# Define the permissions of the prefix subdirectory
# Must at least be writable, readable and executable for the user
#PREFIX_PERMISSIONS=700

graysky · 2013-10-12 18:19:27

Not sure what do to without digging deeper into it, sorry, But again, spaces in *nix filesystems shouldn't be used.

orschiro · 2013-10-20 16:15:21

I noticed the following error:

pam_tally(cinnamon-screensaver:setcred): Error opening /var/log/faillog for update

I am using asd for /var/log:

WHATTOSYNC=('/var/log')

[orschiro@thinkpad ~]$ ls /var/log/faillog 
-rw------- 1 root root 32064 Oct 20 08:24 /var/log/faillog

[orschiro@thinkpad ~]$ sudo systemctl status asd
[sudo] password for orschiro: 
asd.service - Anything-sync-daemon
   Loaded: loaded (/usr/lib/systemd/system/asd.service; enabled)
   Active: active (exited) since Sun 2013-10-20 08:24:29 CEST; 9h ago
     Docs: man:asd(1)
           man:anything-sync-daemon(1)
           https://wiki.archlinux.org/index.php/Anything-sync-daemon
 Main PID: 466 (code=exited, status=0/SUCCESS)
   CGroup: /system.slice/asd.service

Oct 20 08:24:29 thinkpad systemd[1]: Started Anything-sync-daemon.

Any idea what this error could mean?

graysky · 2013-10-20 18:40:17

Never seen that before... does cinnamon-screensaver run as root or as your user? If it runs as you, that log is 600 with root owning it so it makes sense that you cannot write to it.

Post the output of:
ps aux | grep cinnamon-screensaver

orschiro · 2013-10-20 18:51:39

You were correct. It runs as user. Should I report that upstream or might that be intentional?

[orschiro@thinkpad ~]$ ps aux | grep cinnamon-screensaver
orschiro  1021  0.0  0.1 471584 14136 tty1     Sl   08:26   0:02 cinnamon-screensaver
orschiro 20757  0.0  0.0  12876  1080 pts/1    S+   20:50   0:00 grep cinnamon-screensaver

Last edited by orschiro (2013-10-20 18:51:53)

Arch Linux

#201 2013-01-29 20:58:15

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#202 2013-01-29 21:07:05

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#203 2013-01-29 21:13:59

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#204 2013-01-29 23:01:42

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#205 2013-01-30 11:01:00

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#206 2013-02-09 04:09:54

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#207 2013-02-09 05:20:31

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#208 2013-02-09 11:17:43

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#209 2013-02-09 14:57:40

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#210 2013-07-03 20:23:20

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#211 2013-07-03 21:39:08

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#212 2013-07-03 21:55:00

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#213 2013-07-04 16:15:44

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#214 2013-07-04 16:27:31

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#215 2013-07-06 05:41:25

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#216 2013-09-10 12:41:25

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#217 2013-09-10 19:14:18

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#218 2013-09-30 01:23:50

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#219 2013-10-12 15:52:43

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#220 2013-10-12 15:58:17

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#221 2013-10-12 16:40:22

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#222 2013-10-12 18:19:27

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#223 2013-10-20 16:15:21

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#224 2013-10-20 18:40:17

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

#225 2013-10-20 18:51:39

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

Board footer