You are not logged in.

#201 2013-01-29 20:58:15

PReP
Member
From: Sweden
Registered: 2010-06-13
Posts: 359
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

I just tried this very nice (i believe) program/deamon-script.

The main subject was my minecraft server world

WHATTOSYNC=('/home/prep/.server_minecraft')

I left the voilatile at the default shm.


I started it with: sudo systemctl start asd.service.
then i enabled it with: sudo systemctl enable asd.service.

Then I started the minecraft server - once for testing, and stopped it again when all seemed ok.


Then i rebooted (sudo reboot), to see if all was well when ending systemd and asd.

. But now.. i can no longer boot, i get this message:

"Betriebssystem fehlt"


I reckon that to be german! - and i run a completely english system...


So my worries and possible conclusion are that systemd (german devs/devs?) ended to quickly and did not let asd sync and stop nicely when it raced on to reboot?

If not, i must have missed some logical step or other vital thing in my setup.

This is very sad, but i will go and troubleshoot as best i can now, and update when i know more
- any tips from any of you helpful archers are most welcome.

Last edited by PReP (2013-01-29 21:02:28)


. Main: Intel Core i5 6600k @ 4.4 Ghz, 16 GB DDR4 XMP, Gefore GTX 970 (Gainward Phantom) - Arch Linux 64-Bit
. Server: Intel Core i5 2500k @ 3.9 Ghz, 8 GB DDR2-XMP RAM @ 1600 Mhz, Geforce GTX 570 (Gainward Phantom) - Arch Linux 64-Bit
. Body: Estrogen @ 90%, Testestorone @ 10% (Not scientific just out-of-my-guesstimate-brain)

Offline

#202 2013-01-29 21:07:05

graysky
Wiki Maintainer
From: :wq
Registered: 2008-12-01
Posts: 10,592
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

Google translator says that means ' missing operating system' and I have no idea why you would see that.  What you're syncing is totally in user space.  I can't think of any possible connection between asd and your problem.


CPU-optimized Linux-ck packages @ Repo-ck  • AUR packagesZsh and other configs

Offline

#203 2013-01-29 21:13:59

PReP
Member
From: Sweden
Registered: 2010-06-13
Posts: 359
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

graysky wrote:

Google translator says that means ' missing operating system' and I have no idea why you would see that.  What you're syncing is totally in user space.  I can't think of any possible connection between asd and your problem.

I didn't really correlate it with asd either, but i did suspect systemd - since it's too-quick stop and start worries my slow mind.
But i was at fault with my suspicions it turns out.

I had a thought about it being grub - since it did happen before i even got into booting arch or anything
- i just could not phantom that failing all of a sudden.

As it turns out, my servers motherboard just randomly switched primary/secondary drive among the SATA and the IDE disk just after the reboot,
thus it tried to boot a non-bootable drive.

Sorry for the noise, and thanks again for the script/application smile

Last edited by PReP (2013-01-29 21:14:46)


. Main: Intel Core i5 6600k @ 4.4 Ghz, 16 GB DDR4 XMP, Gefore GTX 970 (Gainward Phantom) - Arch Linux 64-Bit
. Server: Intel Core i5 2500k @ 3.9 Ghz, 8 GB DDR2-XMP RAM @ 1600 Mhz, Geforce GTX 570 (Gainward Phantom) - Arch Linux 64-Bit
. Body: Estrogen @ 90%, Testestorone @ 10% (Not scientific just out-of-my-guesstimate-brain)

Offline

#204 2013-01-29 23:01:42

graysky
Wiki Maintainer
From: :wq
Registered: 2008-12-01
Posts: 10,592
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

Glad your stuff is working.  Just to confirm: asd is working as advertised with the directory in your homedir?


CPU-optimized Linux-ck packages @ Repo-ck  • AUR packagesZsh and other configs

Offline

#205 2013-01-30 11:01:00

PReP
Member
From: Sweden
Registered: 2010-06-13
Posts: 359
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

graysky wrote:

Glad your stuff is working.  Just to confirm: asd is working as advertised with the directory in your homedir?

It seems to yes.

the .server_minecraft is a hidden folder in my users homedir.
- and looking up shm with a df shows it used by that folders amount.

I did the same on my client-computer, with .minecraft, and it seems to work fine in both cases thus far : )


. Main: Intel Core i5 6600k @ 4.4 Ghz, 16 GB DDR4 XMP, Gefore GTX 970 (Gainward Phantom) - Arch Linux 64-Bit
. Server: Intel Core i5 2500k @ 3.9 Ghz, 8 GB DDR2-XMP RAM @ 1600 Mhz, Geforce GTX 570 (Gainward Phantom) - Arch Linux 64-Bit
. Body: Estrogen @ 90%, Testestorone @ 10% (Not scientific just out-of-my-guesstimate-brain)

Offline

#206 2013-02-09 04:09:54

ERiS
Member
Registered: 2011-03-15
Posts: 20

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

WHATTOSYNC=

If a path has spaces, what do I do? I've tried:

'/path/to/my folder'
"/path/to/my folder"
'/path/to/my\ folder'

And by running debug I see that the folder isn't being parsed properly. It says:

'/path/to/my': no such file or directory
'folder': no such file or directory

But then on the config file, it says:

"Use NO trailing backslash!"

So does that mean I can't escape the spaces? What is the correct way to go about this then?

Last edited by ERiS (2013-02-09 04:30:59)

Offline

#207 2013-02-09 05:20:31

ERiS
Member
Registered: 2011-03-15
Posts: 20

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

This might be a silly question but Linux is so smart that it does things I sometimes think impossible.

Do I need to have enough RAM for the folder I want to sync? Say I have 6GB and my folder is 20GB...

Offline

#208 2013-02-09 11:17:43

graysky
Wiki Maintainer
From: :wq
Registered: 2008-12-01
Posts: 10,592
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

@E -
*No idea about paths with spaces.  That is a UNIX no-no in general.
*You cannot put 20 gallons of gas in a 6 gallon tank.


CPU-optimized Linux-ck packages @ Repo-ck  • AUR packagesZsh and other configs

Offline

#209 2013-02-09 14:57:40

ERiS
Member
Registered: 2011-03-15
Posts: 20

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

Yeah, I hate spaces, but it was a program that made it like that, not me.

Well, I tried making a symlink to the folder but making the symlink without spaces, that didn't work either. Oh well.

Offline

#210 2013-07-03 20:23:20

Mindstormscreator
Member
Registered: 2012-07-01
Posts: 186

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

Could there be an option to change the general path of the backup directories? For example, right now I sync ~/build which I makepkg in and what-not and the backup dir is ~/build-backup_asd, which is annoying to have lying around in the open in my home directory. I'd like to at least be able to, for example, add a dot at the beginning of the backup directory name.

Offline

#211 2013-07-03 21:39:08

graysky
Wiki Maintainer
From: :wq
Registered: 2008-12-01
Posts: 10,592
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

@Mindstormscreator - The dot prefix sounds reasonable, let me play a bit.


CPU-optimized Linux-ck packages @ Repo-ck  • AUR packagesZsh and other configs

Offline

#212 2013-07-03 21:55:00

graysky
Wiki Maintainer
From: :wq
Registered: 2008-12-01
Posts: 10,592
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

EDIT: Implemented.  Update in the AUR --> https://aur.archlinux.org/packages/anyt … nc-daemon/

Last edited by graysky (2013-07-04 16:36:38)


CPU-optimized Linux-ck packages @ Repo-ck  • AUR packagesZsh and other configs

Offline

#213 2013-07-04 16:15:44

Mindstormscreator
Member
Registered: 2012-07-01
Posts: 186

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

Here's my output:

Packages (1): anything-sync-daemon-3.16-1

Total Installed Size:   0.09 MiB
Net Upgrade Size:       0.00 MiB

:: Proceed with installation? [Y/n] 
(1/1) checking keys in keyring                     [######################] 100%
(1/1) checking package integrity                   [######################] 100%
(1/1) loading package files                        [######################] 100%
(1/1) checking for file conflicts                  [######################] 100%
(1/1) checking available disk space                [######################] 100%
--> Pacman must stop psd before it can upgrade.
--> Please start it manually once the upgrade is complete.
(1/1) upgrading anything-sync-daemon               [######################] 100%
warning: /etc/asd.conf installed as /etc/asd.conf.pacnew

Seems to do as you say, except it says it must stop psd, not asd, for some reason. I don't even have profile-sync-daemon installed on my system.

After restarting asd, the backup dir is now ~/.build-backup_asd, great!

Offline

#214 2013-07-04 16:27:31

graysky
Wiki Maintainer
From: :wq
Registered: 2008-12-01
Posts: 10,592
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

My bad, just a typo in the echo command.  Fixed and thanks.  Edited post #212 to keep things simple now that the new version is live in the AUR.

Last edited by graysky (2013-07-04 16:37:33)


CPU-optimized Linux-ck packages @ Repo-ck  • AUR packagesZsh and other configs

Offline

#215 2013-07-06 05:41:25

orschiro
Member
Registered: 2009-06-04
Posts: 2,136
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

I read through the previous pages and now I am wondering what the use case for this daemon would be on my laptop. I am running a normal Desktop Gnome on my conventional HDD without any server, database or equivalent set-up. Now, the only one I can think of keeping synced is /var/log. What else should I sync since Chromium should explicitly not be synced with asd?

Offline

#216 2013-09-10 12:41:25

Mox
Member
Registered: 2012-02-07
Posts: 32

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

Well I don't know what else you do with your computer, but for me, these are the things I end up synching:
- Software projects that I rebuild regularly.
- One folder in ~ where I edit all my stuff
- Last, but not least: The folder, where all my downloads go. Consider for example a slow torrent: Data cripples in kilobyte by kilobyte and your filesystem is usualy set to write back data quite regularly (3 seconds unless I am mistaken or you changed it). So one block on your hard drive has to be rewritten and rewritten. With asd, it is only written once, or, if you decide later, that you do not really need the file, it even never gets rewritten.

Offline

#217 2013-09-10 19:14:18

graysky
Wiki Maintainer
From: :wq
Registered: 2008-12-01
Posts: 10,592
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

I use it in concert w/ monitorix:

% grep WHATTOSYNC /etc/asd.conf 
# Define the target(s) directories in the WHATTOSYNC array
#WHATTOSYNC=('/srv/http' '/var/lib/monitorix' '/foo/bar')
WHATTOSYNC=('/var/lib/monitorix')

CPU-optimized Linux-ck packages @ Repo-ck  • AUR packagesZsh and other configs

Offline

#218 2013-09-30 01:23:50

magnifico
Member
Registered: 2013-09-30
Posts: 1

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

teateawhy wrote:

[...]

This seems to be in accordance with the manpage about journald.conf :

man journald.conf  wrote:

Storage=
           Controls where to store journal data. One of volatile, persistent, auto and none. If volatile journal log data will be
           stored only in memory[..] If persistent data will be stored [..] below the /var/log/journal hierarchy [...]

ZekeSulastin wrote:

Did any of you happen to try setting Storage=volatile (or none) in /etc/systemd/journald.conf so that journald doesn't actually do anything with /var/log/?

exactly

Hello,

Sorry for maybe stupid question but I'm new to Arch and systemd and not so advanced with Linux in general smile

Won't I lost all journal logs after reboot/poweroff if I set Storage to "volatile"? As much as I would love to use asd for /var/logs I still want to be able to check my logs smile

Offline

#219 2013-10-12 15:52:43

zoevkl
Member
Registered: 2013-10-12
Posts: 2

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

Is the a way to add folders with spaces? like "/home/zoe/my folder" it does not want to take "/home/zoe/my\ folder\"  and I cant change the name of the folder I want to load.

Offline

#220 2013-10-12 15:58:17

graysky
Wiki Maintainer
From: :wq
Registered: 2008-12-01
Posts: 10,592
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

@zoevkl - Never tested specifically for this use case... spaces are taboo for *nix in general.  Post your /etc/asd.conf


CPU-optimized Linux-ck packages @ Repo-ck  • AUR packagesZsh and other configs

Offline

#221 2013-10-12 16:40:22

zoevkl
Member
Registered: 2013-10-12
Posts: 2

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

Here it is.
And the game will not start if it is not in that folder(it is the expected behaviour)

#
# /etc/asd.conf
#

# Define the target(s) directories in the WHATTOSYNC array
# Do NOT define a file! These MUST be directories with an absolute path!
#
# Note that the target DIRECTORIES and all subdirs under them will be included
# In other words, this is recursive
#
# Below is an example to wet your appetite
#WHATTOSYNC=('/srv/http' '/var/lib/monitorix' '/foo/bar')
WHATTOSYNC=("/home/zoe/.local/share/Steam/SteamApps/common/Crusader Kings II/gfx/")

# Define where data will reside in tmpfs
# Think hard about this if using utils like bleachbit as it has a nasty habit
# of nuking files it identifies as junk in /tmp
#
# A safer location for things is actually /dev/shm
#
# This location must be mounted to tmpfs and MUST be writable and executable
# for the user
# Use NO trailing backslash!
#VOLATILE="/dev/shm"

# Define the permissions of the prefix subdirectory
# Must at least be writable, readable and executable for the user
#PREFIX_PERMISSIONS=700

Offline

#222 2013-10-12 18:19:27

graysky
Wiki Maintainer
From: :wq
Registered: 2008-12-01
Posts: 10,592
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

Not sure what do to without digging deeper into it, sorry,  But again, spaces in *nix filesystems shouldn't be used.


CPU-optimized Linux-ck packages @ Repo-ck  • AUR packagesZsh and other configs

Offline

#223 2013-10-20 16:15:21

orschiro
Member
Registered: 2009-06-04
Posts: 2,136
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

I noticed the following error:

pam_tally(cinnamon-screensaver:setcred): Error opening /var/log/faillog for update

I am using asd for /var/log:

WHATTOSYNC=('/var/log')
[orschiro@thinkpad ~]$ ls /var/log/faillog 
-rw------- 1 root root 32064 Oct 20 08:24 /var/log/faillog
[orschiro@thinkpad ~]$ sudo systemctl status asd
[sudo] password for orschiro: 
asd.service - Anything-sync-daemon
   Loaded: loaded (/usr/lib/systemd/system/asd.service; enabled)
   Active: active (exited) since Sun 2013-10-20 08:24:29 CEST; 9h ago
     Docs: man:asd(1)
           man:anything-sync-daemon(1)
           https://wiki.archlinux.org/index.php/Anything-sync-daemon
 Main PID: 466 (code=exited, status=0/SUCCESS)
   CGroup: /system.slice/asd.service

Oct 20 08:24:29 thinkpad systemd[1]: Started Anything-sync-daemon.

Any idea what this error could mean?

Offline

#224 2013-10-20 18:40:17

graysky
Wiki Maintainer
From: :wq
Registered: 2008-12-01
Posts: 10,592
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

Never seen that before... does cinnamon-screensaver run as root or as your user?  If it runs as you, that log is 600 with root owning it so it makes sense that you cannot write to it.

Post the output of:
ps aux | grep cinnamon-screensaver


CPU-optimized Linux-ck packages @ Repo-ck  • AUR packagesZsh and other configs

Offline

#225 2013-10-20 18:51:39

orschiro
Member
Registered: 2009-06-04
Posts: 2,136
Website

Re: anything-sync-daemon - keep ANYTHING in tmpfs and sync'ed

You were correct. It runs as user. Should I report that upstream or might that be intentional?

[orschiro@thinkpad ~]$ ps aux | grep cinnamon-screensaver
orschiro  1021  0.0  0.1 471584 14136 tty1     Sl   08:26   0:02 cinnamon-screensaver
orschiro 20757  0.0  0.0  12876  1080 pts/1    S+   20:50   0:00 grep cinnamon-screensaver

Last edited by orschiro (2013-10-20 18:51:53)

Offline

Board footer

Powered by FluxBB