You are not logged in.

#1 2017-02-02 14:41:22

giovannotti69
Member
Registered: 2017-02-02
Posts: 5

Xtreemfs on ArchLinux

Hi

I'm working on a cloud implementation project, and looking for an object-oriented, distributed and Internet capable (secure transmission through public networks)  storage system I found XtreemFS.... it looks like a very robust and SPOF free system, with encrypted capabilities out of the box. I saw also there is actually support for Glusterfs

Unfortunately I haven't seen this package included in the Arch official repos, neither in the AUR lists

I made an attempt to install it but the sources make it work on Sysinit, not with systemd, so Icannot make it work yet

some ideas?

Is there any plan to include it in the near future?

Best Regards

Giovanny

Offline

#2 2017-02-02 16:07:00

Slithery
Administrator
From: Norfolk, UK
Registered: 2013-12-01
Posts: 5,776

Re: Xtreemfs on ArchLinux

Post your attempt at a PKGBUILD and we can help you figure this out.


No, it didn't "fix" anything. It just shifted the brokeness one space to the right. - jasonwryan
Closing -- for deletion; Banning -- for muppetry. - jasonwryan

aur - dotfiles

Offline

#3 2017-02-03 03:21:00

giovannotti69
Member
Registered: 2017-02-02
Posts: 5

Re: Xtreemfs on ArchLinux

Hi slithery, thank yopu for your answer...

I made again the attempt , this time worked!!! but I just executed the scripts in the /etc/init.d folder (the system does not have sysinitv, it does have systemd).
All depèndences are installed and use the official repos:

From the Xtreemfs webpage (http://www.xtreemfs.org/download_sources.php):

"The client is implemeted in C++ and has the following dependencies:

    gcc 4.1+

    boost 1.39+

    FUSE 2.6+ (Linux), OSXFUSE (OS X)

    OpenSSL 0.99.8+

    cmake 2.6+

    make

    libattr (Linux only)

The XtreemFS servers are implemented in Java and require Java 6+ and ant 1.6.5+."


I've installed them with the command    pacman -S gcc boost fuse openssl cmake make attr jre8-openjdk-headless apache-ant, the installation of prerequisites was straightforward, no problems.

Then, the Xtreemfs's compilation:

[root@xtreemfs1 init.d]# uname -vr
4.9.6-1-ARCH #1 SMP PREEMPT Thu Jan 26 09:22:26 CET 2017
[root@xtreemfs1 giovannotti]# cd XtreemFS-1.5.1
[root@xtreemfs1 XtreemFS-1.5.1]# ls -la
total 52
drwxrwxr-x 12 giovannotti giovannotti   255 Mar 12  2015 .
drwx------  3 giovannotti giovannotti   134 Jan 18 09:36 ..
-rw-rw-r--  1 giovannotti giovannotti   309 Mar 12  2015 AUTHORS
drwxrwxr-x  2 giovannotti giovannotti   259 Mar 12  2015 bin
-rw-rw-r--  1 giovannotti giovannotti  8891 Mar 12  2015 CHANGELOG
drwxrwxr-x 10 giovannotti giovannotti   176 Mar 12  2015 contrib
drwxrwxr-x  9 giovannotti giovannotti   166 Mar 12  2015 cpp
drwxrwxr-x  4 giovannotti giovannotti    31 Mar 12  2015 etc
drwxrwxr-x  5 giovannotti giovannotti    66 Mar 12  2015 interface
drwxrwxr-x  7 giovannotti giovannotti   159 Mar 12  2015 java
-rw-rw-r--  1 giovannotti giovannotti   279 Mar 12  2015 KNOWN_ISSUES
-rw-rw-r--  1 giovannotti giovannotti  1734 Mar 12  2015 LICENSE
-rw-rw-r--  1 giovannotti giovannotti 15481 Mar 12  2015 Makefile
drwxrwxr-x  3 giovannotti giovannotti    18 Mar 12  2015 man
drwxrwxr-x  2 giovannotti giovannotti    55 Mar 12  2015 packaging
-rw-rw-r--  1 giovannotti giovannotti  1038 Mar 12  2015 README.md
drwxrwxr-x  2 giovannotti giovannotti   108 Mar 12  2015 snmp
drwxrwxr-x  7 giovannotti giovannotti   274 Mar 12  2015 tests
-rw-rw-r--  1 giovannotti giovannotti  5118 Mar 12  2015 Vagrantfile

[root@xtreemfs1 XtreemFS-1.5.1]# pwd
/home/giovannotti/XtreemFS-1.5.1
[root@xtreemfs1 XtreemFS-1.5.1]# make server

ant ok

/usr/share/apache-ant/bin/ant -D"file.encoding=UTF-8" -f java/foundation/build-1.6.5.xml jar
Buildfile: /home/giovannotti/XtreemFS-1.5.1/java/foundation/build-1.6.5.xml

-pre-init:

-init-private:

-init-user:

-init-project:

-init-macrodef-property:

-do-init:

-post-init:

-init-check:

-init-macrodef-javac:

-init-macrodef-junit:

-init-macrodef-nbjpda:

-init-debug-args:

-init-macrodef-debug:

-init-macrodef-java:

-init-presetdef-jar:

init:

deps-jar:

-pre-pre-compile:
    [mkdir] Created dir: /home/giovannotti/XtreemFS-1.5.1/java/foundation/build/classes

-pre-compile:

-compile-depend:

-do-compile:
    [mkdir] Created dir: /home/giovannotti/XtreemFS-1.5.1/java/foundation/build/empty
    [mkdir] Created dir: /home/giovannotti/XtreemFS-1.5.1/java/foundation/build/generated-sources
    [javac] Compiling 75 source files to /home/giovannotti/XtreemFS-1.5.1

BUILD SUCCESSFUL
Total time: 8 seconds
/usr/share/apache-ant/bin/ant -D"file.encoding=UTF-8" -f java/flease/build-1.6.5.xml jar
Buildfile: /home/giovannotti/XtreemFS-1.5.1/java/flease/build-1.6.5.xml

-pre-init:

-init-private:

-init-user:

-init-project:

-init-macrodef-property:

-do-init:

-post-init:

-init-check:

-init-ap-cmdline-properties:

-init-macrodef-javac-with-processors:

-init-macrodef-javac-without-processors:

-init-macrodef-javac:

-init-macrodef-junit:

-init-debug-args:

-init-macrodef-nbjpda:

-init-macrodef-debug:

-init-macrodef-java:

-init-presetdef-jar:

-init-ap-cmdline-supported:

-init-ap-cmdline:

init:

-deps-jar-init:

deps-jar:
    [mkdir] Created dir: /home/giovannotti/XtreemFS-1.5.1/java/flease/build

-warn-already-built-jar:
[propertyfile] Updating property file: /home/giovannotti/XtreemFS-1.5.1/java/flease/build/built-jar.properties

-check-automatic-build:

-clean-after-automatic-build:

-verify-automatic-build:

-pre-pre-compile:
    [mkdir] Created dir: /home/giovannotti/XtreemFS-1.5.1/java/flease/build/classes

-pre-compile:

-copy-persistence-xml:

-compile-depend:

-do-compile:
    [mkdir] Created dir: /home/giovannotti/XtreemFS-1.5.1/java/flease/build/empty
    [mkdir] Created dir: /home/giovannotti/XtreemFS-1.5.1/java/flease/build/generated-sources
    [mkdir] Created dir: /home/giovannotti/XtreemFS-1.5.1/java/flease/build/generated-sources/ap-source-output
    [javac] Compiling 36 source files to /home/giovannotti/XtreemFS-1.5.1/java/flease/build/classes
    [javac] warning: [options] bootstrap class path not set in conjunction with -source 1.6
    [javac] Note: /home/giovannotti/XtreemFS-1.5.1/java/flease/src/org/xtreemfs/foundation/flease/sim/FleaseSim.java uses or overrides a deprecated API.
    [javac] Note: Recompile with -Xlint:deprecation for details.
    [javac] Note: Some input files use unchecked or unsafe operations.
    [javac] Note: Recompile with -Xlint:unchecked for details.
    [javac] 1 warning

-post-compile:

compile:

-pre-jar:

-pre-pre-jar:
    [mkdir] Created dir: /home/giovannotti/XtreemFS-1.5.1/java/flease/dist

-do-jar-with-manifest:
[j2seproject1:jar] Building jar: /home/giovannotti/XtreemFS-1.5.1/java/flease/dist/Flease.jar

-do-jar-without-manifest:

-do-jar-with-mainclass:

-init-macrodef-copylibs:

-do-jar-with-libraries-and-splashscreen:

-do-jar-with-libraries:

-post-jar:

jar:

BUILD SUCCESSFUL
Total time: 5 seconds
/usr/share/apache-ant/bin/ant -D"file.encoding=UTF-8" -f java/servers/build-1.6.5.xml jar
Buildfile: /home/giovannotti/XtreemFS-1.5.1/java/servers/build-1.6.5.xml

-pre-init:

-init-private:

-init-user:

-init-project:

-init-macrodef-property:

-do-init:

-post-init:

-init-check:

-init-macrodef-javac:

-init-macrodef-junit:

-init-macrodef-nbjpda:

-init-debug-args:

-init-macrodef-debug:

-init-macrodef-java:

-init-presetdef-jar:

init:

deps-jar:

-pre-pre-compile:
    [mkdir] Created dir: /home/giovannotti/XtreemFS-1.5.1/java/servers/build/classes

-pre-compile:

-compile-depend:

-do-compile:
    [mkdir] Created dir: /home/giovannotti/XtreemFS-1.5.1/java/servers/build/empty
    [mkdir] Created dir: /home/giovannotti/XtreemFS-1.5.1/java/servers/build/generated-sources
    [javac] Compiling 431 source files to /home/giovannotti/XtreemFS-1.5.1/java/servers/build/classes
    [javac] warning: [options] bootstrap class path not set in conjunction with -source 1.6
    [javac] /home/giovannotti/XtreemFS-1.5.1/java/servers/src/org/xtreemfs/common/HeartbeatThread.java:45: warning: Signal is internal proprietary API and may be removed in a future release
    [javac] import sun.misc.Signal;
    [javac]                ^
    [javac] /home/giovannotti/XtreemFS-1.5.1/java/servers/src/org/xtreemfs/common/HeartbeatThread.java:46: warning: SignalHandler is internal proprietary API and may be removed in a future release
    [javac] import sun.misc.SignalHandler;
    [javac]                ^
    [javac] /home/giovannotti/XtreemFS-1.5.1/java/servers/src/org/xtreemfs/common/HeartbeatThread.java:605: warning: Signal is internal proprietary API and may be removed in a future release
    [javac]             Signal.handle(new Signal("USR2"), new SignalHandler() {
    [javac]                               ^
    [javac] /home/giovannotti/XtreemFS-1.5.1/java/servers/src/org/xtreemfs/common/HeartbeatThread.java:605: warning: SignalHandler is internal proprietary API and may be removed in a future release
    [javac]             Signal.handle(new Signal("USR2"), new SignalHandler() {
    [javac]                                                   ^
    [javac] /home/giovannotti/XtreemFS-1.5.1/java/servers/src/org/xtreemfs/common/HeartbeatThread.java:608: warning: Signal is internal proprietary API and may be removed in a future release
    [javac]                 public void handle(Signal signal) {
    [javac]                                    ^
    [javac] /home/giovannotti/XtreemFS-1.5.1/java/servers/src/org/xtreemfs/common/HeartbeatThread.java:605: warning: Signal is internal proprietary API and may be removed in a future release
    [javac]             Signal.handle(new Signal("USR2"), new SignalHandler() {
    [javac]             ^
    [javac] Note: Some input files use or override a deprecated API.
    [javac] Note: Recompile with -Xlint:deprecation for details.
    [javac] Note: Some input files use unchecked or unsafe operations.
    [javac] Note: Recompile with -Xlint:unchecked for details.
    [javac] 7 warnings
     [copy] Copying 9 files to /home/giovannotti/XtreemFS-1.5.1/java/servers/build/classes

-post-compile:

compile:

-pre-jar:

-pre-pre-jar:
    [mkdir] Created dir: /home/giovannotti/XtreemFS-1.5.1/java/servers/dist

-do-jar-with-manifest:

-do-jar-without-manifest:
[j2seproject1:jar] Building jar: /home/giovannotti/XtreemFS-1.5.1/java/servers/dist/XtreemFS.jar

-do-jar-with-mainclass:

-do-jar-with-libraries:

-do-jar-with-libraries-without-manifest:

-post-jar:

jar:

BUILD SUCCESSFUL
Total time: 23 seconds
[root@xtreemfs1 XtreemFS-1.5.1]# make install-server
to complete the server installation, please execute /etc/xos/xtreemfs/postinstall_setup.sh
[root@xtreemfs1 XtreemFS-1.5.1]# cd /etc/xos/xtreemfs/
[root@xtreemfs1 xtreemfs]# ls -la
total 32
drwxr-xr-x 3 root root  165 Feb  2 21:46 .
drwxr-xr-x 3 root root   22 Feb  2 21:46 ..
-rw-r--r-- 1 root root 5357 Feb  2 21:46 dirconfig.properties
-rwxr-xr-x 1 root root  934 Feb  2 21:46 generate_uuid
-rw-r--r-- 1 root root 7119 Feb  2 21:46 mrcconfig.properties
-rw-r--r-- 1 root root 4880 Feb  2 21:46 osdconfig.properties
-rwxr-xr-x 1 root root 2754 Feb  2 21:46 postinstall_setup.sh
drwxr-xr-x 2 root root   50 Feb  2 21:46 server-repl-plugin

[root@xtreemfs1 xtreemfs]# sh postinstall_setup.sh
Generated UUID for service: dir
Generated UUID for service: mrc
Generated UUID for service: osd
created group xtreemfs
created user xtreemfs and data directory /var/lib/xtreemfs
directory /etc/xos/xtreemfs is owned by root, should be owned by xtreemfs, executing chgrp (may take some time)
setting /etc/xos/xtreemfs/dirconfig.properties 0640, executing chmod
setting /etc/xos/xtreemfs/mrcconfig.properties 0640, executing chmod
setting /etc/xos/xtreemfs/osdconfig.properties 0640, executing chmod

[root@xtreemfs1 xtreemfs]#
[root@xtreemfs1 xtreemfs]#
[root@xtreemfs1 xtreemfs]#
[root@xtreemfs1 xtreemfs]# cd /etc/init.d/
[root@xtreemfs1 init.d]# ls -la
total 16
drwxr-xr-x  2 root root   66 Feb  2 21:46 .
drwxr-xr-x 45 root root 4096 Feb  2 21:46 ..
-rwxr-xr-x  1 root root 3805 Feb  2 21:46 xtreemfs-dir
-rwxr-xr-x  1 root root 3922 Feb  2 21:46 xtreemfs-mrc
-rwxr-xr-x  1 root root 3852 Feb  2 21:46 xtreemfs-osd
[root@xtreemfs1 init.d]# ./xtreemfs-dir start
./xtreemfs-dir: line 19: /etc/init.d/functions: No such file or directory
Starting XtreemFS Directory Service (DIR)...success
[root@xtreemfs1 init.d]# ./xtreemfs-mrc start
./xtreemfs-mrc: line 19: /etc/init.d/functions: No such file or directory
Starting XtreemFS Metadata and Replica Catalog (MRC)...success
[root@xtreemfs1 init.d]# ./xtreemfs-osd start
./xtreemfs-osd: line 19: /etc/init.d/functions: No such file or directory
Starting XtreemFS Object Storage Device (OSD)...success

after this I could have access to the monitoring pages of xtreemfs!...

In theory, it only lacks the systemd part, in which the service is started at boot, seen as a background process and obviously, it would be cool to have it as an Arch Package!

Waiting your comments

Regards

Giovanni

Last edited by giovannotti69 (2017-02-03 15:39:23)

Offline

#4 2017-02-03 03:49:17

x33a
Forum Fellow
Registered: 2009-08-15
Posts: 4,587

Re: Xtreemfs on ArchLinux

@giovannotti69, please edit your post and use code tags. In its current state, your post is basically unreadable.

Offline

Board footer

Powered by FluxBB