Arch Linux

monksy

Member

Registered: 2013-12-30

Posts: 23

Installing Hadoop 2.7 on Arch Linux (Via AUR)

I've been trying to install Hadoop via the AUR, however I've run into the issue where the documentation appears to be out of date.

The Jobtracker and tasktracker service seems to be out of date. I'm not sure what those commands got changed to in the 2.x releases. Does anyone else know what I should be running instead?

From starting the jobtracker and tasktracker services I'm getting the following error:

sudo -u hadoop hadoop jobtracker
DEPRECATED: Use of this script to execute mapred command is deprecated.
Instead use the mapred command for it.

Sorry, the jobtracker command is no longer supported.
You may find similar functionality with the "yarn" shell command.
Usage: mapred [--config confdir] [--loglevel loglevel] COMMAND
where COMMAND is one of:
pipes run a Pipes job
job manipulate MapReduce jobs
queue get information regarding JobQueues
classpath prints the class path needed for running
mapreduce subcommands
historyserver run job history servers as a standalone daemon
distcp <srcurl> <desturl> copy file or directories recursively
archive -archiveName NAME -p <parent path> <src>* <dest> create a hadoop archive
hsadmin job history server admin interface

Most commands print help when invoked w/o parameters.

Last edited by monksy (2015-08-20 06:00:15)

jasonwryan

Anarchist

From: .nz

Registered: 2009-05-09

Posts: 30,426

Website

Re: Installing Hadoop 2.7 on Arch Linux (Via AUR)

Please use code tags when pasting to the boards: https://wiki.archlinux.org/index.php/Fo … s_and_code

Moving to AUR Issues...

---

Arch + dwm   •   Mercurial repos  •   Surfraw

Registered Linux User #482438

d1t2

Member

Registered: 2011-06-05

Posts: 5

Re: Installing Hadoop 2.7 on Arch Linux (Via AUR)

Finally I get it work manually starting these services.

sudo -u hadoop -i /bin/bash
vim hadoop-env.sh  # add JAVA_HOME=/usr/lib/jvm/default
cd /usr/lib/hadoop/sbin/
./hadoop-daemon.sh start namenode
./hadoop-daemon.sh start datanode
./start-yarn.sh
./mr-jobhistory-daemon.sh start historyserver

# stop services
./mr-jobhistory-daemon.sh stop historyserver
./stop-yarn.sh 
./hadoop-daemon.sh stop namenode
./hadoop-daemon.sh stop datanode