Arch Linux

vorlket

Member

Registered: 2017-09-30

Posts: 90

[SOLVED] Hadoop start-dfs.sh

Hi, I followed https://www.linode.com/docs/databases/h … p-cluster/ for set up, and then receive the following message upon entering start-dfs.sh:

Starting namenodes on [master]
ERROR: Both HADOOP_WORKERS and HADOOP_WORKER_NAMES were defined. Aborting.
...
Starting secondary namenodes on [master]
ERROR: Both HADOOP_WORKERS and HADOOP_WORKER_NAMES were defined. Aborting.

Can someone tell me what's going on and how to fix it?

Last edited by vorlket (2019-11-21 07:04:17)

Trilby

Inspector Parrot

Registered: 2011-11-29

Posts: 29,530

Website

Re: [SOLVED] Hadoop start-dfs.sh

First, follow the wiki.  Then if it's still failing, post your /etc/profile.d/hadoop.sh.

---

"UNIX is simple and coherent..." - Dennis Ritchie, "GNU's Not UNIX" -  Richard Stallman

vorlket

Member

Registered: 2017-09-30

Posts: 90

Re: [SOLVED] Hadoop start-dfs.sh

cat /etc/profile.d/hadoop.sh

export HADOOP_CONF_DIR=/etc/hadoop
export HADOOP_LOG_DIR=/tmp/hadoop/log
export HADOOP_WORKERS=/etc/hadoop/workers
export HADOOP_PID_DIR=/tmp/hadoop/run

Trilby

Inspector Parrot

Registered: 2011-11-29

Posts: 29,530

Website

Re: [SOLVED] Hadoop start-dfs.sh

How about:

env | grep HADOOP_WORKER_NAMES
sudo grep -rl HADOOP_WORKER_NAMES /etc

---

"UNIX is simple and coherent..." - Dennis Ritchie, "GNU's Not UNIX" -  Richard Stallman

vorlket

Member

Registered: 2017-09-30

Posts: 90

Re: [SOLVED] Hadoop start-dfs.sh

grep -rl HADOOP_WORKER_NAMES /etc

/etc/hadoop/hadoop-user-functions.sh.example

vorlket

Member

Registered: 2017-09-30

Posts: 90

Re: [SOLVED] Hadoop start-dfs.sh

Removing export HADOOP_WORKERS=/etc/hadoop/workers from /etc/profile.d/hadoop.sh works.