You are not logged in.
First of all, apologies but I didn't see a forum where this was appropriate. I did a forum search, saw a few on elasticsearch so decided to put this here. I have the latest version from the community repo installed and it sort of starts. I start with
$ sudo systemctl start elasticsearchAfter that running ps aux shows it running
elastic+ 9622 260 19.3 3801072 1186316 ? Sl 21:27 0:07 /usr/lib/jvm/default-runtime/bin/java -Xms1g -Xmx1g -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -Des.networkaddress.cache.ttl=60 -Des.networkaddress.cache.negative.ttl=10 -XX:+AlwaysPreTouch -Xss1m -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djna.nosys=true -XX:-OmitStackTraceInFastThrow -Dio.netty.noUnsafe=true -Dio.netty.noKeySetOptimization=true -Dio.netty.recycler.maxCapacityPerThread=0 -Dlog4j.shutdownHookEnabled=false -Dlog4j2.disable.jmx=true -Djava.io.tmpdir=/tmp -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=data -XX:ErrorFile=logs/hs_err_pid%p.log -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m -Djava.locale.providers=COMPAT -Dio.netty.allocator.type=unpooled -Des.path.home=/usr/share/elasticsearch -Des.path.conf=/etc/elasticsearch -Des.distribution.flavor=default -Des.distribution.type=tar -Des.bundled_jdk=false -cp /usr/share/elasticsearch/lib/* org.elasticsearch.bootstrap.Elasticsearch -d -p /run/elasticsearch/elasticsearch.pidbut the pid appears and disappears in /run/elasticsearch/
checking the status with systemctl does show it running as well:
● elasticsearch.service - Elasticsearch
Loaded: loaded (/usr/lib/systemd/system/elasticsearch.service; disabled; vendor preset: disabled)
Active: active (running) since Thu 2019-05-09 21:20:14 EDT; 2s ago
Docs: http://www.elastic.co
Process: 6027 ExecStart=/usr/share/elasticsearch/bin/elasticsearch -d -p /run/elasticsearch/elasticsearch.pid (code=exited, status=0/SUCCESS)
Main PID: 6066 (java)
Tasks: 27 (limit: 4915)
Memory: 1.1G
CGroup: /system.slice/elasticsearch.service
└─6066 /usr/lib/jvm/default-runtime/bin/java -Xms1g -Xmx1g -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -Des.networkaddress.cache.ttl=60 -Des.networkaddress.cache.negative.ttl>
May 09 21:20:12 archer systemd[1]: Starting Elasticsearch...
May 09 21:20:12 archer elasticsearch[6027]: OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
May 09 21:20:12 archer systemd[1]: elasticsearch.service: Can't open PID file /run/elasticsearch/elasticsearch.pid (yet?) after start: No such file or directory
May 09 21:20:14 archer systemd[1]: Started Elasticsearch.But I can't access from my project and checking the logs in /var/logs/elasticsearch/elasticsearch.log shows a crash:
[2019-05-09T10:28:41,956][INFO ][o.e.e.NodeEnvironment ] [archer] using [1] data paths, mounts [[/ (/dev/sda2)]], net usable_space [4.1gb], net total_space [19.5gb], types [ext4]
[2019-05-09T10:28:41,963][INFO ][o.e.e.NodeEnvironment ] [archer] heap size [989.8mb], compressed ordinary object pointers [true]
[2019-05-09T10:28:42,045][INFO ][o.e.n.Node ] [archer] node name [archer], node ID [LQIKoPTlThe8cVmK6hZ8WA]
[2019-05-09T10:28:42,046][INFO ][o.e.n.Node ] [archer] version[7.0.1], pid[4009], build[default/tar/e4efcb5/2019-04-29T12:56:03.145736Z], OS[Linux/5.0.13-1-ck/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/11.0.3/11.0.3+4]
[2019-05-09T10:28:42,047][INFO ][o.e.n.Node ] [archer] JVM home [/usr/lib/jvm/java-11-openjdk]
[2019-05-09T10:28:42,048][INFO ][o.e.n.Node ] [archer] JVM arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Djava.locale.providers=COMPAT, -Dio.netty.allocator.type=unpooled, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/etc/elasticsearch, -Des.distribution.flavor=default, -Des.distribution.type=tar, -Des.bundled_jdk=false]
[2019-05-09T10:28:43,211][INFO ][o.e.p.PluginsService ] [archer] loaded module [aggs-matrix-stats]
[2019-05-09T10:28:43,212][INFO ][o.e.p.PluginsService ] [archer] loaded module [analysis-common]
[2019-05-09T10:28:43,213][INFO ][o.e.p.PluginsService ] [archer] loaded module [ingest-common]
[2019-05-09T10:28:43,214][INFO ][o.e.p.PluginsService ] [archer] loaded module [ingest-geoip]
[2019-05-09T10:28:43,214][INFO ][o.e.p.PluginsService ] [archer] loaded module [ingest-user-agent]
[2019-05-09T10:28:43,215][INFO ][o.e.p.PluginsService ] [archer] loaded module [lang-expression]
[2019-05-09T10:28:43,215][INFO ][o.e.p.PluginsService ] [archer] loaded module [lang-mustache]
[2019-05-09T10:28:43,216][INFO ][o.e.p.PluginsService ] [archer] loaded module [lang-painless]
[2019-05-09T10:28:43,216][INFO ][o.e.p.PluginsService ] [archer] loaded module [mapper-extras]
[2019-05-09T10:28:43,217][INFO ][o.e.p.PluginsService ] [archer] loaded module [parent-join]
[2019-05-09T10:28:43,217][INFO ][o.e.p.PluginsService ] [archer] loaded module [percolator]
[2019-05-09T10:28:43,218][INFO ][o.e.p.PluginsService ] [archer] loaded module [rank-eval]
[2019-05-09T10:28:43,218][INFO ][o.e.p.PluginsService ] [archer] loaded module [reindex]
[2019-05-09T10:28:43,219][INFO ][o.e.p.PluginsService ] [archer] loaded module [repository-url]
[2019-05-09T10:28:43,219][INFO ][o.e.p.PluginsService ] [archer] loaded module [transport-netty4]
[2019-05-09T10:28:43,220][INFO ][o.e.p.PluginsService ] [archer] no plugins loaded
[2019-05-09T10:28:46,428][ERROR][o.e.b.Bootstrap ] [archer] Exception
java.lang.NullPointerException: null
at sun.nio.fs.UnixFileSystem.getPath(UnixFileSystem.java:272) ~[?:?]
at org.elasticsearch.common.io.PathUtils.get(PathUtils.java:60) ~[elasticsearch-core-7.0.1.jar:7.0.1]
at org.elasticsearch.monitor.os.OsProbe.readSysFsCgroupCpuAcctCpuAcctUsage(OsProbe.java:277) ~[elasticsearch-7.0.1.jar:7.0.1]
at org.elasticsearch.monitor.os.OsProbe.getCgroupCpuAcctUsageNanos(OsProbe.java:264) ~[elasticsearch-7.0.1.jar:7.0.1]
at org.elasticsearch.monitor.os.OsProbe.getCgroup(OsProbe.java:483) ~[elasticsearch-7.0.1.jar:7.0.1]
at org.elasticsearch.monitor.os.OsProbe.osStats(OsProbe.java:603) ~[elasticsearch-7.0.1.jar:7.0.1]
at org.elasticsearch.monitor.os.OsService.<init>(OsService.java:49) ~[elasticsearch-7.0.1.jar:7.0.1]
at org.elasticsearch.monitor.MonitorService.<init>(MonitorService.java:46) ~[elasticsearch-7.0.1.jar:7.0.1]
at org.elasticsearch.node.Node.<init>(Node.java:365) ~[elasticsearch-7.0.1.jar:7.0.1]
at org.elasticsearch.node.Node.<init>(Node.java:251) ~[elasticsearch-7.0.1.jar:7.0.1]
at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:211) ~[elasticsearch-7.0.1.jar:7.0.1]
at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:211) ~[elasticsearch-7.0.1.jar:7.0.1]
at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:325) [elasticsearch-7.0.1.jar:7.0.1]
at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) [elasticsearch-7.0.1.jar:7.0.1]
at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150) [elasticsearch-7.0.1.jar:7.0.1]
at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) [elasticsearch-7.0.1.jar:7.0.1]
at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:124) [elasticsearch-cli-7.0.1.jar:7.0.1]
at org.elasticsearch.cli.Command.main(Command.java:90) [elasticsearch-cli-7.0.1.jar:7.0.1]
at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:115) [elasticsearch-7.0.1.jar:7.0.1]
at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92) [elasticsearch-7.0.1.jar:7.0.1]
[2019-05-09T10:28:46,442][WARN ][o.e.b.ElasticsearchUncaughtExceptionHandler] [archer] uncaught exception in thread [main]
org.elasticsearch.bootstrap.StartupException: java.lang.NullPointerException
at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:163) ~[elasticsearch-7.0.1.jar:7.0.1]
at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150) ~[elasticsearch-7.0.1.jar:7.0.1]
at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) ~[elasticsearch-7.0.1.jar:7.0.1]
at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:124) ~[elasticsearch-cli-7.0.1.jar:7.0.1]
at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-cli-7.0.1.jar:7.0.1]
at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:115) ~[elasticsearch-7.0.1.jar:7.0.1]
at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92) ~[elasticsearch-7.0.1.jar:7.0.1]
Caused by: java.lang.NullPointerException
at sun.nio.fs.UnixFileSystem.getPath(UnixFileSystem.java:272) ~[?:?]
at org.elasticsearch.common.io.PathUtils.get(PathUtils.java:60) ~[elasticsearch-core-7.0.1.jar:7.0.1]
at org.elasticsearch.monitor.os.OsProbe.readSysFsCgroupCpuAcctCpuAcctUsage(OsProbe.java:277) ~[elasticsearch-7.0.1.jar:7.0.1]
at org.elasticsearch.monitor.os.OsProbe.getCgroupCpuAcctUsageNanos(OsProbe.java:264) ~[elasticsearch-7.0.1.jar:7.0.1]
at org.elasticsearch.monitor.os.OsProbe.getCgroup(OsProbe.java:483) ~[elasticsearch-7.0.1.jar:7.0.1]
at org.elasticsearch.monitor.os.OsProbe.osStats(OsProbe.java:603) ~[elasticsearch-7.0.1.jar:7.0.1]
at org.elasticsearch.monitor.os.OsService.<init>(OsService.java:49) ~[elasticsearch-7.0.1.jar:7.0.1]
at org.elasticsearch.monitor.MonitorService.<init>(MonitorService.java:46) ~[elasticsearch-7.0.1.jar:7.0.1]
at org.elasticsearch.node.Node.<init>(Node.java:365) ~[elasticsearch-7.0.1.jar:7.0.1]
at org.elasticsearch.node.Node.<init>(Node.java:251) ~[elasticsearch-7.0.1.jar:7.0.1]
at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:211) ~[elasticsearch-7.0.1.jar:7.0.1]
at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:211) ~[elasticsearch-7.0.1.jar:7.0.1]
at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:325) ~[elasticsearch-7.0.1.jar:7.0.1]
at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-7.0.1.jar:7.0.1]
... 6 moreIt used to work a couple of weeks ago so I'm not sure if this is a bug with Elasticsearch or another package. Any help, appreciated.
Last edited by viniosity (2019-05-14 05:08:14)
Offline
So it looks like this is related to me installing the linux-ck kernel which uses a different scheduler.( source 1, source 2 )
I'm trying to decide whether to change the scheduler on linux-ck or downgrade to the vanilla kernel. The reason for my switch is the vanilla kernel would freeze with moderate disk I/O.
I'll leave this thread open for a day or so in case anybody wants to chime in. Otherwise I'll downgrade my kernel and come back and mark it solved if it turns out to be the problem and open a new thread for my disk i/o issues.
Offline