How to get distcc to work? "child terminated with status 0x100"

honestly · 2017-04-10 08:02:12

Hello,

since I apparently have to bisect kernels now, I need a working distcc setup.

I have two build slaves and one master (the kernel is supposed to run on the master in the end.)

I installed distcc and made sure the gcc versions are the same on all machines and all dependencies are installed for linux-mainline from AUR.

However, all compiles fail, with error message in slave logs like this:

Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: (dcc_check_client) connection from 131.159.42.5:39016
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: (check_address_inet) match client 0x52a9f83, value 0x52a9f83, mask 0xffffffff
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: (dcc_r_token_int) got DIST00000001
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: (dcc_r_token_int) got ARGC00000037
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: (dcc_r_argv) reading 55 arguments from job submission
[... argument parsing...]
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: (dcc_scan_args) found object/output file "arch/x86/kernel/cpu/.tmp_rdrand.o"
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: (dcc_scan_args) found input file "arch/x86/kernel/cpu/rdrand.c"
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: compile from rdrand.c to .tmp_rdrand.o
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: (dcc_run_job) output file arch/x86/kernel/cpu/.tmp_rdrand.o
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: (dcc_input_tmpnam) input file arch/x86/kernel/cpu/rdrand.c
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: (dcc_r_token_int) got DOTI000589c7
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: (dcc_r_file) received 362951 bytes to file /tmp/distccd_90ff37e5.i
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: (dcc_r_file_timed) 362951 bytes received in 0.003502s, rate 101212kB/s
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: (dcc_set_input) changed input from "arch/x86/kernel/cpu/rdrand.c" to "/tmp/distccd_90ff37e5.i"
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: (dcc_set_input) command after: /usr/lib/hardening-wrapper/bin/gcc -Wall -Wundef -Wstrict-prototypes -Wno-trigraphs -fno-strict-aliasing -fno-common -Werror-implicit-function-declaration -Wno-format-security -std=gnu89 -fno-PIE -mno-sse -mno-mmx -mno-sse2 -mno-3dnow -mno-avx -m64 -falign-jumps=1 -falign-loops=1 -mno-80387 -mno-fp-ret-in-387 -mpreferred-stack-boundary=3 -mskip-rax-setup -mtune=generic -mno-red-zone -mcmodel=kernel -funit-at-a-time -pipe -Wno-sign-compare -fno-asynchronous-unwind-tables -fno-delete-null-pointer-checks -Wno-frame-address -O2 --param=allow-store-data-races=0 -Wframe-larger-than=2048 -fstack-protector-strong -Wno-unused-but-set-variable -Wno-unused-const-variable -fno-omit-frame-pointer -fno-optimize-sibling-calls -fno-var-tracking-assignments -pg -mfentry -Wdeclaration-after-statement -Wno-pointer-sign -fno-strict-overflow -fconserve-stack -Werror=implicit-int -Werror=strict-prototypes -Werror=date-time -Werror=incompatible-pointer-types -c -o arch/x86/kernel/cpu/.tmp_rdrand.o /tmp/distccd_90ff37e5.i
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: (dcc_set_output) changed output from "arch/x86/kernel/cpu/.tmp_rdrand.o" to "/tmp/distccd_90a437e5.o"
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: (dcc_set_output) command after: /usr/lib/hardening-wrapper/bin/gcc -Wall -Wundef -Wstrict-prototypes -Wno-trigraphs -fno-strict-aliasing -fno-common -Werror-implicit-function-declaration -Wno-format-security -std=gnu89 -fno-PIE -mno-sse -mno-mmx -mno-sse2 -mno-3dnow -mno-avx -m64 -falign-jumps=1 -falign-loops=1 -mno-80387 -mno-fp-ret-in-387 -mpreferred-stack-boundary=3 -mskip-rax-setup -mtune=generic -mno-red-zone -mcmodel=kernel -funit-at-a-time -pipe -Wno-sign-compare -fno-asynchronous-unwind-tables -fno-delete-null-pointer-checks -Wno-frame-address -O2 --param=allow-store-data-races=0 -Wframe-larger-than=2048 -fstack-protector-strong -Wno-unused-but-set-variable -Wno-unused-const-variable -fno-omit-frame-pointer -fno-optimize-sibling-calls -fno-var-tracking-assignments -pg -mfentry -Wdeclaration-after-statement -Wno-pointer-sign -fno-strict-overflow -fconserve-stack -Werror=implicit-int -Werror=strict-prototypes -Werror=date-time -Werror=incompatible-pointer-types -c -o /tmp/distccd_90a437e5.o /tmp/distccd_90ff37e5.i
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: (dcc_spawn_child) forking to execute: /usr/lib/hardening-wrapper/bin/gcc -Wall -Wundef -Wstrict-prototypes -Wno-trigraphs -fno-strict-aliasing -fno-common -Werror-implicit-function-declaration -Wno-format-security -std=gnu89 -fno-PIE -mno-sse -mno-mmx -mno-sse2 -mno-3dnow -mno-avx -m64 -falign-jumps=1 -falign-loops=1 -mno-80387 -mno-fp-ret-in-387 -mpreferred-stack-boundary=3 -mskip-rax-setup -mtune=generic -mno-red-zone -mcmodel=kernel -funit-at-a-time -pipe -Wno-sign-compare -fno-asynchronous-unwind-tables -fno-delete-null-pointer-checks -Wno-frame-address -O2 --param=allow-store-data-races=0 -Wframe-larger-than=2048 -fstack-protector-strong -Wno-unused-but-set-variable -Wno-unused-const-variable -fno-omit-frame-pointer -fno-optimize-sibling-calls -fno-var-tracking-assignments -pg -mfentry -Wdeclaration-after-statement -Wno-pointer-sign -fno-strict-overflow -fconserve-stack -Werror=implicit-int -Werror=strict-prototypes -Werror=date-time -Werror=incompatible-pointer-types -c -o /tmp/distccd_90a437e5.o /tmp/distccd_90ff37e5.i
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: (dcc_spawn_child) child started as pid5970
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[5970]: (dcc_new_pgrp) entered process group
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[5970]: (dcc_increment_safeguard) setting safeguard: _DISTCC_SAFEGUARD=1
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: (dcc_collect_child) cc child 5970 terminated with status 0x100
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: (dcc_collect_child) cc times: user 0.000000s, system 0.000000s, 0 minflt, 0 majflt
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: (dcc_x_token_int) send DONE00000001
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: (dcc_x_token_int) send STAT00000100
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: (dcc_x_file) send 0 byte file /tmp/distcc_b33037e5.stderr with token SERR and compression 69
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: (dcc_x_token_int) send SERR00000000
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: (dcc_x_file) send 0 byte file /tmp/distcc_b32037e5.stdout with token SOUT and compression 69
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: (dcc_x_token_int) send SOUT00000000
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: (dcc_x_token_int) send DOTO00000000
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: /usr/lib/hardening-wrapper/bin/gcc arch/x86/kernel/cpu/rdrand.c on localhost failed
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: job complete
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: (dcc_cleanup_tempfiles_inner) deleted 5 temporary files
Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: (dcc_job_summary) client: 131.159.42.5:39016 COMPILE_ERROR exit:1 sig:0 core:0 ret:0 time:135ms /usr/lib/hardening-wrapper/bin/gcc arch/x86/kernel/cpu/rdrand.c

How do I get actual error messages out?

graysky · 2017-04-10 08:52:27

Hardware details, slaves and master? Firewalls?

Lone_Wolf · 2017-04-10 11:01:36

Apr 10 09:44:37 atrbg122.informatik.tu-muenchen.de distccd[4695]: /usr/lib/hardening-wrapper/bin/gcc arch/x86/kernel/cpu/rdrand.c on localhost failed

Have you tried without hardening-wrapper installed ?

honestly · 2017-04-10 13:02:33

Lone_Wolf wrote:

Have you tried without hardening-wrapper installed ?

It seems that was the issue! Thanks!

For reference,

graysky wrote:

Hardware details, slaves and master? Firewalls?

All x86_64 with up-to-date arch software (no user repos, but adulterated with various aur packages). All hosts in the same VLAN and no firewalls.

EDIT: Lone_Wolf, do have any idea why compiling locally worked find with hardening-wrapper installed, but via distcc it didn't?

Last edited by honestly (2017-04-10 13:08:40)

Lone_Wolf · 2017-04-11 11:32:14

hardening-wrapper changes $PATH and so ensures it's gcc/g++ etc equivalents are used, not the regular ones in /usr/bin .

Distcc appears to use a different method , that clashes with hardening-wrapper.
Someone with xp with distcc may be able to explain what clashes.

Arch Linux

#1 2017-04-10 08:02:12

How to get distcc to work? "child terminated with status 0x100"

#2 2017-04-10 08:52:27

Re: How to get distcc to work? "child terminated with status 0x100"

#3 2017-04-10 11:01:36

Re: How to get distcc to work? "child terminated with status 0x100"

#4 2017-04-10 13:02:33

Re: How to get distcc to work? "child terminated with status 0x100"

#5 2017-04-11 11:32:14

Re: How to get distcc to work? "child terminated with status 0x100"

Board footer