Linux-4.12 hostname lookup problems

wins · 2017-07-29 08:34:23

Hi all!
Yesterday I have updated my 2 DNS servers.
After 4 hours from update, monitoring system alarmed me about problems with dns service.

Here is update log:

 
[2017-07-28 22:37] [PACMAN] Running 'pacman -Syu'
[2017-07-28 22:37] [PACMAN] synchronizing package lists
[2017-07-28 22:37] [PACMAN] starting full system upgrade
[2017-07-28 22:38] [ALPM] transaction started
[2017-07-28 22:38] [ALPM] upgraded glibc (2.25-5 -> 2.25-7)
[2017-07-28 22:38] [ALPM-SCRIPTLET] Generating locales...
[2017-07-28 22:38] [ALPM-SCRIPTLET]   en_US.UTF-8... done
[2017-07-28 22:38] [ALPM-SCRIPTLET]   en_US.ISO-8859-1... done
[2017-07-28 22:38] [ALPM-SCRIPTLET]   ru_RU.KOI8-R... done
[2017-07-28 22:38] [ALPM-SCRIPTLET]   ru_RU.UTF-8... done
[2017-07-28 22:38] [ALPM-SCRIPTLET]   ru_RU.ISO-8859-5... done
[2017-07-28 22:38] [ALPM-SCRIPTLET] Generation complete.
[2017-07-28 22:38] [ALPM] upgraded zlib (1:1.2.11-1 -> 1:1.2.11-2)
[2017-07-28 22:38] [ALPM] upgraded gcc-libs (7.1.1-3 -> 7.1.1-4)
[2017-07-28 22:38] [ALPM] upgraded pcre (8.40-1 -> 8.41-1)
[2017-07-28 22:38] [ALPM] upgraded openssl (1.1.0.f-1 -> 1.1.0.f-2)
[2017-07-28 22:38] [ALPM] upgraded expat (2.2.1-1 -> 2.2.2-1)
[2017-07-28 22:38] [ALPM] upgraded libsystemd (233.75-3 -> 234.11-1)
[2017-07-28 22:38] [ALPM] upgraded libutil-linux (2.29.2-2 -> 2.30.1-2)
[2017-07-28 22:38] [ALPM] installed libcap-ng (0.7.8-1)
[2017-07-28 22:38] [ALPM] upgraded util-linux (2.29.2-2 -> 2.30.1-2)
[2017-07-28 22:38] [ALPM] upgraded apache (2.4.26-3 -> 2.4.27-1)
[2017-07-28 22:38] [ALPM] upgraded binutils (2.28.0-3 -> 2.28.0-4)
[2017-07-28 22:38] [ALPM] upgraded bison (3.0.4-2 -> 3.0.4-3)
[2017-07-28 22:38] [ALPM] upgraded device-mapper (2.02.172-2 -> 2.02.173-1)
[2017-07-28 22:38] [ALPM] upgraded dnssec-anchors (20170228-1 -> 20170711-1)
[2017-07-28 22:38] [ALPM] upgraded harfbuzz (1.4.6-1 -> 1.4.7-1)
[2017-07-28 22:38] [ALPM] upgraded fontconfig (2.12.3-1 -> 2.12.4-1)
[2017-07-28 22:38] [ALPM-SCRIPTLET] Rebuilding fontconfig cache... done.
[2017-07-28 22:38] [ALPM] upgraded gcc (7.1.1-3 -> 7.1.1-4)
[2017-07-28 22:38] [ALPM] upgraded libelf (0.169-1 -> 0.169-2)
[2017-07-28 22:38] [ALPM] upgraded libjpeg-turbo (1.5.1-1 -> 1.5.2-1)
[2017-07-28 22:38] [ALPM] upgraded libtiff (4.0.8-1 -> 4.0.8-2)
[2017-07-28 22:38] [ALPM] upgraded linux-firmware (20170422.ade8332-1 -> 20170622.7d2c913-1)
[2017-07-28 22:38] [ALPM] upgraded popt (1.16-8 -> 1.16-9)
[2017-07-28 22:38] [ALPM] upgraded systemd (233.75-3 -> 234.11-1)
[2017-07-28 22:38] [ALPM] upgraded linux (4.11.9-1 -> 4.12.3-1)
[2017-07-28 22:38] [ALPM-SCRIPTLET] >>> Updating module dependencies. Please wait ...
[2017-07-28 22:38] [ALPM] upgraded lvm2 (2.02.172-2 -> 2.02.173-1)
[2017-07-28 22:38] [ALPM] warning: /etc/pacman.d/mirrorlist installed as /etc/pacman.d/mirrorlist.pacnew
[2017-07-28 22:38] [ALPM] upgraded pacman-mirrorlist (20170628-1 -> 20170714-1)
[2017-07-28 22:38] [ALPM] upgraded pacman (5.0.2-1 -> 5.0.2-2)
[2017-07-28 22:38] [ALPM] upgraded package-query (1.8-1 -> 1.9-1)
[2017-07-28 22:38] [ALPM] upgraded python2 (2.7.13-3 -> 2.7.13-4)
[2017-07-28 22:38] [ALPM] upgraded s-nail (14.8.16-2 -> 14.9.0-1)
[2017-07-28 22:38] [ALPM] upgraded systemd-sysvcompat (233.75-3 -> 234.11-1)
[2017-07-28 22:38] [ALPM] upgraded tcpdump (4.9.0-2 -> 4.9.1-1)
[2017-07-28 22:38] [ALPM] upgraded vim-runtime (8.0.0628-1 -> 8.0.0722-1)
[2017-07-28 22:38] [ALPM] upgraded vim (8.0.0628-1 -> 8.0.0722-1)
[2017-07-28 22:38] [ALPM] upgraded yaourt (1.8.1-1 -> 1.9-1)
[2017-07-28 22:38] [ALPM] upgraded zabbix-agent (3.2.6-4 -> 3.2.7-1)
[2017-07-28 22:38] [ALPM] transaction completed
[2017-07-28 22:38] [ALPM] running '90-linux.hook'...
[2017-07-28 22:38] [ALPM-SCRIPTLET] ==> Building image from preset: /etc/mkinitcpio.d/linux.preset: 'default'
[2017-07-28 22:38] [ALPM-SCRIPTLET]   -> -k /boot/vmlinuz-linux -c /etc/mkinitcpio.conf -g /boot/initramfs-linux.img
[2017-07-28 22:38] [ALPM-SCRIPTLET] ==> Starting build: 4.12.3-1-ARCH
[2017-07-28 22:38] [ALPM-SCRIPTLET]   -> Running build hook: [base]
[2017-07-28 22:38] [ALPM-SCRIPTLET]   -> Running build hook: [udev]
[2017-07-28 22:38] [ALPM-SCRIPTLET]   -> Running build hook: [autodetect]
[2017-07-28 22:38] [ALPM-SCRIPTLET]   -> Running build hook: [modconf]
[2017-07-28 22:38] [ALPM-SCRIPTLET]   -> Running build hook: [block]
[2017-07-28 22:38] [ALPM-SCRIPTLET]   -> Running build hook: [filesystems]
[2017-07-28 22:38] [ALPM-SCRIPTLET]   -> Running build hook: [keyboard]
[2017-07-28 22:38] [ALPM-SCRIPTLET]   -> Running build hook: [fsck]
[2017-07-28 22:38] [ALPM-SCRIPTLET] ==> Generating module dependencies
[2017-07-28 22:38] [ALPM-SCRIPTLET] ==> Creating gzip-compressed initcpio image: /boot/initramfs-linux.img
[2017-07-28 22:38] [ALPM-SCRIPTLET] ==> Image generation successful
[2017-07-28 22:38] [ALPM-SCRIPTLET] ==> Building image from preset: /etc/mkinitcpio.d/linux.preset: 'fallback'
[2017-07-28 22:38] [ALPM-SCRIPTLET]   -> -k /boot/vmlinuz-linux -c /etc/mkinitcpio.conf -g /boot/initramfs-linux-fallback.img -S autodetect
[2017-07-28 22:38] [ALPM-SCRIPTLET] ==> Starting build: 4.12.3-1-ARCH
[2017-07-28 22:38] [ALPM-SCRIPTLET]   -> Running build hook: [base]
[2017-07-28 22:38] [ALPM-SCRIPTLET]   -> Running build hook: [udev]
[2017-07-28 22:38] [ALPM-SCRIPTLET]   -> Running build hook: [modconf]
[2017-07-28 22:38] [ALPM-SCRIPTLET]   -> Running build hook: [block]
[2017-07-28 22:38] [ALPM-SCRIPTLET] ==> WARNING: Possibly missing firmware for module: aic94xx
[2017-07-28 22:38] [ALPM-SCRIPTLET] ==> WARNING: Possibly missing firmware for module: wd719x
[2017-07-28 22:39] [ALPM-SCRIPTLET]   -> Running build hook: [filesystems]
[2017-07-28 22:39] [ALPM-SCRIPTLET]   -> Running build hook: [keyboard]
[2017-07-28 22:39] [ALPM-SCRIPTLET]   -> Running build hook: [fsck]
[2017-07-28 22:39] [ALPM-SCRIPTLET] ==> Generating module dependencies
[2017-07-28 22:39] [ALPM-SCRIPTLET] ==> Creating gzip-compressed initcpio image: /boot/initramfs-linux-fallback.img
[2017-07-28 22:39] [ALPM-SCRIPTLET] ==> Image generation successful
[2017-07-28 22:39] [ALPM] running 'systemd-hwdb.hook'...
[2017-07-28 22:39] [ALPM] running 'systemd-sysusers.hook'...
[2017-07-28 22:39] [ALPM] running 'systemd-tmpfiles.hook'...
[2017-07-28 22:39] [ALPM] running 'systemd-update.hook'...
[2017-07-28 22:39] [ALPM] running 'texinfo-install.hook'...
[2017-07-28 22:42] [PACMAN] Running 'pacman -Rds php-apache'
[2017-07-28 22:42] [ALPM] transaction started
[2017-07-28 22:42] [ALPM] removed php-apache (7.1.7-2)
[2017-07-28 22:42] [ALPM] transaction completed
[2017-07-28 22:42] [ALPM] running 'systemd-update.hook'...
[2017-07-28 22:42] [PACMAN] Running 'pacman -Rds apache'
[2017-07-28 22:42] [ALPM] transaction started
[2017-07-28 22:42] [ALPM] warning: /etc/httpd/conf/httpd.conf saved as /etc/httpd/conf/httpd.conf.pacsave
[2017-07-28 22:42] [ALPM] removed apache (2.4.27-1)
[2017-07-28 22:42] [ALPM] removed apr-util (1.6.0-1)
[2017-07-28 22:42] [ALPM] removed apr (1.6.2-1)
[2017-07-28 22:42] [ALPM] transaction completed
[2017-07-28 22:42] [ALPM] running 'systemd-update.hook'...

And the biggest strange thing:

 
nslookup google.com
;; connection timed out; no servers could be reached

nslookup google.com 8.8.8.8
;; connection timed out; no servers could be reached

systemctl stop named;  nslookup google.com 8.8.8.8
Server:        8.8.8.8
Address:    8.8.8.8#53

Non-authoritative answer:
Name:    google.com
Address: 173.194.122.232
Name:    google.com
Address: 173.194.122.238
Name:    google.com
Address: 173.194.122.226
Name:    google.com
Address: 173.194.122.224
Name:    google.com
Address: 173.194.122.229
Name:    google.com
Address: 173.194.122.225
Name:    google.com
Address: 173.194.122.230
Name:    google.com
Address: 173.194.122.227
Name:    google.com
Address: 173.194.122.233
Name:    google.com
Address: 173.194.122.231
Name:    google.com
Address: 173.194.122.228
Name:    google.com
Address: 2a00:1450:400a:804::200e

systemctl start named;  nslookup google.com 8.8.8.8
;; connection timed out; no servers could be reached

Installed bind version:
extra/bind 9.11.1.P3-1 [installed]
extra/bind-tools 9.11.1.P3-1 [installed]

I trie'd to lookup with other DNS, where I can dump: other DNS servers receive's request and send a reply correctly.

iptables is not used
System reboot solves problem for a short time (2-4 hours), and problem came again.
Which packet brokes nslookup? systemd? kernel?

Last edited by wins (2017-08-07 06:32:31)

jasonwryan · 2017-07-29 09:15:03

Please use code tags when pasting to the boards: https://wiki.archlinux.org/index.php/Co … s_and_code

seth · 2017-07-29 12:03:28

Obviously the local named process isn't responding any more - so look into the journal for named errors or run "named -d 100" from an interactive shell to inspect the output when it starts failing.
I guess aside a reboot a restart of the naed.service will do as well, so as a workaround you could setup a cron job or systed timer to restart it frequently.

wins · 2017-07-29 12:27:58

Manual restart named process have no effect.
journal is full of messages aka "servfail". nslookup, dig, ping, drill - not working too.

Now I successfully restore VM to state before this "update", and two production DNS servers working correctly.

Still trying to fix this on cloned VM..

seth · 2017-07-29 12:38:24

Much luck, but if you continue to make only vague statements on the system condition, error messages etc., you'll be on your own with this.

wins · 2017-08-04 05:50:10

solved after update:
upgraded libsystemd (234.11-1 -> 234.11-3)
upgraded systemd (234.11-1 -> 234.11-3)

wrong, wrong, wrong

problem is reproduced with upgrade from linux-4.11 to linux-4.12.

downgrade to linux-lts fixes problem.

Dear moderators, is it possible to transfer this thread to https://bbs.archlinux.org/viewforum.php?id=22 ?

Last edited by wins (2017-08-07 06:31:22)

Arch Linux

#1 2017-07-29 08:34:23

Linux-4.12 hostname lookup problems

#2 2017-07-29 09:15:03

Re: Linux-4.12 hostname lookup problems

#3 2017-07-29 12:03:28

Re: Linux-4.12 hostname lookup problems

#4 2017-07-29 12:27:58

Re: Linux-4.12 hostname lookup problems

#5 2017-07-29 12:38:24

Re: Linux-4.12 hostname lookup problems

#6 2017-08-04 05:50:10

Re: Linux-4.12 hostname lookup problems

Board footer