samba 4.12.2 depends on icu 67

rigred · 2020-05-01 15:12:03

I just upgraded my install including samba to 4.12.2
Aside from samba 4.12.2 being a very broken mess. It also depends on icu version 67 which at the time doesn't appear in package index search (despite being present on servers and updated) and isn't listed as a dependency on the samba arch package.

 ldd /usr/bin/smbd | grep icu
        libicui18n.so.67 => not found
        libicuuc.so.67 => not found

For the time being I'm having to rollback to samba 4.10 since from Windows any shares when mapped as network drives are inaccessible with all sorts of errors, claiming that the resource is in use by another process etc.
Some other bug reports that are also still present can be found here:
https://bbs.archlinux.org/viewtopic.php?id=254083
https://bbs.archlinux.org/viewtopic.php?id=255232

Last edited by rigred (2020-05-01 15:13:49)

rigred · 2020-05-01 15:41:21

The bug with samba 4.12.x itself is absolutely bizarre and I can't find a way to reasonable track down it's origin.
Browsing subdirectories of a mounted network share is possible by directly entering the path.
But going to the root of the network drive path is broken (example, Z:\)

Additionally once a network share is added as a mapped drive, the network share becomes inaccessible via the (\\IP\Path)) URI.

If someone want's to submit this upstream feel free, though I doubt it matters, it's so blatantly broken I would be impressed if it gets missed.

WorMzy · 2020-05-01 15:48:10

Use lddtree (from pax-utils), not ldd.

Mod note: Not a pacman issue, moving to NC.

Last edited by WorMzy (2020-05-01 15:49:18)

V1del · 2020-05-01 16:57:39

If you don't get icu during the update that is a sign that you have outdated mirrors, double check your mirror list so that you get one with a quick sync time and 100% completion. https://www.archlinux.org/mirrors/status/

rigred · 2020-05-01 17:59:58

Dang I should feel insulted getting moved into the newbie corner. But whatever Haha XD
12 years of arch and aur package maintainer.
Just never bothered with a forum account.

At the time pulled core from https://mirror.orbit-os.com/archlinux/core/os/x86_64/
Evidently then hadn't synced index fully (the usual index update delay culprit)
And this even with a custom reflector script that checks for completed mirrors only.

More importantly the smbclient package still doesn't include icu as a dependency for 4.12
Here's the lddtree output

lddtree /usr/bin/smbd
/usr/bin/smbd (interpreter => /lib64/ld-linux-x86-64.so.2)
    libsamba-util.so.0 => /usr/lib/libsamba-util.so.0
        libtime-basic-samba4.so => /usr/lib/samba/libtime-basic-samba4.so
        libreplace-samba4.so => /usr/lib/samba/libreplace-samba4.so
        libsystemd.so.0 => /usr/lib/libsystemd.so.0
            librt.so.1 => /usr/lib/librt.so.1
            liblzma.so.5 => /usr/lib/liblzma.so.5
            liblz4.so.1 => /usr/lib/liblz4.so.1
            libgcrypt.so.20 => /usr/lib/libgcrypt.so.20
                libgpg-error.so.0 => /usr/lib/libgpg-error.so.0
        libicui18n.so.67 => None
        libicuuc.so.67 => None
        libbsd.so.0 => /usr/lib/libbsd.so.0
    libsmbd-base-samba4.so => /usr/lib/samba/libsmbd-base-samba4.so
        libndr.so.1 => /usr/lib/libndr.so.1
        libsmbd-conn-samba4.so => /usr/lib/samba/libsmbd-conn-samba4.so
        libmessages-util-samba4.so => /usr/lib/samba/libmessages-util-samba4.so
        liblibsmb-samba4.so => /usr/lib/samba/liblibsmb-samba4.so
            libasn1util-samba4.so => /usr/lib/samba/libasn1util-samba4.so
            libutil-cmdline-samba4.so => /usr/lib/samba/libutil-cmdline-samba4.so
            libcli-cldap-samba4.so => /usr/lib/samba/libcli-cldap-samba4.so
                libcli-ldap-common-samba4.so => /usr/lib/samba/libcli-ldap-common-samba4.so
                libldb.so.2 => /usr/lib/libldb.so.2
                    libdl.so.2 => /usr/lib/libdl.so.2
            libsmb-transport-samba4.so => /usr/lib/samba/libsmb-transport-samba4.so
            libndr-nbt.so.0 => /usr/lib/libndr-nbt.so.0
        libdbwrap-samba4.so => /usr/lib/samba/libdbwrap-samba4.so
        libsamba-security-samba4.so => /usr/lib/samba/libsamba-security-samba4.so
        libkrb5samba-samba4.so => /usr/lib/samba/libkrb5samba-samba4.so
            libkrb5.so.3 => /usr/lib/libkrb5.so.3
                libkrb5support.so.0 => /usr/lib/libkrb5support.so.0
                libkeyutils.so.1 => /usr/lib/libkeyutils.so.1
                libresolv.so.2 => /usr/lib/libresolv.so.2
            libk5crypto.so.3 => /usr/lib/libk5crypto.so.3
            libgssapi_krb5.so.2 => /usr/lib/libgssapi_krb5.so.2
        libmessages-dgm-samba4.so => /usr/lib/samba/libmessages-dgm-samba4.so
            libmsghdr-samba4.so => /usr/lib/samba/libmsghdr-samba4.so
        libprinting-migrate-samba4.so => /usr/lib/samba/libprinting-migrate-samba4.so
        libnpa-tstream-samba4.so => /usr/lib/samba/libnpa-tstream-samba4.so
        libcommon-auth-samba4.so => /usr/lib/samba/libcommon-auth-samba4.so
            libMESSAGING-SEND-samba4.so => /usr/lib/samba/libMESSAGING-SEND-samba4.so
        libserver-id-db-samba4.so => /usr/lib/samba/libserver-id-db-samba4.so
        libiov-buf-samba4.so => /usr/lib/samba/libiov-buf-samba4.so
        libmsrpc3-samba4.so => /usr/lib/samba/libmsrpc3-samba4.so
        libnetapi.so.0 => /usr/lib/libnetapi.so.0
            liblibcli-netlogon3-samba4.so => /usr/lib/samba/liblibcli-netlogon3-samba4.so
            libflag-mapping-samba4.so => /usr/lib/samba/libflag-mapping-samba4.so
            libtrusts-util-samba4.so => /usr/lib/samba/libtrusts-util-samba4.so
        libdfs-server-ad-samba4.so => /usr/lib/samba/libdfs-server-ad-samba4.so
            libsamdb-common-samba4.so => /usr/lib/samba/libsamdb-common-samba4.so
        libCHARSET3-samba4.so => /usr/lib/samba/libCHARSET3-samba4.so
        libhttp-samba4.so => /usr/lib/samba/libhttp-samba4.so
            libclidns-samba4.so => /usr/lib/samba/libclidns-samba4.so
        libsamdb.so.0 => /usr/lib/libsamdb.so.0
            libldbsamba-samba4.so => /usr/lib/samba/libldbsamba-samba4.so
            libz.so.1 => /usr/lib/libz.so.1
        libdcerpc-samba-samba4.so => /usr/lib/samba/libdcerpc-samba-samba4.so
        libgse-samba4.so => /usr/lib/samba/libgse-samba4.so
            libaddns-samba4.so => /usr/lib/samba/libaddns-samba4.so
            libcli-nbt-samba4.so => /usr/lib/samba/libcli-nbt-samba4.so
        libcli-smb-common-samba4.so => /usr/lib/samba/libcli-smb-common-samba4.so
        libgensec-samba4.so => /usr/lib/samba/libgensec-samba4.so
        libtdb-wrap-samba4.so => /usr/lib/samba/libtdb-wrap-samba4.so
        libcli-spoolss-samba4.so => /usr/lib/samba/libcli-spoolss-samba4.so
        libutil-reg-samba4.so => /usr/lib/samba/libutil-reg-samba4.so
        libevents-samba4.so => /usr/lib/samba/libevents-samba4.so
        libutil-setid-samba4.so => /usr/lib/samba/libutil-setid-samba4.so
        liblibcli-lsa3-samba4.so => /usr/lib/samba/liblibcli-lsa3-samba4.so
        libads-samba4.so => /usr/lib/samba/libads-samba4.so
            libsmbldap.so.2 => /usr/lib/libsmbldap.so.2
            liblber-2.4.so.2 => /usr/lib/liblber-2.4.so.2
        libsamba-modules-samba4.so => /usr/lib/samba/libsamba-modules-samba4.so
        libwbclient.so.0 => /usr/lib/libwbclient.so.0
            libwinbind-client-samba4.so => /usr/lib/samba/libwinbind-client-samba4.so
        libsamba-credentials.so.0 => /usr/lib/libsamba-credentials.so.0
        libdcerpc-binding.so.0 => /usr/lib/libdcerpc-binding.so.0
        libndr-samba4.so => /usr/lib/samba/libndr-samba4.so
            libndr-krb5pac.so.0 => /usr/lib/libndr-krb5pac.so.0
        libauthkrb5-samba4.so => /usr/lib/samba/libauthkrb5-samba4.so
        libldap-2.4.so.2 => /usr/lib/libldap-2.4.so.2
            libsasl2.so.3 => /usr/lib/libsasl2.so.3
            libssl.so.1.1 => /usr/lib/libssl.so.1.1
            libcrypto.so.1.1 => /usr/lib/libcrypto.so.1.1
        libcom_err.so.2 => /usr/lib/libcom_err.so.2
        libtdb.so.1 => /usr/lib/libtdb.so.1
        libcups.so.2 => /usr/lib/libcups.so.2
            libm.so.6 => /usr/lib/libm.so.6
            libcrypt.so.1 => /usr/lib/libcrypt.so.1
        libavahi-client.so.3 => /usr/lib/libavahi-client.so.3
            libdbus-1.so.3 => /usr/lib/libdbus-1.so.3
        libjansson.so.4 => /usr/lib/libjansson.so.4
        libtirpc.so.3 => /usr/lib/libtirpc.so.3
        libacl.so.1 => /usr/lib/libacl.so.1
            libattr.so.1 => /usr/lib/libattr.so.1
        libgnutls.so.30 => /usr/lib/libgnutls.so.30
            libp11-kit.so.0 => /usr/lib/libp11-kit.so.0
                libffi.so.7 => /usr/lib/libffi.so.7
            libidn2.so.0 => /usr/lib/libidn2.so.0
            libunistring.so.2 => /usr/lib/libunistring.so.2
            libtasn1.so.6 => /usr/lib/libtasn1.so.6
            libnettle.so.7 => /usr/lib/libnettle.so.7
            libhogweed.so.5 => /usr/lib/libhogweed.so.5
            libgmp.so.10 => /usr/lib/libgmp.so.10
        libavahi-common.so.3 => /usr/lib/libavahi-common.so.3
    libpopt-samba3-samba4.so => /usr/lib/samba/libpopt-samba3-samba4.so
    libgenrand-samba4.so => /usr/lib/samba/libgenrand-samba4.so
    libsocket-blocking-samba4.so => /usr/lib/samba/libsocket-blocking-samba4.so
    libsamba-debug-samba4.so => /usr/lib/samba/libsamba-debug-samba4.so
    libsys-rw-samba4.so => /usr/lib/samba/libsys-rw-samba4.so
    libndr-samba-samba4.so => /usr/lib/samba/libndr-samba-samba4.so
    libsmbconf.so.0 => /usr/lib/libsmbconf.so.0
        libtalloc-report-printf-samba4.so => /usr/lib/samba/libtalloc-report-printf-samba4.so
        libinterfaces-samba4.so => /usr/lib/samba/libinterfaces-samba4.so
        libserver-role-samba4.so => /usr/lib/samba/libserver-role-samba4.so
        libnsl.so.2 => /usr/lib/libnsl.so.2
        libcap.so.2 => /usr/lib/libcap.so.2
    libsamba-sockets-samba4.so => /usr/lib/samba/libsamba-sockets-samba4.so
    libtevent-util.so.0 => /usr/lib/libtevent-util.so.0
    libcliauth-samba4.so => /usr/lib/samba/libcliauth-samba4.so
    libutil-tdb-samba4.so => /usr/lib/samba/libutil-tdb-samba4.so
    libauth-samba4.so => /usr/lib/samba/libauth-samba4.so
        libMESSAGING-samba4.so => /usr/lib/samba/libMESSAGING-samba4.so
        libpam.so.0 => /usr/lib/libpam.so.0
            libaudit.so.1 => /usr/lib/libaudit.so.1
                libcap-ng.so.0 => /usr/lib/libcap-ng.so.0
    libsamba3-util-samba4.so => /usr/lib/samba/libsamba3-util-samba4.so
    libsamba-passdb.so.0 => /usr/lib/libsamba-passdb.so.0
    libsamba-errors.so.1 => /usr/lib/libsamba-errors.so.1
    libsamba-cluster-support-samba4.so => /usr/lib/samba/libsamba-cluster-support-samba4.so
    libndr-standard.so.0 => /usr/lib/libndr-standard.so.0
    libsmbd-shim-samba4.so => /usr/lib/samba/libsmbd-shim-samba4.so
    libsamba-hostconfig.so.0 => /usr/lib/libsamba-hostconfig.so.0
    libsecrets3-samba4.so => /usr/lib/samba/libsecrets3-samba4.so
    libtalloc.so.2 => /usr/lib/libtalloc.so.2
    libpopt.so.0 => /usr/lib/libpopt.so.0
    libtevent.so.0 => /usr/lib/libtevent.so.0
    libpthread.so.0 => /usr/lib/libpthread.so.0
    libglib-2.0.so.0 => /usr/lib/libglib-2.0.so.0
        libpcre.so.1 => /usr/lib/libpcre.so.1
    libc.so.6 => /usr/lib/libc.so.6

libsamba-util.so.0 => /usr/lib/libsamba-util.so.0
libtime-basic-samba4.so => /usr/lib/samba/libtime-basic-samba4.so
libreplace-samba4.so => /usr/lib/samba/libreplace-samba4.so
libsystemd.so.0 => /usr/lib/libsystemd.so.0
librt.so.1 => /usr/lib/librt.so.1
liblzma.so.5 => /usr/lib/liblzma.so.5
liblz4.so.1 => /usr/lib/liblz4.so.1
libgcrypt.so.20 => /usr/lib/libgcrypt.so.20
libgpg-error.so.0 => /usr/lib/libgpg-error.so.0
libicui18n.so.67 => None
libicuuc.so.67 => None
libbsd.so.0 => /usr/lib/libbsd.so.0

pacman -Qo /usr/lib/libsamba-util.so
/usr/lib/libsamba-util.so is owned by smbclient 4.12.2-2

Believe me now?

samba 4.11 and 4.10 do not link to libicu and even manually loading the 67 version doesn't fix the samba issues.

For the fun of it here's a screenshot of what 4.12 behaves like with a perfectly valid samba config. Absolutely stuffed.
https://i.imgur.com/DWqIhHP.jpg

Mod note: replaced oversized image with URL.

Last edited by WorMzy (2020-05-01 18:33:56)

loqs · 2020-05-01 18:12:17

Please do not post oversized images. Please post the output of the following as well as the contents of /var/log/pacman.log

pacman -Qi smbclient

V1del · 2020-05-01 18:12:43

You need to define which issue you want to look at, you should first ensure your dependencies are in proper order, whether earlier versions did or did not depend on icu is completely irrelevant, it does so now, so ensure your packages are properly synchronized.

If you did not get the new icu version your mirrors are outdated and you should ensure all dependencies are properly resolved. If the issue persists afterwards, post logs of the samba server while it's running instead of a meaningless screenshot from windows (and if you feel the need to do so, please only post thumbnails or links).

rigred · 2020-05-01 18:16:06

loqs wrote:

Please do not post oversized images. Please post the output of the following as well as the contents of /var/log/pacman.log
pacman -Qi smbclient

Name            : smbclient
Version         : 4.12.2-2
Description     : Tools to access a server's filespace and printers via SMB
Architecture    : x86_64
URL             : https://www.samba.org
Licenses        : GPL3
Groups          : None
Provides        : libwbclient
Depends On      : popt  cifs-utils  tdb  ldb  tevent  libgcrypt  python  talloc  readline  gnutls  libbsd  libldap  libcups  libarchive  libnsl  jansson  libldb.so=2-64  libtdb.so=1-64  libtevent.so=0-64  libreadline.so=8-64
Optional Deps   : python-dnspython: samba_dnsupdate and samba_upgradedns in AD setup
Required By     : cifs-utils  kio-extras  mpv  samba
Optional For    : vlc  xine-lib
Conflicts With  : None
Replaces        : libwbclient
Installed Size  : 25.89 MiB
Packager        : Jelle van der Waa <jelle@archlinux.org>
Build Date      : Thu Apr 30 21:38:40 2020
Install Date    : Fri May 1 19:48:39 2020
Install Reason  : Installed as a dependency for another package
Install Script  : No
Validated By    : Signature

rigred · 2020-05-01 18:26:37

V1del wrote:

You need to define which issue you want to look at, you should first ensure your dependencies are in proper order, whether earlier versions did or did not depend on icu is completely irrelevant, it does so now, so ensure your packages are properly synchronized.
If you did not get the new icu version your mirrors are outdated and you should ensure all dependencies are properly resolved. If the issue persists afterwards, post logs of the samba server while it's running instead of a meaningless screenshot from windows (and if you feel the need to do so, please only post thumbnails or links).

I wish there where useful logs.
Windows itself doesn't log anything helpful and the Windows Context handles I've tracked already make no sense.

On the linux side I'm looking at wireshark traffic, teasing out the details though is a mess. I'm just going directly to the samba issue tracker now while my patience holds out

For those interested here's a debug level 5 dump of samba for the particular windows system connection.
https://gist.githubusercontent.com/rigr … system.txt

Scimmia · 2020-05-01 23:26:50

Why don't you have the current version of icu? Or do you just not have icu at all?

Last edited by Scimmia (2020-05-01 23:33:39)

rigred · 2020-05-02 07:27:45

Scimmia wrote:

Why don't you have the current version of icu? Or do you just not have icu at all?

pacman -Si smbclient
Repository      : extra
Name            : smbclient
Version         : 4.12.2-3
Description     : Tools to access a server's filespace and printers via SMB
Architecture    : x86_64
URL             : https://www.samba.org
Licenses        : GPL3
Groups          : None
Provides        : libwbclient
Depends On      : popt  cifs-utils  tdb  ldb  tevent  libgcrypt  python  talloc  readline  gnutls  libbsd  libldap  libcups  libarchive  libnsl  jansson  libldb.so=2-64  libtdb.so=1-64  libtevent.so=0-64  libreadline.so=8-64
Optional Deps   : python-dnspython: samba_dnsupdate and samba_upgradedns in AD setup
Conflicts With  : None
Replaces        : libwbclient
Download Size   : 6.22 MiB
Installed Size  : 25.89 MiB
Packager        : Jelle van der Waa <jelle@archlinux.org>
Build Date      : Fri May 1 20:20:54 2020
Validated By    : MD5 Sum  SHA-256 Sum  Signature

pacman -Qi icu
Name            : icu
Version         : 67.1-1
Description     : International Components for Unicode library
Architecture    : x86_64
URL             : http://site.icu-project.org/home
Licenses        : custom:icu
Groups          : None
Provides        : libicudata.so=67-64  libicui18n.so=67-64  libicuio.so=67-64  libicutest.so=67-64  libicutu.so=67-64  libicuuc.so=67-64
Depends On      : gcc-libs  sh
Optional Deps   : None
Required By     : bind-tools  boost-libs  brltty  calibre-common  chromium  gfxbench  gnustep-base  harfbuzz-icu  lib32-icu  libcdr  libical  libmspub  libphonenumber  libreoffice-fresh  libvisio  libxml2  nodejs  postfix  r  radare2-cutter  raptor  texlive-bin
                  tor-browser  unarchiver  xfsprogs
Optional For    : qt4
Conflicts With  : None
Replaces        : None
Installed Size  : 37.39 MiB
Packager        : Andreas Radke <andyrtr@archlinux.org>
Build Date      : Mon Apr 27 07:57:07 2020
Install Date    : Fri May 1 19:54:24 2020
Install Reason  : Installed as a dependency for another package
Install Script  : No
Validated By    : Signature

icu isn't listed in the Depends On for smbclient nor is smbclient listed in the the Required By listing of icu. smbclient needs icu as a dependency as of 4.12.X

That aside 4.12.X is an entirely broken mess.

Last edited by rigred (2020-05-02 07:28:26)

Scimmia · 2020-05-02 07:29:29

You're right, the missing dep is a packaging bug, but the fact that it's required by so many other things on your system PROVES this was a partial update problem.

Figure it out.

papavlos · 2020-05-03 16:29:44

@rigred
There must be something wrong with samba 4.12 release. Either a bug, or a 'feature' which is not well documented and needs smb.conf adjustment to continue working with Win 7 clients. Affecting different host systems.
Look here:
https://lists.samba.org/archive/samba/2 … 28834.html
https://lists.samba.org/archive/samba/2 … 29338.html
Definitely downgrading to 4.11 stops the problem.

I am also suffering that at home with a very simple network setup, no domains, just simple NAS build on Arch+Samba.
It is very easy to reproduce the problem - just map in Windows more that one disk drives to shares or subfolders of a share on the same server, open and close those drives in Windows Explorer a couple of times, and finally you're getting a fantastic and funny (followed by another f's) message:

The process cannot access the file because it is being used by another process.

Reproduced also on a newly created vanilla fresh Arch system with Samba built in Virtualbox.

Anyone finds any formal bug report, eventually with a workaround, or a clear and confirmed 'new feature' explanation - please, report it here!

khvalera · 2020-05-04 16:46:04

Yesterday I updated the samba package on the server too, and today I worked out the problem for half a day . The problem also manifests itself with linux clients; the caps periodically fall off after a while.

papavlos · 2020-05-04 17:39:37

I have also reported it to samba mailing list.
Will let you know about any reasonable solution.

papavlos · 2020-05-09 17:01:41

@rigred
I have found solution of my problem, with the help of the Great Samba Team. Thanks!

Everything is in the thread in the samba mailing list.

I highly recommend you to give it a try, because of random and unpredictable symptoms reported by you, similar to mine.

Browsing subdirectories of a mounted network share is possible by directly entering the path.
But going to the root of the network drive path is broken (example, Z:\)

If you go for a current master you will get already 4.13.0pre, which is planned for the second half of this year. Of course you can also go for the current 4.12.x stable.

If you don't want to compile it by yourself, the only workaround is to manually downgrade packages to 4.11.3-3 (latest Arch release before 4.12.x) and prevent them from being upgraded by 'ignoring' them in your pacman.conf.
Until we get official maintenance release of samba package here in Arch, with this patch applied.

Arch Linux

#1 2020-05-01 15:12:03

samba 4.12.2 depends on icu 67

#2 2020-05-01 15:41:21

Re: samba 4.12.2 depends on icu 67

#3 2020-05-01 15:48:10

Re: samba 4.12.2 depends on icu 67

#4 2020-05-01 16:57:39

Re: samba 4.12.2 depends on icu 67

#5 2020-05-01 17:59:58

Re: samba 4.12.2 depends on icu 67

#6 2020-05-01 18:12:17

Re: samba 4.12.2 depends on icu 67

#7 2020-05-01 18:12:43

Re: samba 4.12.2 depends on icu 67

#8 2020-05-01 18:16:06

Re: samba 4.12.2 depends on icu 67

#9 2020-05-01 18:26:37

Re: samba 4.12.2 depends on icu 67

#10 2020-05-01 23:26:50

Re: samba 4.12.2 depends on icu 67

#11 2020-05-02 07:27:45

Re: samba 4.12.2 depends on icu 67

#12 2020-05-02 07:29:29

Re: samba 4.12.2 depends on icu 67

#13 2020-05-03 16:29:44

Re: samba 4.12.2 depends on icu 67

#14 2020-05-04 16:46:04

Re: samba 4.12.2 depends on icu 67

#15 2020-05-04 17:39:37

Re: samba 4.12.2 depends on icu 67

#16 2020-05-09 17:01:41

Re: samba 4.12.2 depends on icu 67

Board footer