Arch Linux

heisenberg

Member

Registered: 2017-05-27

Posts: 87

[SOLVED] HDMI Issues with kernel 4.18

Hello,

Since the update to kernel 4.18 I've got some regressions.
I have an amdgpu and with kernels 4.16 and 4.17 everything was working perfectly, basically since the merge of dc patches.
(don't remember about 4.15, for sure on 4.14 lts there are the same issues I am facing now).

Since 4.18.* it became like with older kernels: No sound output and bad colors rendering (12 bit iirc), and iirc even resolution capped at 720p when the output should be 1080p. You'll discover below why I did put iirc and didn't check exactly before posting this...

Initially I had no time to look into it, so I did just downgrade to 4.17.14 where everything works perfectly! Today I tried to update the kernel once again, and with the current version (4.18.12) I noticed that the hdmi output is just black! May someone help me to find what's wrong and solve the problem, or if needed fill a bug report ? Please ask for any additional information, I appreciate if you write also how do I retrieve it since I am not an expert. Sorry for the bad english, and thanks in advance for the support.

Last edited by heisenberg (2018-11-21 15:44:03)

loqs

Member

Registered: 2014-03-06

Posts: 17,369

Re: [SOLVED] HDMI Issues with kernel 4.18

I would suggest waiting for 4.19-rc8 to be released within the next 24 hours then trying that to see if the issues are still present.
Edit:
Forgot there was going to be an rc8.

Last edited by loqs (2018-10-15 07:02:21)

heisenberg

Member

Registered: 2017-05-27

Posts: 87

Re: [SOLVED] HDMI Issues with kernel 4.18

Tried 4.18.14 from Testing repository, not working. Same for mainline rc8, from https://wiki.archlinux.org/index.php/un … ries#miffe

To be honest I am not optimistic about the fact that will be fixed in the final release.

loqs

Member

Registered: 2014-03-06

Posts: 17,369

Re: [SOLVED] HDMI Issues with kernel 4.18

I would suggest trying the amd-staging-drm-next or drm-next-4.20 branches of https://cgit.freedesktop.org/~agd5f/linux/ next.
If that fails you could either report the issues upstream or try bisecting between 4.17 and 4.18 and find which commit first caused the issue.
Does disabling dc have make any difference if your GPU will still produce output with amdgpu.dc=0 ?

heisenberg

Member

Registered: 2017-05-27

Posts: 87

Re: [SOLVED] HDMI Issues with kernel 4.18

I tried with amdgpu.dc=0 and it behaves exactly the same as linux-lts 4.14 (as expected, no sound and bad color rendering).

I don't know how to bisect, and probably I can't do it if it takes a lot of time. Neither I know how can I try those branches...

loqs

Member

Registered: 2014-03-06

Posts: 17,369

Re: [SOLVED] HDMI Issues with kernel 4.18

https://aur.archlinux.org/packages/linux-drm-next-git/ the branch is set by https://aur.archlinux.org/cgit/aur.git/ … xt-git#n15
Please note https://aur.archlinux.org/cgit/aur.git/ … xt-git#n38 sets the pkgver to ${_kernel_rel} overriding the version recorded in the git repository itself.

heisenberg

Member

Registered: 2017-05-27

Posts: 87

Re: [SOLVED] HDMI Issues with kernel 4.18

https://aur.archlinux.org/packages/linux-drm-next-git/ the branch is set by https://aur.archlinux.org/cgit/aur.git/ … xt-git#n15
Please note https://aur.archlinux.org/cgit/aur.git/ … xt-git#n38 sets the pkgver to ${_kernel_rel} overriding the version recorded in the git repository itself.

Thanks, compiling linux-drm-next-git and linux-amd-staging-drm-next-git. Unfortunately it will take hours on my system... probably I'll test both tomorrow.
If there's a package already avaible somewhere, please link

heisenberg

Member

Registered: 2017-05-27

Posts: 87

Re: [SOLVED] HDMI Issues with kernel 4.18

Tried both kernels, not working on drm-next, while amd-staging doesn't even boot up (ends up with a black screen).

EDIT: Trying to follow https://wiki.archlinux.org/index.php/Bi … s_with_Git, other suggestions?

EDIT2: Looks like linux-git on AUR is not up to date, so how do I bisect ? Is the first time for me trying that, please help!

Last edited by heisenberg (2018-10-17 09:31:35)

loqs

Member

Registered: 2014-03-06

Posts: 17,369

Re: [SOLVED] HDMI Issues with kernel 4.18

Please check linux-4.18.1.arch1-1 is affected if you do not have the package in the systems pacman cache you can obtain it from Arch_Linux_Archive.
Edit:
The following assumes the base-devel group and git are installed and I recomend enabling Makepkg#Parallel_compilation to reduce build times

$ git clone git://git.archlinux.org/svntogit/packages.git --single-branch --branch "packages/linux"
$ cd packages/trunk
$ git checkout 	4f382ccfea47eae4eb55ee84b4577afdd372f83b #4.17.1-1
$ cd ../..
$ cp -r packages/trunk linux-git
$ rm -rf packages
$ cd linux-git
$ rm *.patch # remove unneeded patches
# Edit replace the PKGBUILD with the one below
$ makepkg -rsi #this is to confirm 4.17 as built on your system does have the issue update bootloader for new kernel if needed

$ cd linux-git/src/linux
$ git checkout v4.18
$ cd ../..
$ makepkg -ersi #this is to confirm 4.18 as built on your system does not have the issue select the default option for all prompted options

$ cd linux-git/src/linux/
$ git bisect start
$ git bisect good v4.17
$ git bisect bad v4.18
$ cd ../..
$ makepkg -ersif

$ cd linux-git/src/linux/
$ git bisect $result #substitue good or bad here
$ cd ../..
$ makepkg -ersif #repeat these four lines and test the generated kernel until git has found the bad commit

PKGBUILD

# Maintainer: Boohbah <boohbah at gmail.com>
# Contributor: Tobias Powalowski <tpowa@archlinux.org>
# Contributor: Thomas Baechler <thomas@archlinux.org>
# Contributor: Jonathan Chan <jyc@fastmail.fm>
# Contributor: misc <tastky@gmail.com>
# Contributor: NextHendrix <cjones12 at sheffield.ac.uk>

pkgbase=linux-git
_srcname=linux
pkgver=0
pkgrel=1
arch=('x86_64')
url="https://www.kernel.org/"
license=('GPL2')
makedepends=('kmod' 'inetutils' 'bc' 'libelf')
options=('!strip')
source=('git+https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git#tag=v4.17'
        #'git+https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git#tag=vX.X.Y'
  'config'   # the main kernel config file
  '60-linux.hook'  # pacman hook for depmod
  '90-linux.hook'  # pacman hook for initramfs regeneration
  'linux.preset'   # standard config files for mkinitcpio ramdisk
)

sha256sums=('SKIP'
            '0269d9a56f0d0306c9bd5c179a7e32214b0a1c082d3bca581661203b27305f17'
            'ae2e95db94ef7176207c690224169594d49445e04249d2499e9d2fbc117a0b21'
            '75f99f5239e03238f88d1a834c50043ec32b1dc568f2cc291b07d04718483919'
            'ad6344badc91ad0630caacde83f7f9b97276f80d26a20619a87952be65492c65')

_kernelname=${pkgbase#linux}
: ${_kernelname:=-ARCH}

pkgver() {
  cd "${_srcname}"

  git describe --long | sed -E 's/^v//;s/([^-]*-g)/r\1/;s/-/./g;s/\.rc/rc/'
}

prepare() {
  cd ${_srcname}

  cp -Tf ../config .config

  # set localversion to git commit
  sed -i "s|CONFIG_LOCALVERSION=.*|CONFIG_LOCALVERSION=\"${_kernelname}\"|g" ./.config
  sed -i "s|^.*CONFIG_LOCALVERSION_AUTO.*|CONFIG_LOCALVERSION_AUTO=y|" ./.config

  # don't run depmod on 'make install'. We'll do this ourselves in packaging
#  git tracks scripts/depmod.sh so do not change it when using the existing source dir for bisection
#  sed -i '2iexit 0' scripts/depmod.sh

  # get kernel version
  make prepare

  # load configuration
  # Configure the kernel. Replace the line below with one of your choice.
  #make menuconfig # CLI menu for configuration
  #make nconfig # new CLI menu for configuration
  #make xconfig # X-based configuration
  #make oldconfig # using old config from previous kernel version
  make olddefconfig # old config from previous kernel, defaults for new options
  # ... or manually edit .config
}

build() {
  cd ${_srcname}

  make bzImage modules
}

_package() {
  pkgdesc="The Linux kernel and modules (git version)"
  depends=('coreutils' 'linux-firmware' 'kmod' 'mkinitcpio>=0.7')
  optdepends=('crda: to set the correct wireless channels of your country')
  backup=("etc/mkinitcpio.d/${pkgbase}.preset")
  install=linux.install

  cd ${_srcname}

  # get kernel version
  _kernver="$(make kernelrelease)"
  _kernver=${_kernver%-dirty} #https://bbs.archlinux.org/viewtopic.php?id=236702
  _basekernel="$(make kernelversion)"
  _basekernel=${_basekernel%.*}

  mkdir -p "${pkgdir}"/{boot,usr/lib/modules}
  make INSTALL_MOD_PATH="${pkgdir}/usr" modules_install
  cp arch/x86/boot/bzImage "${pkgdir}/boot/vmlinuz-${pkgbase}"

  # make room for external modules
  local _extramodules="extramodules-${_basekernel}${_kernelname}"
  ln -s "../${_extramodules}" "${pkgdir}/usr/lib/modules/${_kernver}/extramodules"

  # add real version for building modules and running depmod from hook
  echo "${_kernver}" |
    install -Dm644 /dev/stdin "${pkgdir}/usr/lib/modules/${_extramodules}/version"

  # remove build and source links
  rm "${pkgdir}"/usr/lib/modules/${_kernver}/{source,build}

  # now we call depmod...
  depmod -b "${pkgdir}/usr" -F System.map "${_kernver}"

  # add vmlinux
  install -Dt "${pkgdir}/usr/lib/modules/${_kernver}/build" -m644 vmlinux

  # sed expression for following substitutions
  local _subst="
    s|%PKGBASE%|${pkgbase}|g
    s|%KERNVER%|${_kernver}|g
    s|%EXTRAMODULES%|${_extramodules}|g
  "

  # hack to allow specifying an initially nonexisting install file
  sed "${_subst}" "${startdir}/${install}" > "${startdir}/${install}.pkg"
  true && install=${install}.pkg

  # install mkinitcpio preset file
  sed "${_subst}" ../linux.preset |
    install -Dm644 /dev/stdin "${pkgdir}/etc/mkinitcpio.d/${pkgbase}.preset"

  # install pacman hooks
  sed "${_subst}" ../60-linux.hook |
    install -Dm644 /dev/stdin "${pkgdir}/usr/share/libalpm/hooks/60-${pkgbase}.hook"
  sed "${_subst}" ../90-linux.hook |
    install -Dm644 /dev/stdin "${pkgdir}/usr/share/libalpm/hooks/90-${pkgbase}.hook"
}

_package-headers() {
  pkgdesc="Header files and scripts for building modules for Linux kernel (git version)"

  cd ${_srcname}
  local _builddir="${pkgdir}/usr/lib/modules/${_kernver}/build"

  install -Dt "${_builddir}" -m644 Makefile .config Module.symvers
  install -Dt "${_builddir}/kernel" -m644 kernel/Makefile

  mkdir "${_builddir}/.tmp_versions"

  cp -t "${_builddir}" -a include scripts

  install -Dt "${_builddir}/arch/x86" -m644 arch/x86/Makefile
  install -Dt "${_builddir}/arch/x86/kernel" -m644 arch/x86/kernel/asm-offsets.s

  cp -t "${_builddir}/arch/x86" -a arch/x86/include

  install -Dt "${_builddir}/drivers/md" -m644 drivers/md/*.h
  install -Dt "${_builddir}/net/mac80211" -m644 net/mac80211/*.h

  # http://bugs.archlinux.org/task/13146
  install -Dt "${_builddir}/drivers/media/i2c" -m644 drivers/media/i2c/msp3400-driver.h

  # http://bugs.archlinux.org/task/20402
  install -Dt "${_builddir}/drivers/media/usb/dvb-usb" -m644 drivers/media/usb/dvb-usb/*.h
  install -Dt "${_builddir}/drivers/media/dvb-frontends" -m644 drivers/media/dvb-frontends/*.h
  install -Dt "${_builddir}/drivers/media/tuners" -m644 drivers/media/tuners/*.h

  # add xfs and shmem for aufs building
  mkdir -p "${_builddir}"/{fs/xfs,mm}

  # copy in Kconfig files
  find . -name Kconfig\* -exec install -Dm644 {} "${_builddir}/{}" \;

  # add objtool for external module building and enabled VALIDATION_STACK option
  install -Dt "${_builddir}/tools/objtool" tools/objtool/objtool

  # remove unneeded architectures
  local _arch
  for _arch in "${_builddir}"/arch/*/; do
    [[ ${_arch} == */x86/ ]] && continue
    rm -r "${_arch}"
  done

  # remove files already in linux-docs package
  rm -r "${_builddir}/Documentation"

  # remove now broken symlinks
  find -L "${_builddir}" -type l -printf 'Removing %P\n' -delete

  # Fix permissions
  chmod -R u=rwX,go=rX "${_builddir}"

  # strip scripts directory
  local _binary _strip
  while read -rd '' _binary; do
    case "$(file -bi "${_binary}")" in
      *application/x-sharedlib*)  _strip="${STRIP_SHARED}"   ;; # Libraries (.so)
      *application/x-archive*)    _strip="${STRIP_STATIC}"   ;; # Libraries (.a)
      *application/x-executable*) _strip="${STRIP_BINARIES}" ;; # Binaries
      *) continue ;;
    esac
    /usr/bin/strip ${_strip} "${_binary}"
  done < <(find "${_builddir}/scripts" -type f -perm -u+w -print0 2>/dev/null)
}

_package-docs() {
  pkgdesc="Kernel hackers manual - HTML documentation that comes with the Linux kernel (git version)"

  cd ${_srcname}
  local _builddir="${pkgdir}/usr/lib/modules/${_kernver}/build"

  mkdir -p "${_builddir}"
  cp -t "${_builddir}" -a Documentation

  # Fix permissions
  chmod -R u=rwX,go=rX "${_builddir}"
}

pkgname=("${pkgbase}" "${pkgbase}-headers" "${pkgbase}-docs")
for _p in ${pkgname[@]}; do
  eval "package_${_p}() {
    $(declare -f "_package${_p#${pkgbase}}")
    _package${_p#${pkgbase}}
  }"
done

# vim:set ts=8 sts=2 sw=2 et:

Edit2:
fix up instructions

Last edited by loqs (2018-10-17 12:31:23)

heisenberg

Member

Registered: 2017-05-27

Posts: 87

Re: [SOLVED] HDMI Issues with kernel 4.18

Please check linux-4.18.1.arch1-1 is affected if you do not have the package in the systems pacman cache you can obtain it from Arch_Linux_Archive.

I tested all the the 4.18 packages between 1-8 included, with the following results:
- since 4.18.1, the hdmi output says "12 bit". With 4.17.14 it says nothing, so I guess it's 16 bit, but I am not sure, how can I check ?
- the situation is the same. Since 4.18.8 there's no video output !!

Anyway, your instructions are not clear to me, sorry.. I am doing a "comparision" between 4.17.1 and which one? (anyway is the opposite of what you said in comments: 4.17 does NOT have the issue, 4.18 does, in particular 4.18.8... not sure if the "12 bit thing" is to be considered as an issue at this point)

EDIT: Following your instructions, building 4.17...

EDIT2: Ran it (linux-git 4.17.0), hdmi works but is really buggy. The background is cut and made up by "squares" (the image is not scaled correctly), also moving a window around draws the animation and it remains on the screen. Sorry for the bad english. Should I go forward with instructions ?

Last edited by heisenberg (2018-10-17 16:16:39)

loqs

Member

Registered: 2014-03-06

Posts: 17,369

Re: [SOLVED] HDMI Issues with kernel 4.18

No I was expecting linux-git 4.17.0 to be good,  If you try the 4.17.1 package from the archive is that good?

heisenberg

Member

Registered: 2017-05-27

Posts: 87

Re: [SOLVED] HDMI Issues with kernel 4.18

No I was expecting linux-git 4.17.0 to be good,  If you try the 4.17.1 package from the archive is that good?

Nope, same as 4.17.0.

Wouldn't be easier to compare 4.17.14 with 4.18.1 or 4.18.8 ??

loqs

Member

Registered: 2014-03-06

Posts: 17,369

Re: [SOLVED] HDMI Issues with kernel 4.18

The problem with that is 4.17.14 comes from a different branch of the tree than 4.18.8.  I am less confident in git bisect working.  Which is the first 4.17 release that works?

heisenberg

Member

Registered: 2017-05-27

Posts: 87

Re: [SOLVED] HDMI Issues with kernel 4.18

The problem with that is 4.17.14 comes from a different branch of the tree than 4.18.8.  I am less confident in git bisect working.  Which is the first 4.17 release that works?

Damn, the latest issue wrote is not kernel related, because now its buggy on 4.17.14 as well !
edit -> Solved !! I am surprised, but the cause of the latest buggy behavior was that command that I used to hide MATE's desktop icons:

gsettings set org.mate.background show-desktop-icons false

So should I proceed with bisecting as you said before ? I am really sorry for the inconvenience.

Last edited by heisenberg (2018-10-17 19:29:26)

loqs

Member

Registered: 2014-03-06

Posts: 17,369

Re: [SOLVED] HDMI Issues with kernel 4.18

You could check /var/log/pacman.log and downgrade downgrading every package apart from the kernel that was updated in the last day?
If you can not find a good configuration then all that could be checked would be if the output shows 12 bit or not?

Last edited by loqs (2018-10-17 19:26:28)

heisenberg

Member

Registered: 2017-05-27

Posts: 87

Re: [SOLVED] HDMI Issues with kernel 4.18

You could check /var/log/pacman.log and downgrade downgrading every package apart from the kernel that was updated in the last day?
If you can not find a good configuration then all that could be checked would be if the output shows 12 bit or not?

How can I check output's bits from the system ? Using xrandr ?

Anyway, I am really sorry, I edited the previous post. Should I proceed with bisect as you said before ?

Last edited by heisenberg (2018-10-17 19:32:22)

loqs

Member

Registered: 2014-03-06

Posts: 17,369

Re: [SOLVED] HDMI Issues with kernel 4.18

If linux-git 4.17.0 is good now yes proceed with the bisection.

heisenberg

Member

Registered: 2017-05-27

Posts: 87

Re: [SOLVED] HDMI Issues with kernel 4.18

If linux-git 4.17.0 is good now yes proceed with the bisection.

I don't know, it takes a few hours on this hardware to build, and I have to do it from scratch (yeah, I did also edit makepkg.conf as you suggested earlier)
Tomorrow I'll be busy, so I'll edit this post most likely Friday (hopefully in the morning). Keep an eye on it please

Last edited by heisenberg (2018-10-17 19:41:33)

loqs

Member

Registered: 2014-03-06

Posts: 17,369

Re: [SOLVED] HDMI Issues with kernel 4.18

The linux-git directory will contain the 4.17.0 packages you built before.  You can reinstall them with `pacman -U` although they do not actually conflict with linux / linux-lts so you can have both installed at once.

heisenberg

Member

Registered: 2017-05-27

Posts: 87

Re: [SOLVED] HDMI Issues with kernel 4.18

The linux-git directory will contain the 4.17.0 packages you built before.  You can reinstall them with `pacman -U` although they do not actually conflict with linux / linux-lts so you can have both installed at once.

They do not conflict, as they're named "linux-git". The problem is that I already removed that directory, so I have to start from scratch (yeah, I'm stupid!)

heisenberg

Member

Registered: 2017-05-27

Posts: 87

Re: [SOLVED] HDMI Issues with kernel 4.18

I did follow your instructions, and I am about to start the bisection (will do it in the next days):

Bisecting: 7032 revisions left to test after this (roughly 13 steps)
[3036bc45364f98515a2c446d7fac2c34dcfbeff4] Merge tag 'media/v4.18-2' of git://git.kernel.org/pub/scm/linux/kernel/git/mchehab/linux-media

First question, I may have to rebuild the kernel 13 times ? Because to do so, I need at least one month considering the hours that it takes on my machine and my free time.

Second question: between the versions that we are comparing, the difference is that 12 bit warn... but I have to admit that the output looks really similar to my eyes, so I was thinking: Could it be that the difference is just that this warn for some reason, does not appear on the second monitor on 4.17, but it's 12bit anyway ?! I'd like to check that, before investing all that time on bisecting.

Third and last question, since the video output stops working on 4.18.8, I will have to bisect (also) between 4.18.7 and 4.18.8 ?? ;(

loqs

Member

Registered: 2014-03-06

Posts: 17,369

Re: [SOLVED] HDMI Issues with kernel 4.18

First question, I may have to rebuild the kernel 13 times ? Because to do so, I need at least one month considering the hours that it takes on my machine and my free time.

Yes at least 13 times although as the change set becomes smaller the amount the rebuild time should reduce.

Second question: between the versions that we are comparing, the difference is that 12 bit warn... but I have to admit that the output looks really similar to my eyes, so I was thinking: Could it be that the difference is just that this warn for some reason, does not appear on the second monitor on 4.17, but it's 12bit anyway ?! I'd like to check that, before investing all that time on bisecting.

I do not know what is generating the warning so I do not know.

Third and last question, since the video output stops working on 4.18.8, I will have to bisect (also) between 4.18.7 and 4.18.8 ?? ;(

Yes if that is a separate issue and it appears likely due to the different  symptoms.  However if you just concentrated on bisecting that issue it should be much faster.

heisenberg

Member

Registered: 2017-05-27

Posts: 87

Re: [SOLVED] HDMI Issues with kernel 4.18

Yes at least 13 times although as the change set becomes smaller the amount the rebuild time should reduce.

I was thinking maximum 13 times
Every build should be tested (even the first 13 builds right?), and when I see the issue it's gone, then "bisect good" and it's over ?!

I do not know what is generating the warning so I do not know.

There's no way to check it on linux ? I'd like to know if the warning it's wrong, and also on 4.17 (without warning) the output's bits, is it 12 ? 16 ? 24 ? 32 ?

Yes if that is a separate issue and it appears likely due to the different  symptoms.  However if you just concentrated on bisecting that issue it should be much faster.

I am doing so, but as I said it takes a lot of time to build and some days I simply have no free time to spend resolving that issue. If you're patient enough, I am pretty sure we'll find out though. Prepare the instructions to bisect between 4.18.7 and 4.18.8 then !

edit

Bisecting: 3348 revisions left to test after this (roughly 12 steps)
[721afaa2aeb860067decdddadc84ed16f42f2048] Merge tag 'armsoc-dt' of git://git.kernel.org/pub/scm/linux/kernel/git/arm/arm-soc

That's the output after bisect good. I guess I should keep going for 12 more times, and the last one it will say which one is the bad commit, right ?

Last edited by heisenberg (2018-10-20 07:58:17)

heisenberg

Member

Registered: 2017-05-27

Posts: 87

Re: [SOLVED] HDMI Issues with kernel 4.18

e03fd3f300f6184c1264186a4c815e93bf658abb is the first bad commit
commit e03fd3f300f6184c1264186a4c815e93bf658abb
Author: Mikita Lipski <mikita.lipski@amd.com>
Date:   Wed May 16 16:46:18 2018 -0400

    drm/amd/display: Do not limit color depth to 8bpc
    
    Delete if statement that would force any display's color depth higher
    than 8 bpc to 8
    
    Signed-off-by: Mikita Lipski <mikita.lipski@amd.com>
    Reviewed-by: Harry Wentland <Harry.Wentland@amd.com>
    Signed-off-by: Alex Deucher <alexander.deucher@amd.com>

:040000 040000 57c7a743a10059addbfdd1a122f90c4053d377fa 13139317e62ef56db1748bf48f31f81eb986c7f8 M      drivers

loqs

Member

Registered: 2014-03-06

Posts: 17,369

Re: [SOLVED] HDMI Issues with kernel 4.18

The output look better when the display depth is limited to 8bpc seems to be the result of the bisection.