You are not logged in.

#1 2023-07-18 23:34:59

physfizz
Member
Registered: 2014-01-07
Posts: 8

[Solved] julia packages can't find curl

I'm trying to instantiate a project environment in Julia, but some required packages do not successfully precompile because Julia can't find curl. Here's an example:

ERROR: LoadError: InitError: could not load library "~/.julia/artifacts/b0cf4509cab69941ff82be108f901e4fa3dcbdad/lib/libhdf5.so"
/usr/bin/../lib/julia/libcurl.so: version `CURL_4' not found (required by ~/.julia/artifacts/b0cf4509cab69941ff82be108f901e4fa3dcbdad/lib/libhdf5.so)
Stacktrace:
 [1] macro expansion
   @ ~/.julia/packages/JLLWrappers/QpMQW/src/products/library_generators.jl:54 [inlined]
 [2] __init__()
   @ HDF5_jll ~/.julia/packages/HDF5_jll/vTrKi/src/wrappers/x86_64-linux-gnu-libgfortran5-cxx11-mpi+mpich.jl:15
 [3] include(x::String)
   @ HDF5.API ~/.julia/packages/HDF5/aiZLs/src/api/api.jl:1
 [4] top-level scope
   @ ~/.julia/packages/HDF5/aiZLs/src/api/api.jl:8
 [5] include(x::String)
   @ HDF5 ~/.julia/packages/HDF5/aiZLs/src/HDF5.jl:1
 [6] top-level scope
   @ ~/.julia/packages/HDF5/aiZLs/src/HDF5.jl:67
 [7] top-level scope
   @ stdin:3
during initialization of module HDF5_jll
in expression starting at ~/.julia/packages/HDF5/aiZLs/deps/deps.jl:3
in expression starting at ~/.julia/packages/HDF5/aiZLs/src/api/api.jl:1
in expression starting at ~/.julia/packages/HDF5/aiZLs/src/HDF5.jl:1
in expression starting at stdin:3

It appears to be linked correctly, though:

/usr/lib/julia/libcurl.so -> /usr/lib/libcurl.so.4*

Any ideas?

Last edited by physfizz (2023-07-23 00:04:28)

Offline

#2 2023-07-19 06:21:33

seth
Member
Registered: 2012-09-03
Posts: 66,079

Re: [Solved] julia packages can't find curl

Is that supposed to be a symlink?

pacman -Qikk julia

https://archlinux.org/packages/core/x86_64/curl/ is versioned "CURL_OPENSSL_4", so looking for CURL_4 is gonna fail.
There's a bunch of untagged versions (compat/gnutls) but that's probably not gonna help either.

What is ~/.julia/artifacts/b0cf4509cab69941ff82be108f901e4fa3dcbdad/lib/libhdf5.so ?
Copy of or symlink to /usr/lib/libhdf5.so ?

ldd ~/.julia/artifacts/b0cf4509cab69941ff82be108f901e4fa3dcbdad/lib/libhdf5.so
pacman -Qs hdf5

Offline

#3 2023-07-19 20:16:35

physfizz
Member
Registered: 2014-01-07
Posts: 8

Re: [Solved] julia packages can't find curl

I'm not sure whether that is supposed to be a symlink. Running

 pacman -Qikk julia 

I get

 julia: 2444 total files, 0 altered files 
seth wrote:

What is ~/.julia/artifacts/b0cf4509cab69941ff82be108f901e4fa3dcbdad/lib/libhdf5.so ?
Copy of or symlink to /usr/lib/libhdf5.so ?

It's a link to a file in the same directory:

~/.julia/artifacts/b0cf4509cab69941ff82be108f901e4fa3dcbdad/lib/libhdf5.so -> libhdf5.so.310.0.0*
seth wrote:

https://archlinux.org/packages/core/x86_64/curl/ is versioned "CURL_OPENSSL_4", so looking for CURL_4 is gonna fail.

I wondered whether something like this might be the case. I saw that some people had this issue with Julia elsewhere, but it seemed to be the result of building their own version of Julia (https://discourse.julialang.org/t/linux … or/90487/8). Could it be that Julia built for Arch should look for "CURL_OPENSSL_4" instead?

Last edited by physfizz (2023-07-19 21:01:05)

Offline

#4 2023-07-19 21:18:49

seth
Member
Registered: 2012-09-03
Posts: 66,079

Re: [Solved] julia packages can't find curl

seth wrote:
pacman -Qs hdf5

https://archlinux.org/packages/extra/x86_64/hdf5/ has /usr/lib/libhdf5.so.310.1.0

I know nothing about julia, but there seems to be some dated local copy in your $HOME, either from an older hdf5 version or from god knows where.
You could try to redirect the symlink to the system library, but I'd have to lookup myself what those artifacts are and why there're apparently library copies in those.

Offline

#5 2023-07-20 08:21:25

Lone_Wolf
Administrator
From: Netherlands, Europe
Registered: 2005-10-04
Posts: 13,973

Re: [Solved] julia packages can't find curl

You have read https://wiki.archlinux.org/title/Julia , especailly the 2nd colored box ?


Disliking systemd intensely, but not satisfied with alternatives so focusing on taming systemd.

clean chroot building not flexible enough ?
Try clean chroot manager by graysky

Offline

#6 2023-07-20 19:35:19

physfizz
Member
Registered: 2014-01-07
Posts: 8

Re: [Solved] julia packages can't find curl

Lone_Wolf wrote:

You have read https://wiki.archlinux.org/title/Julia , especailly the 2nd colored box ?

:0

That fixed it. Sorry. Should have read the wiki and installed https://aur.archlinux.org/packages/julia-bin instead

Offline

#7 2023-07-21 09:19:12

Lone_Wolf
Administrator
From: Netherlands, Europe
Registered: 2005-10-04
Posts: 13,973

Re: [Solved] julia packages can't find curl

Glad you found a way to get things to work, please prepend [Solved] to the thread title (edit first post)


Disliking systemd intensely, but not satisfied with alternatives so focusing on taming systemd.

clean chroot building not flexible enough ?
Try clean chroot manager by graysky

Offline

Board footer

Powered by FluxBB