Python application packaging best practice

mnot · 2023-01-27 00:42:47

I've noticed that Python-based applications (i.e., things called from shell that happen to be implemented in Python) are often packaged in such a way that they write into the global Python site-packages. For example:

- certbot
- ansible
- ansible-lint

... and I suspect many more.

Installing these in their own, isolated virtual environments (e.g., using pipx) seems like it would be better practice, assuring that conflicts with other requirements could be avoided.

Has this been discussed before?

Lone_Wolf · 2023-01-27 11:25:59

Yup, many times.
Usually triggered by conflicts between pacman-maintained stuff & maintained-by-other-package-manager stuff .

The consensus is that archlinux packages are intended to be used systemwide and should use systemwide folders .
Isolated virtual environments are great for users and should be maintained by users .

https://wiki.archlinux.org/title/Python … management and https://wiki.archlinux.org/title/Python … guidelines should help to give more insight.

Last edited by Lone_Wolf (2023-01-27 11:26:28)

mnot · 2023-01-30 00:02:57

Thx.

I suspect one day a conflict between different pacman-maintained packages will surface, but *shrug*.

Cheers,

Trilby · 2023-01-30 01:18:59

How could pacman-maintained packages conflict? The path includes the package name.

mnot · 2023-01-30 03:09:39

If all dependencies are installed through pacman, they won't. Never mind -- this makes sense to me now. Still not a _huge_ fan of having pacman-managed Python packages installed into the system site_packages; it's difficult to distinguish them from packages that were installed by pip.

Scimmia · 2023-01-30 03:16:10

Unless you only use pip for user installed packages.

mnot · 2023-01-30 03:20:17

Sure -- but that's something people have to learn (and then implement with eg PIP_REQUIRE_VIRTUALENV=true). Until then, this is a bit of a footgun just lying around.

Scimmia · 2023-01-30 03:36:06

AFAIK, pip defaults to user installs now, unless you override it.

Trilby · 2023-01-30 04:00:45

Nothing about those concerns are in any way specific to python.

If one installs *any* software as root / system-wide bypassing pacman they're prone to run into conflicts.

The concern should not be with packaged files being placed in the system-wide site-packages directory, but only unpackaged files being placed there.

Last edited by Trilby (2023-01-30 04:01:07)

Arch Linux

#1 2023-01-27 00:42:47

Python application packaging best practice

#2 2023-01-27 11:25:59

Re: Python application packaging best practice

#3 2023-01-30 00:02:57

Re: Python application packaging best practice

#4 2023-01-30 01:18:59

Re: Python application packaging best practice

#5 2023-01-30 03:09:39

Re: Python application packaging best practice

#6 2023-01-30 03:16:10

Re: Python application packaging best practice

#7 2023-01-30 03:20:17

Re: Python application packaging best practice

#8 2023-01-30 03:36:06

Re: Python application packaging best practice

#9 2023-01-30 04:00:45

Re: Python application packaging best practice

Board footer