"Python2 & 3 major rebuild" upgrade - impressions ?

flamelab · 2010-10-18 23:12:03

Has anybody done the major python upgrade ? My mirror hasn't synced yet

combuster · 2010-10-18 23:14:47

Well I have testing enabled and there were no issues. Moving it to extra didn't have an impact for me.

Everything from the repos works just fine. Some AUR packages needs updating though...

Dogmeat · 2010-10-18 23:25:06

I have testing enabled as well as combuster and everything works fine thanks to Arch devs. I had some issues with PKGBUILDs from AUR but they were easily fixable.

firecat53 · 2010-10-18 23:37:42

Mysql-python isn't compatible with python 3. It installs fine, but I get errors on trying to run scripts that use it. Should I file a bug report, or will this forum work?

Python 3.1.2 (r312:79147, Oct  4 2010, 12:45:09) 
[GCC 4.5.1] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> import MySQLdb as dbapi
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ImportError: No module named MySQLdb

Thanks!
Scott

(Everything else from the repos works fine so far)

Last edited by firecat53 (2010-10-18 23:38:31)

Dogmeat · 2010-10-18 23:39:14

firecat53 wrote:

Should I file a bug report, or will this forum work?

If you are sure it is a bug then file a bug report.

News: Python is now Python 3 states "All our packages have been updated accordingly, but any remaining issues found can be reported to the bug tracker (not the forums or mailing lists)."

Last edited by Dogmeat (2010-10-18 23:42:28)

wonder · 2010-10-18 23:40:11

@firecat53 you are doing it wrong!

run python2 not python. you have to adjust all your scripts to point to /usr/bin/python2

Last edited by wonder (2010-10-18 23:41:17)

firecat53 · 2010-10-18 23:49:02

@wonder -- heh, my updating was one step ahead of the mirror....NOW python2 is installed

Scott

edit: All fixed and functional. I think I posted a wee bit early

Last edited by firecat53 (2010-10-19 00:16:45)

toofishes · 2010-10-18 23:52:38

firecat53 wrote:

Mysql-python isn't compatible with python 3. It installs fine, but I get errors on trying to run scripts that use it. Should I file a bug report, or will this forum work?
Python 3.1.2 (r312:79147, Oct  4 2010, 12:45:09) 
[GCC 4.5.1] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> import MySQLdb as dbapi
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ImportError: No module named MySQLdb
Thanks!
Scott
(Everything else from the repos works fine so far)

Most modules are not built for python3 just yet, but still work with python2. That is a whole different issue that you will slowly start to see take shape in the coming months once more modules are available for python 3 and we carry both of them in our repos.

Tempel · 2010-10-19 01:34:56

For me, the transition's gone smoothly with the exception of the AUR packages I maintain. Are there any agreed-upon conventions I should be following? Namely:

1) For modules that only work with python2, should they be renamed to "python2-module"? This is my problem with python-objgraph and python-ftdi.

2) For modules that can work in both, should they be installed to both? For example, python-pylibftdi works unmodified in both python2 and python3, and many other modules will likely work if the 2to3 tool is used on them during install. So should these be installed for one or both versions, and should there be any special naming for either approach?

Last edited by Tempel (2010-10-19 01:59:48)

cschep · 2010-10-19 02:00:21

It's a bit confusing that pip seems to install to python2, yet it's not called python2-pip, it's still python-pip.. Also, is there a way to install pip for python3? which is now my default python.. hmm.

I'm sure this will be addressed as part of the transition. Seems painful, so good job arch devs to get on top of this.

Allan · 2010-10-19 02:02:23

The idea is that naming will eventually transform to "python-foo" being for python-3.x and "python2-foo" being for python2. However, that is not fully realised yet and would require a lot of renaming if we did it all at once so we are going to transition that slowly.

moose jaw · 2010-10-19 03:18:49

Everything has been beautifully smooth here: thanks devs! A nice side benefit is that rdiff-backup runs noticeably faster with the update to python 2.7 on my source and target machines.

Meyithi · 2010-10-19 03:36:03

Everything went fine here - with the added bonus of Weechat being patched for that ruby plugin error

LeafStorm · 2010-10-19 03:51:13

As a Python developer, I'm not sure going to Python 3000 is a smart idea now. In theory, it would work great if you used pacman to install your Python packages. But I don't - I just use pacman for any packages I want installed system-wide. Which isn't many of them:

$ pacman -Qs python
local/gnome-python-desktop 2.32.0-1
    Python bindings for the GNOME desktop environment
local/python 2.6.5-3
    A high-level scripting language
local/python-brasero 2.32.0-1
    Python bindings for brasero
local/python-bugbuddy 2.32.0-1
    Python module for bug-buddy
local/python-evince 2.32.0-1
    Python bindings for evince
local/python-evolution 2.32.0-1
    Python bindings for evolution
local/python-gnomeapplet 2.32.0-1
    Python bindings for gnome-panel
local/python-gnomedesktop 2.32.0-1
    Python bindings for gnome-desktop
local/python-gnomekeyring 2.32.0-1
    Python bindings for libgnome-keyring
local/python-gnomeprint 2.32.0-1
    Python bindings for libgnomeprintui
local/python-gtksourceview 2.32.0-1
    Python bindings for gtksourceview
local/python-gtop 2.32.0-1
    Python bindings for libgtop
local/python-mediaprofiles 2.32.0-1
    Python bindings for gnome-media
local/python-metacity 2.32.0-1
    Python bindings for metacity
local/python-notify 0.1.1-6
    Python bindings for libnotify
local/python-pip 0.8.1-1
    An easy_install replacement for installing pypi python packages
local/python-pycurl 7.19.0-4
    A Python interface to libcurl
local/python-pysqlite 2.6.0-1
    A Python DB-API 2.0 interface for the SQLite embedded relational database
    engine
local/python-rsvg 2.32.0-1
    Python bindings for librsvg
local/python-totem-plparser 2.32.0-1
    Python bindings for totem-plparser
local/python-urwid 0.9.9.1-1
    Urwid is a curses-based user interface library.
local/python-virtualenv 1.5.1-1
    Virtual Python Environment builder
local/python-wnck 2.32.0-1
    Python bindings for libwnck

These pretty much fall into (a) dependencies of software written in Python like wicd, (b) hard-to-find and hard-to-build packages like GTK, and (c) virtualenv and pip, my two development tools. Everything else, I either "pip install" into my home directory, or create a virtualenv for each project and install the packages to the virtualenv. This is the most popular way to develop now, because it ensures that you have the latest versions of each package, that you don't need to install everything as root, and that the packages won't conflict with each other.

So, before I run the upgrade, I need to know: how will this affect Python packages not installed with pacman, especially those in virtualenvs? What will I need to install to make sure those keep working? Will having Python 2.7 affect things even more? What about pip, virtualenv, and setuptools?

(Optional rant:) Also, I am kind of wondering what in space the Arch devs were thinking upgrading to Python 3000 this soon. There are a lot of important packages (like Django and SQLAlchemy) that do not support Python 3 yet, the questions of WSGI and package distribution are not sorted out, and no one else is even considering a move like this. This has the potential to make a lot of people's lives a gigantic pain.

Allan · 2010-10-19 04:20:27

Python packages not installed with pacman probably need reinstalled given the update to python2.7. python2 will not look in /usr/lib/python-2.6/site-packages as that would be stupid...

As far as virtualenv goes "virtualenv --python=python2 ...". Easy.

(Optional rant response - nice version:) If is not as if you do not have a python2.x install. If you can not handle /usr/bin/python point to python-3.x and /usr/bin/python2 being python-2.7, then you are not a very good python developer.

anthonyclark · 2010-10-19 04:36:38

I'm not having installation issues .... but some apps aren't playing to nicely with this whole upgrade. Take 'gedit' for example ... the 'gedit-plugins' package is now broken .... and I'm not sure what todo to fix it. Bleeding edge in this case is causing frustration and pain. lol. Good idea on the adoption though. Hope it works out!

foutrelis · 2010-10-19 04:39:57

The upgrade went better than expected! Only issue I came across is gEdit's Python plugins which are broken at the moment as gEdit itself needs a rebuild. Other than that, everything works great.

Allan wrote:

As far as virtualenv goes "virtualenv --python=python2 ...". Easy.

That is not necessary; it'll use python2 by default. However, I couldn't figure out how to migrate my old environments, so I just recreated them.

Edit:

anthonyclark wrote:

Take 'gedit' for example ... the 'gedit-plugins' package is now broken .... and I'm not sure what todo to fix it.

Hehe, see the beginning of this message.

Last edited by foutrelis (2010-10-19 04:42:18)

cb474 · 2010-10-19 05:20:53

As an end user, with zero knowledge of coding, developing, etc., if I run into problems with an AUR package (or any other package for that matter), how will I:

1) Know that the problem is caused by the upgrade to Python 3?

2) Fix the problem?

Thanks.

cb474 · 2010-10-19 05:22:20

P.S. What AUR packages have people had to upgrade things with?

.:B:. · 2010-10-19 06:30:29

For AUR packages, a rebuild and making the shebang of the executable script point to python2 should suffice. And python2 instead of python instead of the depends of course .

Edit: cb474, please edit your posts instead of just stacking them .

djgera · 2010-10-19 06:31:12

Works good, thanks to all

There is only small detail:

.noitamrofni erom rof "esnecil" ro "stiderc" ,"thgirypoc" ,"pleh" epyT
2xunil no ]1.5.4 CCG[
 )90:54:21 ,0102 4  tcO ,74197:213r( 2.1.3 nohtyP

mikesd · 2010-10-19 06:58:27

Yes, thanks to all devs and TUs involved in the rebuild. Massive effort.

bones · 2010-10-19 07:11:31

Good work guys. Everything working perfect this end

broch · 2010-10-19 14:49:09

broken firefox in abs. Complaining about syntax (.py file).

/usr/bin/python ../toolkit/xre/make-platformini.py --print-buildid > buildid
File "../toolkit/xre/make-platformini.py", line 17
print datetime.now().strftime('%Y%m%d%H%M%S')
^
SyntaxError: invalid syntax
make[4]: *** [export] Error 1

jiyunatori · 2010-10-19 15:00:43

the update broke python-matplotlib for me. With python3 it can't find the module (I guess it's normal), but with python2 (2.7) it fails when I try to display something.

From the last line of the following log, it seems pylab is trying to get something from a python2.6 folder rather than python2.7. Any clue to solve this ?

Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/matplotlib/backends/backend_gtk.py", line 393, in expose_event
    self._render_figure(self._pixmap, w, h)
  File "/usr/lib/python2.7/site-packages/matplotlib/backends/backend_gtkagg.py", line 75, in _render_figure
    FigureCanvasAgg.draw(self)
  File "/usr/lib/python2.7/site-packages/matplotlib/backends/backend_agg.py", line 394, in draw
    self.figure.draw(self.renderer)
  File "/usr/lib/python2.7/site-packages/matplotlib/artist.py", line 55, in draw_wrapper
    draw(artist, renderer, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/matplotlib/figure.py", line 798, in draw
    func(*args)
  File "/usr/lib/python2.7/site-packages/matplotlib/artist.py", line 55, in draw_wrapper
    draw(artist, renderer, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/matplotlib/axes.py", line 1934, in draw
    a.draw(renderer)
  File "/usr/lib/python2.7/site-packages/matplotlib/artist.py", line 55, in draw_wrapper
    draw(artist, renderer, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/matplotlib/axis.py", line 1017, in draw
    tick.draw(renderer)
  File "/usr/lib/python2.7/site-packages/matplotlib/artist.py", line 55, in draw_wrapper
    draw(artist, renderer, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/matplotlib/axis.py", line 234, in draw
    self.label1.draw(renderer)
  File "/usr/lib/python2.7/site-packages/matplotlib/artist.py", line 55, in draw_wrapper
    draw(artist, renderer, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/matplotlib/text.py", line 524, in draw
    bbox, info = self._get_layout(renderer)
  File "/usr/lib/python2.7/site-packages/matplotlib/text.py", line 298, in _get_layout
    ismath=False)
  File "/usr/lib/python2.7/site-packages/matplotlib/backends/backend_agg.py", line 180, in get_text_width_height_descent
    font = self._get_agg_font(prop)
  File "/usr/lib/python2.7/site-packages/matplotlib/backends/backend_agg.py", line 221, in _get_agg_font
    font = FT2Font(str(fname))
RuntimeError: Could not open facefile /usr/lib/python2.6/site-packages/matplotlib/mpl-data/fonts/ttf/Vera.ttf; Cannot_Open_Resource

Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/matplotlib/backends/backend_gtk.py", line 393, in expose_event
    self._render_figure(self._pixmap, w, h)
  File "/usr/lib/python2.7/site-packages/matplotlib/backends/backend_gtkagg.py", line 75, in _render_figure
    FigureCanvasAgg.draw(self)
  File "/usr/lib/python2.7/site-packages/matplotlib/backends/backend_agg.py", line 394, in draw
    self.figure.draw(self.renderer)
  File "/usr/lib/python2.7/site-packages/matplotlib/artist.py", line 55, in draw_wrapper
    draw(artist, renderer, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/matplotlib/figure.py", line 798, in draw
    func(*args)
  File "/usr/lib/python2.7/site-packages/matplotlib/artist.py", line 55, in draw_wrapper
    draw(artist, renderer, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/matplotlib/axes.py", line 1934, in draw
    a.draw(renderer)
  File "/usr/lib/python2.7/site-packages/matplotlib/artist.py", line 55, in draw_wrapper
    draw(artist, renderer, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/matplotlib/axis.py", line 1017, in draw
    tick.draw(renderer)
  File "/usr/lib/python2.7/site-packages/matplotlib/artist.py", line 55, in draw_wrapper
    draw(artist, renderer, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/matplotlib/axis.py", line 234, in draw
    self.label1.draw(renderer)
  File "/usr/lib/python2.7/site-packages/matplotlib/artist.py", line 55, in draw_wrapper
    draw(artist, renderer, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/matplotlib/text.py", line 524, in draw
    bbox, info = self._get_layout(renderer)
  File "/usr/lib/python2.7/site-packages/matplotlib/text.py", line 298, in _get_layout
    ismath=False)
  File "/usr/lib/python2.7/site-packages/matplotlib/backends/backend_agg.py", line 180, in get_text_width_height_descent
    font = self._get_agg_font(prop)
  File "/usr/lib/python2.7/site-packages/matplotlib/backends/backend_agg.py", line 221, in _get_agg_font
    font = FT2Font(str(fname))
RuntimeError: Could not open facefile /usr/lib/python2.6/site-packages/matplotlib/mpl-data/fonts/ttf/Vera.ttf; Cannot_Open_Resource

Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/matplotlib/backends/backend_gtk.py", line 393, in expose_event
    self._render_figure(self._pixmap, w, h)
  File "/usr/lib/python2.7/site-packages/matplotlib/backends/backend_gtkagg.py", line 75, in _render_figure
    FigureCanvasAgg.draw(self)
  File "/usr/lib/python2.7/site-packages/matplotlib/backends/backend_agg.py", line 394, in draw
    self.figure.draw(self.renderer)
  File "/usr/lib/python2.7/site-packages/matplotlib/artist.py", line 55, in draw_wrapper
    draw(artist, renderer, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/matplotlib/figure.py", line 798, in draw
    func(*args)
  File "/usr/lib/python2.7/site-packages/matplotlib/artist.py", line 55, in draw_wrapper
    draw(artist, renderer, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/matplotlib/axes.py", line 1934, in draw
    a.draw(renderer)
  File "/usr/lib/python2.7/site-packages/matplotlib/artist.py", line 55, in draw_wrapper
    draw(artist, renderer, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/matplotlib/axis.py", line 1017, in draw
    tick.draw(renderer)
  File "/usr/lib/python2.7/site-packages/matplotlib/artist.py", line 55, in draw_wrapper
    draw(artist, renderer, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/matplotlib/axis.py", line 234, in draw
    self.label1.draw(renderer)
  File "/usr/lib/python2.7/site-packages/matplotlib/artist.py", line 55, in draw_wrapper
    draw(artist, renderer, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/matplotlib/text.py", line 524, in draw
    bbox, info = self._get_layout(renderer)
  File "/usr/lib/python2.7/site-packages/matplotlib/text.py", line 298, in _get_layout
    ismath=False)
  File "/usr/lib/python2.7/site-packages/matplotlib/backends/backend_agg.py", line 180, in get_text_width_height_descent
    font = self._get_agg_font(prop)
  File "/usr/lib/python2.7/site-packages/matplotlib/backends/backend_agg.py", line 221, in _get_agg_font
    font = FT2Font(str(fname))
RuntimeError: Could not open facefile /usr/lib/python2.6/site-packages/matplotlib/mpl-data/fonts/ttf/Vera.ttf; Cannot_Open_Resource

Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/matplotlib/backends/backend_gtk.py", line 393, in expose_event
    self._render_figure(self._pixmap, w, h)
  File "/usr/lib/python2.7/site-packages/matplotlib/backends/backend_gtkagg.py", line 75, in _render_figure
    FigureCanvasAgg.draw(self)
  File "/usr/lib/python2.7/site-packages/matplotlib/backends/backend_agg.py", line 394, in draw
    self.figure.draw(self.renderer)
  File "/usr/lib/python2.7/site-packages/matplotlib/artist.py", line 55, in draw_wrapper
    draw(artist, renderer, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/matplotlib/figure.py", line 798, in draw
    func(*args)
  File "/usr/lib/python2.7/site-packages/matplotlib/artist.py", line 55, in draw_wrapper
    draw(artist, renderer, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/matplotlib/axes.py", line 1934, in draw
    a.draw(renderer)
  File "/usr/lib/python2.7/site-packages/matplotlib/artist.py", line 55, in draw_wrapper
    draw(artist, renderer, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/matplotlib/axis.py", line 1017, in draw
    tick.draw(renderer)
  File "/usr/lib/python2.7/site-packages/matplotlib/artist.py", line 55, in draw_wrapper
    draw(artist, renderer, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/matplotlib/axis.py", line 234, in draw
    self.label1.draw(renderer)
  File "/usr/lib/python2.7/site-packages/matplotlib/artist.py", line 55, in draw_wrapper
    draw(artist, renderer, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/matplotlib/text.py", line 524, in draw
    bbox, info = self._get_layout(renderer)
  File "/usr/lib/python2.7/site-packages/matplotlib/text.py", line 298, in _get_layout
    ismath=False)
  File "/usr/lib/python2.7/site-packages/matplotlib/backends/backend_agg.py", line 180, in get_text_width_height_descent
    font = self._get_agg_font(prop)
  File "/usr/lib/python2.7/site-packages/matplotlib/backends/backend_agg.py", line 221, in _get_agg_font
    font = FT2Font(str(fname))
RuntimeError: Could not open facefile /usr/lib/python2.6/site-packages/matplotlib/mpl-data/fonts/ttf/Vera.ttf; Cannot_Open_Resource

Arch Linux

#1 2010-10-18 23:12:03

"Python2 & 3 major rebuild" upgrade - impressions ?

#2 2010-10-18 23:14:47

Re: "Python2 & 3 major rebuild" upgrade - impressions ?

#3 2010-10-18 23:25:06

Re: "Python2 & 3 major rebuild" upgrade - impressions ?

#4 2010-10-18 23:37:42

Re: "Python2 & 3 major rebuild" upgrade - impressions ?

#5 2010-10-18 23:39:14

Re: "Python2 & 3 major rebuild" upgrade - impressions ?

#6 2010-10-18 23:40:11

Re: "Python2 & 3 major rebuild" upgrade - impressions ?

#7 2010-10-18 23:49:02

Re: "Python2 & 3 major rebuild" upgrade - impressions ?

#8 2010-10-18 23:52:38

Re: "Python2 & 3 major rebuild" upgrade - impressions ?

#9 2010-10-19 01:34:56

Re: "Python2 & 3 major rebuild" upgrade - impressions ?

#10 2010-10-19 02:00:21

Re: "Python2 & 3 major rebuild" upgrade - impressions ?

#11 2010-10-19 02:02:23

Re: "Python2 & 3 major rebuild" upgrade - impressions ?

#12 2010-10-19 03:18:49

Re: "Python2 & 3 major rebuild" upgrade - impressions ?

#13 2010-10-19 03:36:03

Re: "Python2 & 3 major rebuild" upgrade - impressions ?

#14 2010-10-19 03:51:13

Re: "Python2 & 3 major rebuild" upgrade - impressions ?

#15 2010-10-19 04:20:27

Re: "Python2 & 3 major rebuild" upgrade - impressions ?

#16 2010-10-19 04:36:38

Re: "Python2 & 3 major rebuild" upgrade - impressions ?

#17 2010-10-19 04:39:57

Re: "Python2 & 3 major rebuild" upgrade - impressions ?

#18 2010-10-19 05:20:53

Re: "Python2 & 3 major rebuild" upgrade - impressions ?

#19 2010-10-19 05:22:20

Re: "Python2 & 3 major rebuild" upgrade - impressions ?

#20 2010-10-19 06:30:29

Re: "Python2 & 3 major rebuild" upgrade - impressions ?

#21 2010-10-19 06:31:12

Re: "Python2 & 3 major rebuild" upgrade - impressions ?

#22 2010-10-19 06:58:27

Re: "Python2 & 3 major rebuild" upgrade - impressions ?

#23 2010-10-19 07:11:31

Re: "Python2 & 3 major rebuild" upgrade - impressions ?

#24 2010-10-19 14:49:09

Re: "Python2 & 3 major rebuild" upgrade - impressions ?

#25 2010-10-19 15:00:43

Re: "Python2 & 3 major rebuild" upgrade - impressions ?

Board footer