Page MenuHomeSolus

Python 3.6 update
Closed, ResolvedPublic

Description

This is just an overall task for the python 3.6.4 update. I've rebuilt over 300 of the packages locally, but to save time I've skipped a bunch of the ones that take a long time to build, or if I found some issues that warranted further investigation (I just skipped ahead).

Help with rebuilding these would be greatly appreciated: Some may just need the python update to rebuild against, others will require to get further in the update as everything that uses python3 is currently broken. May take a day or two to finish off.

  • libreoffice
  • obs-studio
  • ogre
  • opencv
  • blender (needs tweaks to python paths)
  • devscripts (missing source) <-- this will likely be deprecated --> I found the new source location
  • gramps
  • libopenshot (issue with ffpmeg?) then openshot-qt -> issue with imagemagick
  • pycrypto (check no longer works)
  • gnome-builder
  • pyatspi2 (enum issue) -> was fixed in a newer version. I updated to latest version
  • orca (fails to build in help) -> dependency pygobject-3.0 rebuild against python 3.6 + update to 3.26.0 as some issues related to python 3.6 have been addressed
  • python-flaky (fails tests)
  • python-hypothesis (fails tests)
  • python-keyrings.alt
  • python-wheel
  • mutagen (fails tests)
  • python-bcrypt (check section needs updating)
  • python-mechanize (needs an update I think, plus the real rundeps added [and the one I added to calibre can be removed])
  • python-qscintilla D2109 and D2115 have been published

I also added R4009 although it wasn't accepted because it is a mandatory dependency of the updated python-twisted (I forgot to mention the dependency in the patch, sorry).

Some non-pathed ones I just found which need rebuilding also

  • gnome-code-assistance
  • eog-plugins
  • gedit-plugins
  • rhythmbox
  • fs-uae-launcher-dev
  • mate-dock-applet
  • fs-uae-arcade-dev
  • rstudio needs an update (this isn't related, but don't want to forget) xD - I gavee a quick try with the latest version requires boost 1.63
NOTE: the failed tests may be circular dep ordering issues, and may just need turning up for the stack update. Also pkgconfig(python-3.5) is deaded

Event Timeline

kyrios123 updated the task description. (Show Details)Jan 31 2018, 10:48 AM
kyrios123 updated the task description. (Show Details)Jan 31 2018, 10:54 AM
kyrios123 updated the task description. (Show Details)
kyrios123 updated the task description. (Show Details)Jan 31 2018, 11:29 AM
kyrios123 updated the task description. (Show Details)Jan 31 2018, 11:43 AM
kyrios123 updated the task description. (Show Details)Jan 31 2018, 11:58 AM
stigarn added a subscriber: stigarn.
kyrios123 updated the task description. (Show Details)Jan 31 2018, 12:39 PM
kyrios123 updated the task description. (Show Details)Jan 31 2018, 1:56 PM
kyrios123 updated the task description. (Show Details)Jan 31 2018, 2:03 PM
kyrios123 updated the task description. (Show Details)Jan 31 2018, 2:15 PM
kyrios123 updated the task description. (Show Details)Jan 31 2018, 3:24 PM
kyrios123 updated the task description. (Show Details)Jan 31 2018, 4:19 PM
kyrios123 updated the task description. (Show Details)Jan 31 2018, 10:11 PM
sunnyflunk triaged this task as Unbreak Now! priority.Feb 1 2018, 4:23 AM

So the automated push is over, now just to fix up the final packages, check that I haven't missed any (I feel like I accidentally deleted some) and test, test, test.

A budgie ISO loaded (and calibre), so that's something

sunnyflunk updated the task description. (Show Details)
kyrios123 updated the task description. (Show Details)Feb 1 2018, 11:41 AM
kyrios123 updated the task description. (Show Details)Feb 1 2018, 12:46 PM
kyrios123 updated the task description. (Show Details)Feb 1 2018, 1:48 PM
kyrios123 updated the task description. (Show Details)Feb 1 2018, 1:53 PM
kyrios123 updated the task description. (Show Details)Feb 1 2018, 3:24 PM
kyrios123 updated the task description. (Show Details)Feb 1 2018, 3:56 PM
kyrios123 updated the task description. (Show Details)
kyrios123 updated the task description. (Show Details)Feb 1 2018, 5:59 PM
kyrios123 updated the task description. (Show Details)Feb 1 2018, 10:47 PM

@EP01 @stigarn If there's any possibility you can put some python3 through it's paces on unstable, would be appreciated. Everything should work bar openshot, but some of the older python packages might need updated versions for better python 3.6 support is all I can think of.

EP01 added a comment.Feb 1 2018, 11:38 PM

Will do @sunnyflunk, I'll let you know here if I spot anything. Thanks for all the work to do the upgrade, bet you can't wait to do it all again for 3.7! How much did you manage to script?

sunnyflunk added a comment.EditedFeb 2 2018, 12:00 AM

@EP01 90%, (but then I deleted 15 packages by mistake...). Next time will be much, much easier as 40% of the packages wouldn't build first go due to: no component key, the python macros having changed and make bump was screwing up the source (I think it might happen when there's extra whitespace), then later builds breaking due to pkgconfig(python3.5), which worked locally until the update was pushed to Solus. So it was pretty time consuming, but now all the issues are resolved for next time, though there are a couple of circular dependencies in the python tests (which I'll know about). All part of the repo cleanup efforts really, updating packages to the current format and standards which makes them cake to maintain.

Also managed to merge all the Diffs for updates while doing it xD

Rebuild appears to be complete now. Would only be if I deprecated repos that are still in Solus the other week.

$ egrep -nir python3.5 | grep pspec
sardi-icons/pspec_x86_64.xml:2903:            <Path fileType="data">/usr/share/icons/Sardi-Flexible/scalable/apps/python3.5.svg</Path>
sardi-icons/pspec_x86_64.xml:7345:            <Path fileType="data">/usr/share/icons/Sardi-Mono/scalable/apps/python3.5.svg</Path>
numix-icon-theme-circle/pspec_x86_64.xml:3362:            <Path fileType="data">/usr/share/icons/Numix-Circle/48/apps/python3.5.svg</Path>
numix-icon-theme-square/pspec_x86_64.xml:3362:            <Path fileType="data">/usr/share/icons/Numix-Square/48/apps/python3.5.svg</Path>
$ egrep -nir python-35 | grep pspec
$ egrep -nir libpython3.5 | grep abi_used_libs
$

@sunnyflunk

@EP01 @stigarn If there's any possibility you can put some python3 through it's paces on unstable, would be appreciated. Everything should work bar openshot, but some of the older python packages might need updated versions for better python 3.6 support is all I can think of.

I'm sorry but I don't understand what you mean.

@stigarn well I notice you package a fair few python packages, so figured you might be better positioned than most for updating to unstable for a moment and testing those python packages still work as expected. If you don't want to, that is also ok

@stigarn well I notice you package a fair few python packages, so figured you might be better positioned than most for updating to unstable for a moment and testing those python packages still work as expected. If you don't want to, that is also ok

Now I understand and that is no problem to do. I have a Virtual machine that is on unstable so I can test some packages this afternoon.

I've updated all "my" packages and they work fine, no problems there.

kyrios123 added a comment.EditedFeb 2 2018, 8:27 PM

The only issue I found, was this package that wasn't in the list : dde3f3224b82
Actually it seems that python 3 isn't required to build this package. I am preparing the libboost update, and I'll have to rebuild this package so I'll fix it at the same time.

If it's just a general (non versioned) .py file it shouldn't need a rebuild (i.e. interpreted at runtime with whatever you have installed they typically get versioned when compiled), but I have no objection to being safe than sorry (can rebuild the repo if you really want). Though may be it's different if there's .pyc files built with it which might cause conflict and is certainly worth rebuilding for runtime performance.

sunnyflunk closed this task as Resolved.Feb 7 2018, 5:38 AM
sunnyflunk claimed this task.

I am rebuilding a few of the packages where they link against other libs, to get any demons out of the stack. However, this task can now be closed.