René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Python images (At least bookwork-slim) relased today break installation of sdist packages","articleBody":"Following the discussion her https://github.com/pypa/wheel/issues/660#issuecomment-2788333871 - images relesed today started to break CI - Airflow, but also other people have similar issue.\n\nI explained it in the issue but let me copy it here as well:\n\nExample failure: https://github.com/apache/airflow/actions/runs/14347343802/job/40220981486#step:6:809 \n\n```\n6 13.37 Building wheels for collected packages: pyspark\ndocker-library/official-images#6 13.37   Building wheel for pyspark (setup.py): started\ndocker-library/official-images#6 14.11   Building wheel for pyspark (setup.py): finished with status 'error'\ndocker-library/official-images#6 14.11   error: subprocess-exited-with-error\ndocker-library/official-images#6 14.11   \ndocker-library/official-images#6 14.11   × python setup.py bdist_wheel did not run successfully.\ndocker-library/official-images#6 14.11   │ exit code: 1\ndocker-library/official-images#6 14.11   ╰─\u003e [8 lines of output]\ndocker-library/official-images#6 14.11       /home/airflow/.local/lib/python3.9/site-packages/setuptools/dist.py:717: UserWarning: Usage of dash-separated 'description-file' will not be supported in future versions. Please use the underscore name 'description_file' instead\ndocker-library/official-images#6 14.11         warnings.warn(\ndocker-library/official-images#6 14.11       usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]\ndocker-library/official-images#6 14.11          or: setup.py --help [cmd1 cmd2 ...]\ndocker-library/official-images#6 14.11          or: setup.py --help-commands\ndocker-library/official-images#6 14.11          or: setup.py cmd --help\ndocker-library/official-images#6 14.11       \ndocker-library/official-images#6 14.11       error: invalid command 'bdist_wheel'\ndocker-library/official-images#6 14.11       [end of output]\ndocker-library/official-images#6 14.11   \ndocker-library/official-images#6 14.11   note: This error originates from a subprocess, and is likely not a problem with pip.\ndocker-library/official-images#6 14.11   ERROR: Failed building wheel for pyspark\ndocker-library/official-images#6 14.12   Running setup.py clean for pyspark\n```\n\nAnd after some (non-obvious investigation I found out what the root cause is and that's somethign you might want to talk to the maintainers of official Python images in dockerhub, because probably a lot of people using them will have similar issue after 0.46+ wheel that does not contain bdist_wheel any more and rely on setuptools \u003e 70.1.\n\nThe problem is that some -  latest - official python images available in dockerhub are causing this problem to happen.\n\nIf you look - for example - at latest Python debian bookworm slim images you will see this:\n\n```\n[jarek:~/code/airflow] main ± docker run -it python:3.9-slim-bookworm bash\nroot@fb321ef4723e:/# pip list\nPackage    Version\n---------- -------\npip        23.0.1\nsetuptools 58.1.0\nwheel      0.45.1\n\n[notice] A new release of pip is available: 23.0.1 -\u003e 25.0.1\n[notice] To update, run: pip install --upgrade pip\nroot@fb321ef4723e:/# exit\nexit\n[jarek:~/code/airflow] main 14s ± docker run -it python:3.10-slim-bookworm bash \nroot@2234dee7aba0:/# pip list\nPackage    Version\n---------- -------\npackaging  24.2\npip        23.0.1\nsetuptools 65.5.1\nwheel      0.46.1\n\n[notice] A new release of pip is available: 23.0.1 -\u003e 25.0.1\n[notice] To update, run: pip install --upgrade pip\nroot@2234dee7aba0:/# exit\nexit\n[jarek:~/code/airflow] main 25s ± docker run -it python:3.11-slim-bookworm bash\nroot@b62343d129a6:/# pip list\nPackage    Version\n---------- -------\npackaging  24.2\npip        24.0\nsetuptools 65.5.1\nwheel      0.46.1\n\n[jarek:~/code/airflow] main 1m5s ± docker run -it python:3.12-slim-bookworm bash\nroot@411574e67a7e:/# pip list\nPackage Version\n------- -------\npip     25.0.1\nroot@411574e67a7e:/# \n```\n\n\nAs you can see - default version of setuptools in all those images causes problem:\n\n* Python 3.9 -\u003e both wheel and setuptools are old, but if you **just** upgrade wheel but do not upgrade setuptools, sdist installations will fail\n* Python 3.10, 3.11 -\u003e wheel is already updated, but setuptools is \u003c 70.1 - which mean that by default installing somethign from sdist wil fail there - even if you do not touch setuptools and wheel\n* Python 3.12 -\u003e all good, no setuptools, no wheel, newest versions of those will be installed\n\nI am going to upgrade setuptools and wheels to latest versions in our images, so we will solve the problem in Airflow, but I think currently released \"official images\" need to be rebuild and latest setuptools should be installed in all of them.\n\n\n\n\n\n\n\n\n\n","author":{"url":"https://github.com/potiuk","@type":"Person","name":"potiuk"},"datePublished":"2025-04-09T06:43:32.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":21},"url":"https://github.com/1023/python/issues/1023"}