René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Sphinx linkcheck and broken/redirect occurrences in Python Docs","articleBody":"Running `make linkcheck` in Doc folder outputs thousands of broken and redirected status. It would be nice to clean this up so we can link-check Python in CI/CD for each commit, but right now it is too polluted.\r\n\r\nSome of these occurrences could/should be fixed in the docs itself, others can benefit from [Sphinx's linkcheck configs](https://www.sphinx-doc.org/en/master/usage/configuration.html#options-for-the-linkcheck-builder) e.g. `linkcheck_ignore` and `linkcheck_allow_redirect`.\r\n\r\nSee [linkcheck-log.txt](https://github.com/python/cpython/files/11215133/linkcheck-log.txt) for the full log as of commit f2b7ecb.\r\n\r\nFun stats obtained from the above file:\r\n- Of its 8327 lines, where 7824 are related to BPO -\u003e GH issues. Of 7824, 5744 lines are from whatsnew/changelog and only 20 are not from whatsnew/\r\n- 241 lines are redirection of CPython CVS URL, fixing /tree/ to /blob/ in GitHub URL\r\n- 28 lines are broken links, where one broken link is 'https://' from an example in whatsnet/changelog\r\n\r\nThe way I see, this steps divide in:\r\n- Clean BPO to GH redirection messages\r\n- Fix broken links\r\n- Clean CPython CVS URL redirections\r\n- Clean GH issues to GH PR redirections\r\n- Fix the rest of the occurrences.\r\n\r\nlinkcheck_allow_redirect and linkcheck_ignore can be very handy in this case. linkcheck_allow_redirect makes 'ok' status a redirect that is being spotted by linkcheck, and we have linkcheck_ignore as the last resource.\r\n\r\nQuestions I have before implementing the solution:\r\n* Documentation hosted by Read The Docs may have language enabled so example.com is redirected to example.com/en/latest. To handle occurrences, I could add them to linkcheck_allow_redirect or we can use [sphinx-ext-intersphinx](https://www.sphinx-doc.org/en/master/usage/extensions/intersphinx.html) to map a keyword to the documentation URL (e.g 'rtd' for read-the-docs docs). The last option allows to map to proper language of the target URL linked, similar on how [Weblate did](https://github.com/WeblateOrg/weblate/blob/main/docs/conf.py#L213))\r\n- Is there any restrictions to fix broken/redirect links in old whatsnew/\u003crelease\u003e.rst?\r\n- Is there any restrictions to fix broken/redirect links in old whatsnew/changelog.rst (i.e. Misc/NEWS)?\r\n- Should I create a single Pull Request for all the fixes?\n\n\u003c!-- gh-linked-prs --\u003e\n### Linked PRs\n* gh-103569\n* gh-103602\n* gh-103608\n* gh-103683\n* gh-104001\n* gh-104088\n* gh-123019\n* gh-124136\n* gh-124137\n* gh-124144\n* gh-124151\n* gh-124152\n* gh-124169\n* gh-124179\n* gh-124180\n* gh-124183\n* gh-140012\n\u003c!-- /gh-linked-prs --\u003e\n","author":{"url":"https://github.com/rffontenelle","@type":"Person","name":"rffontenelle"},"datePublished":"2023-04-12T19:27:12.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":30},"url":"https://github.com/103484/cpython/issues/103484"}