René's URL Explorer Experiment


Title: Issue 21475: Support the Sitemap extension in robotparser - Python tracker

direct link

Domain: bugs.python.org

Nonetext/html; charset=utf-8

Links:

https://bugs.python.org/
Python Homehttps://www.python.org/
Abouthttps://www.python.org/about/
Newshttps://www.python.org/blogs/
Documentationhttps://www.python.org/doc/
Downloadshttps://www.python.org/downloads/
Communityhttps://www.python.org/community/
Foundationhttps://www.python.org/psf/
Developer's Guidehttps://devguide.python.org/
Issue Trackerhttps://bugs.python.org/
Searchhttps://bugs.python.org/issue?@template=search&status=1
Random Issuehttps://bugs.python.org/issue?@action=random
Issues with patchhttps://bugs.python.org/issue?status=1&@sort=-activity&@columns=id%2Cgithub%2Cactivity%2Ctitle%2Ccreator%2Cstatus&@dispname=Issues%20with%20patch&@startwith=0&@group=priority&keywords=2&@action=search&@filter=&@pagesize=50
Easy issueshttps://bugs.python.org/issue?status=1&@sort=-activity&@columns=id%2Cgithub%2Cactivity%2Ctitle%2Ccreator%2Cstatus&@dispname=Easy%20issues&@startwith=0&@group=priority&keywords=6&@action=search&@filter=&@pagesize=50
Statshttps://bugs.python.org/issue?@template=stats
Lost your login?https://bugs.python.org/user?@template=forgotten
User Listhttps://bugs.python.org/user?@sort=username
Committer Listhttps://bugs.python.org/user?iscommitter=1&@action=search&@sort=username&@pagesize=300
Tracker Documentationhttp://docs.python.org/devguide/triaging.html
Tracker Developmenthttp://wiki.python.org/moin/TrackerDevelopment
Report Tracker Problemhttps://github.com/python/psf-infra-meta/issues
https://github.com/python/cpython/issues
GitHubhttps://github.com/python/cpython/issues
see the GitHub FAQs in the Python's Developer Guide.https://devguide.python.org/gh-faq/
This issue has been migrated to GitHub: https://github.com/python/cpython/issues/65674 https://github.com/python/cpython/issues/65674
Titlehttp://docs.python.org/devguide/triaging.html#title
Typehttp://docs.python.org/devguide/triaging.html#type
Stagehttp://docs.python.org/devguide/triaging.html#stage
Componentshttp://docs.python.org/devguide/triaging.html#components
Versionshttp://docs.python.org/devguide/triaging.html#versions
Statushttp://docs.python.org/devguide/triaging.html#status
Resolutionhttp://docs.python.org/devguide/triaging.html#resolution
Dependencieshttp://docs.python.org/devguide/triaging.html#dependencies
25497https://bugs.python.org/issue25497
Supersederhttp://docs.python.org/devguide/triaging.html#superseder
Assigned Tohttp://docs.python.org/devguide/triaging.html#assigned-to
Nosy Listhttp://docs.python.org/devguide/triaging.html#nosy-list
Priorityhttp://docs.python.org/devguide/triaging.html#priority
Keywordshttp://docs.python.org/devguide/triaging.html#keywords
robotparser_site_maps_v1.patchhttps://bugs.python.org/file40791/robotparser_site_maps_v1.patch
reviewhttps://bugs.python.org/review/21475/#ps15772
PR 6883https://github.com/python/cpython/pull/6883
msg218308https://bugs.python.org/issue21475#msg218308
(view)https://bugs.python.org/msg218308
http://en.wikipedia.org/wiki/Robots_exclusion_standard#Nonstandard_extensionshttp://en.wikipedia.org/wiki/Robots_exclusion_standard#Nonstandard_extensions
https://support.google.com/webmasters/answer/183669?hl=enhttps://support.google.com/webmasters/answer/183669?hl=en
https://github.com/seomoz/reppyhttps://github.com/seomoz/reppy
msg218318https://bugs.python.org/issue21475#msg218318
(view)https://bugs.python.org/msg218318
issue 16099https://bugs.python.org/issue16099
msg252528https://bugs.python.org/issue21475#msg252528
(view)https://bugs.python.org/msg252528
issue 16099https://bugs.python.org/issue16099
msg253027https://bugs.python.org/issue21475#msg253027
(view)https://bugs.python.org/msg253027
issue25400https://bugs.python.org/issue25400
msg253035https://bugs.python.org/issue21475#msg253035
(view)https://bugs.python.org/msg253035
issue 25400https://bugs.python.org/issue25400
msg253063https://bugs.python.org/issue21475#msg253063
(view)https://bugs.python.org/msg253063
msg255225https://bugs.python.org/issue21475#msg255225
(view)https://bugs.python.org/msg255225
msg255228https://bugs.python.org/issue21475#msg255228
(view)https://bugs.python.org/msg255228
issue 25497https://bugs.python.org/issue25497
msg253016https://bugs.python.org/msg253016
issue 25400https://bugs.python.org/issue25400
msg311416https://bugs.python.org/issue21475#msg311416
(view)https://bugs.python.org/msg311416
msg315362https://bugs.python.org/issue21475#msg315362
(view)https://bugs.python.org/msg315362
msg316740https://bugs.python.org/issue21475#msg316740
(view)https://bugs.python.org/msg316740
https://github.com/python/cpython/pull/6878https://github.com/python/cpython/pull/6878
msg316743https://bugs.python.org/issue21475#msg316743
(view)https://bugs.python.org/msg316743
msg316811https://bugs.python.org/issue21475#msg316811
(view)https://bugs.python.org/msg316811
5db5c0669e624767375593cc1a01f32092c91c58https://hg.python.org/lookup/5db5c0669e624767375593cc1a01f32092c91c58
bpo-21475https://bugs.python.org/issue21475
GH-6883https://github.com/python/cpython/pull/6883
https://github.com/python/cpython/commit/5db5c0669e624767375593cc1a01f32092c91c58https://github.com/python/cpython/commit/5db5c0669e624767375593cc1a01f32092c91c58
msg316813https://bugs.python.org/issue21475#msg316813
(view)https://bugs.python.org/msg316813
msg316813https://bugs.python.org/msg316813
ned.deilyhttps://bugs.python.org/user5248
msg316811https://bugs.python.org/msg316811
msg316743https://bugs.python.org/msg316743
mcscope@gmail.comhttps://bugs.python.org/user28550
msg316740https://bugs.python.org/msg316740
pull_request6556https://bugs.python.org/pull_request6556
stevensalberthttps://bugs.python.org/user28307
msg315362https://bugs.python.org/msg315362
msg311416https://bugs.python.org/msg311416
Rewrite test_robotparserhttps://bugs.python.org/issue25497
msg255228https://bugs.python.org/msg255228
matrixisehttps://bugs.python.org/user17286
msg255225https://bugs.python.org/msg255225
robotparser_site_maps_v1.patchhttps://bugs.python.org/file40791
patchhttps://bugs.python.org/keyword2
msg253063https://bugs.python.org/msg253063
msg253035https://bugs.python.org/msg253035
pwirtzhttps://bugs.python.org/user22630
msg253027https://bugs.python.org/msg253027
msg252528https://bugs.python.org/msg252528
berker.peksaghttps://bugs.python.org/user14674
msg218318https://bugs.python.org/msg218318
The Python Software Foundationhttps://python.org/psf-landing/
Rounduphttp://roundup.sourceforge.net
Python Software Foundationhttp://python.org/psf
Legal Statementshttp://python.org/about/legal
URLs of crawlers that visited me.