René's URL Explorer Experiment


Title: Issue 16099: robotparser doesn't support request rate and crawl delay parameters - Python tracker

direct link

Domain: bugs.python.org

Nonetext/html; charset=utf-8

Links:

https://bugs.python.org/
Python Homehttps://www.python.org/
Abouthttps://www.python.org/about/
Newshttps://www.python.org/blogs/
Documentationhttps://www.python.org/doc/
Downloadshttps://www.python.org/downloads/
Communityhttps://www.python.org/community/
Foundationhttps://www.python.org/psf/
Developer's Guidehttps://devguide.python.org/
Issue Trackerhttps://bugs.python.org/
Searchhttps://bugs.python.org/issue?@template=search&status=1
Random Issuehttps://bugs.python.org/issue?@action=random
Issues with patchhttps://bugs.python.org/issue?status=1&@sort=-activity&@columns=id%2Cgithub%2Cactivity%2Ctitle%2Ccreator%2Cstatus&@dispname=Issues%20with%20patch&@startwith=0&@group=priority&keywords=2&@action=search&@filter=&@pagesize=50
Easy issueshttps://bugs.python.org/issue?status=1&@sort=-activity&@columns=id%2Cgithub%2Cactivity%2Ctitle%2Ccreator%2Cstatus&@dispname=Easy%20issues&@startwith=0&@group=priority&keywords=6&@action=search&@filter=&@pagesize=50
Statshttps://bugs.python.org/issue?@template=stats
Lost your login?https://bugs.python.org/user?@template=forgotten
User Listhttps://bugs.python.org/user?@sort=username
Committer Listhttps://bugs.python.org/user?iscommitter=1&@action=search&@sort=username&@pagesize=300
Tracker Documentationhttp://docs.python.org/devguide/triaging.html
Tracker Developmenthttp://wiki.python.org/moin/TrackerDevelopment
Report Tracker Problemhttps://github.com/python/psf-infra-meta/issues
https://github.com/python/cpython/issues
GitHubhttps://github.com/python/cpython/issues
see the GitHub FAQs in the Python's Developer Guide.https://devguide.python.org/gh-faq/
This issue has been migrated to GitHub: https://github.com/python/cpython/issues/60303 https://github.com/python/cpython/issues/60303
Titlehttp://docs.python.org/devguide/triaging.html#title
Typehttp://docs.python.org/devguide/triaging.html#type
Stagehttp://docs.python.org/devguide/triaging.html#stage
Componentshttp://docs.python.org/devguide/triaging.html#components
Versionshttp://docs.python.org/devguide/triaging.html#versions
Statushttp://docs.python.org/devguide/triaging.html#status
Resolutionhttp://docs.python.org/devguide/triaging.html#resolution
Dependencieshttp://docs.python.org/devguide/triaging.html#dependencies
Supersederhttp://docs.python.org/devguide/triaging.html#superseder
Assigned Tohttp://docs.python.org/devguide/triaging.html#assigned-to
Nosy Listhttp://docs.python.org/devguide/triaging.html#nosy-list
Priorityhttp://docs.python.org/devguide/triaging.html#priority
Keywordshttp://docs.python.org/devguide/triaging.html#keywords
robotparser.patchhttps://bugs.python.org/file27373/robotparser.patch
robotparser.patchhttps://bugs.python.org/file27374/robotparser.patch
robotparser.patchhttps://bugs.python.org/file27476/robotparser.patch
reviewhttps://bugs.python.org/review/16099/#ps6205
robotparser_reformatted.patchhttps://bugs.python.org/file27477/robotparser_reformatted.patch
reviewhttps://bugs.python.org/review/16099/#ps6206
robotparser_v2.patchhttps://bugs.python.org/file33071/robotparser_v2.patch
reviewhttps://bugs.python.org/review/16099/#ps10273
robotparser_v3.patchhttps://bugs.python.org/file35377/robotparser_v3.patch
reviewhttps://bugs.python.org/review/16099/#ps11968
msg171711https://bugs.python.org/issue16099#msg171711
(view)https://bugs.python.org/msg171711
msg171712https://bugs.python.org/issue16099#msg171712
(view)https://bugs.python.org/msg171712
msg171715https://bugs.python.org/issue16099#msg171715
(view)https://bugs.python.org/msg171715
msg171719https://bugs.python.org/issue16099#msg171719
(view)https://bugs.python.org/msg171719
http://pythonmentors.com/http://pythonmentors.com/
msg172327https://bugs.python.org/issue16099#msg172327
(view)https://bugs.python.org/msg172327
msg172338https://bugs.python.org/issue16099#msg172338
(view)https://bugs.python.org/msg172338
msg205567https://bugs.python.org/issue16099#msg205567
(view)https://bugs.python.org/msg205567
msg205641https://bugs.python.org/issue16099#msg205641
(view)https://bugs.python.org/msg205641
msg205755https://bugs.python.org/issue16099#msg205755
(view)https://bugs.python.org/msg205755
http://bugs.python.org/review/16099/diff/6206/Doc/library/urllib.robotparser.rsthttp://bugs.python.org/review/16099/diff/6206/Doc/library/urllib.robotparser.rst
Doc/library/urllib.robotparser.rsthttps://github.com/python/cpython/blob/master/Doc/library/urllib.robotparser.rst
http://bugs.python.org/review/16099/diff/6206/Doc/library/urllib.robotparser...http://bugs.python.org/review/16099/diff/6206/Doc/library/urllib.robotparser...
Doc/library/urllib.robotparser.rst:56https://github.com/python/cpython/blob/master/Doc/library/urllib.robotparser.rst#L56
https://support.google.com/webmasters/answer/48620?hl=enhttps://support.google.com/webmasters/answer/48620?hl=en
http://bugs.python.org/review/16099/diff/6206/Lib/urllib/robotparser.pyhttp://bugs.python.org/review/16099/diff/6206/Lib/urllib/robotparser.py
Lib/urllib/robotparser.pyhttps://github.com/python/cpython/blob/master/Lib/urllib/robotparser.py
http://bugs.python.org/review/16099/diff/6206/Lib/urllib/robotparser.py#newco..http://bugs.python.org/review/16099/diff/6206/Lib/urllib/robotparser.py#newco..
Lib/urllib/robotparser.py:168https://github.com/python/cpython/blob/master/Lib/urllib/robotparser.py#L168
msg205761https://bugs.python.org/issue16099#msg205761
(view)https://bugs.python.org/msg205761
msg208721https://bugs.python.org/issue16099#msg208721
(view)https://bugs.python.org/msg208721
msg219212https://bugs.python.org/issue16099#msg219212
(view)https://bugs.python.org/msg219212
msg223099https://bugs.python.org/issue16099#msg223099
(view)https://bugs.python.org/msg223099
msg225916https://bugs.python.org/issue16099#msg225916
(view)https://bugs.python.org/msg225916
msg252483https://bugs.python.org/issue16099#msg252483
(view)https://bugs.python.org/msg252483
msg252521https://bugs.python.org/issue16099#msg252521
(view)https://bugs.python.org/msg252521
dbed7cacfb7ehttps://hg.python.org/lookup/dbed7cacfb7e
#16099https://bugs.python.org/issue16099
https://hg.python.org/cpython/rev/dbed7cacfb7ehttps://hg.python.org/cpython/rev/dbed7cacfb7e
msg252525https://bugs.python.org/issue16099#msg252525
(view)https://bugs.python.org/msg252525
msg252525https://bugs.python.org/msg252525
python-devhttps://bugs.python.org/user13902
msg252521https://bugs.python.org/msg252521
msg252483https://bugs.python.org/msg252483
msg225916https://bugs.python.org/msg225916
msg223099https://bugs.python.org/msg223099
berker.peksaghttps://bugs.python.org/user14674
robotparser_v3.patchhttps://bugs.python.org/file35377
msg219212https://bugs.python.org/msg219212
rhettingerhttps://bugs.python.org/user114
rhettingerhttps://bugs.python.org/user114
rhettingerhttps://bugs.python.org/user114
msg208721https://bugs.python.org/msg208721
msg205761https://bugs.python.org/msg205761
robotparser_v2.patchhttps://bugs.python.org/file33071
msg205755https://bugs.python.org/msg205755
berker.peksaghttps://bugs.python.org/user14674
msg205641https://bugs.python.org/msg205641
msg205567https://bugs.python.org/msg205567
orsenthilhttps://bugs.python.org/user1741
hynekhttps://bugs.python.org/user14695
needs reviewhttps://bugs.python.org/keyword8
robotparser_reformatted.patchhttps://bugs.python.org/file27477
msg172338https://bugs.python.org/msg172338
robotparser.patchhttps://bugs.python.org/file27476
msg172327https://bugs.python.org/msg172327
easyhttps://bugs.python.org/keyword6
gsochttps://bugs.python.org/keyword11
msg171719https://bugs.python.org/msg171719
robotparser.patchhttps://bugs.python.org/file27374
msg171715https://bugs.python.org/msg171715
christian.heimeshttps://bugs.python.org/user3108
msg171712https://bugs.python.org/msg171712
gsochttps://bugs.python.org/keyword11
The Python Software Foundationhttps://python.org/psf-landing/
Rounduphttp://roundup.sourceforge.net
Python Software Foundationhttp://python.org/psf
Legal Statementshttp://python.org/about/legal
URLs of crawlers that visited me.