René's URL Explorer Experiment


Title: Issue 25400: robotparser doesn't return crawl delay for default entry - Python tracker

direct link

Domain: bugs.python.org

Nonetext/html; charset=utf-8

Links:

https://bugs.python.org/
Python Homehttps://www.python.org/
Abouthttps://www.python.org/about/
Newshttps://www.python.org/blogs/
Documentationhttps://www.python.org/doc/
Downloadshttps://www.python.org/downloads/
Communityhttps://www.python.org/community/
Foundationhttps://www.python.org/psf/
Developer's Guidehttps://devguide.python.org/
Issue Trackerhttps://bugs.python.org/
Searchhttps://bugs.python.org/issue?@template=search&status=1
Random Issuehttps://bugs.python.org/issue?@action=random
Issues with patchhttps://bugs.python.org/issue?status=1&@sort=-activity&@columns=id%2Cgithub%2Cactivity%2Ctitle%2Ccreator%2Cstatus&@dispname=Issues%20with%20patch&@startwith=0&@group=priority&keywords=2&@action=search&@filter=&@pagesize=50
Easy issueshttps://bugs.python.org/issue?status=1&@sort=-activity&@columns=id%2Cgithub%2Cactivity%2Ctitle%2Ccreator%2Cstatus&@dispname=Easy%20issues&@startwith=0&@group=priority&keywords=6&@action=search&@filter=&@pagesize=50
Statshttps://bugs.python.org/issue?@template=stats
Lost your login?https://bugs.python.org/user?@template=forgotten
User Listhttps://bugs.python.org/user?@sort=username
Committer Listhttps://bugs.python.org/user?iscommitter=1&@action=search&@sort=username&@pagesize=300
Tracker Documentationhttp://docs.python.org/devguide/triaging.html
Tracker Developmenthttp://wiki.python.org/moin/TrackerDevelopment
Report Tracker Problemhttps://github.com/python/psf-infra-meta/issues
https://github.com/python/cpython/issues
GitHubhttps://github.com/python/cpython/issues
see the GitHub FAQs in the Python's Developer Guide.https://devguide.python.org/gh-faq/
This issue has been migrated to GitHub: https://github.com/python/cpython/issues/69586 https://github.com/python/cpython/issues/69586
Titlehttp://docs.python.org/devguide/triaging.html#title
Typehttp://docs.python.org/devguide/triaging.html#type
Stagehttp://docs.python.org/devguide/triaging.html#stage
Componentshttp://docs.python.org/devguide/triaging.html#components
Versionshttp://docs.python.org/devguide/triaging.html#versions
Statushttp://docs.python.org/devguide/triaging.html#status
Resolutionhttp://docs.python.org/devguide/triaging.html#resolution
Dependencieshttp://docs.python.org/devguide/triaging.html#dependencies
Supersederhttp://docs.python.org/devguide/triaging.html#superseder
Assigned Tohttp://docs.python.org/devguide/triaging.html#assigned-to
Nosy Listhttp://docs.python.org/devguide/triaging.html#nosy-list
Priorityhttp://docs.python.org/devguide/triaging.html#priority
Keywordshttp://docs.python.org/devguide/triaging.html#keywords
robotparser_crawl_delay.patchhttps://bugs.python.org/file40777/robotparser_crawl_delay.patch
reviewhttps://bugs.python.org/review/25400/#ps15762
robotparser_crawl_delay_v2.patchhttps://bugs.python.org/file40784/robotparser_crawl_delay_v2.patch
reviewhttps://bugs.python.org/review/25400/#ps15767
issue25400_v2.diffhttps://bugs.python.org/file44739/issue25400_v2.diff
reviewhttps://bugs.python.org/review/25400/#ps18613
issue25400_v3.diffhttps://bugs.python.org/file44740/issue25400_v3.diff
reviewhttps://bugs.python.org/review/25400/#ps18614
PR 552https://github.com/python/cpython/pull/552
msg252971https://bugs.python.org/issue25400#msg252971
(view)https://bugs.python.org/msg252971
http://hg.python.org/lookup/dbed7cacfb7ehttp://hg.python.org/lookup/dbed7cacfb7e
https://www.carthage.edu/robots.txthttps://www.carthage.edu/robots.txt
https://www.carthage.edu/robots.txthttps://www.carthage.edu/robots.txt
https://www.carthage.edu/robots.txthttps://www.carthage.edu/robots.txt
msg252972https://bugs.python.org/issue25400#msg252972
(view)https://bugs.python.org/msg252972
msg253015https://bugs.python.org/issue25400#msg253015
(view)https://bugs.python.org/msg253015
msg253016https://bugs.python.org/issue25400#msg253016
(view)https://bugs.python.org/msg253016
msg253017https://bugs.python.org/issue25400#msg253017
(view)https://bugs.python.org/msg253017
msg275776https://bugs.python.org/issue25400#msg275776
(view)https://bugs.python.org/msg275776
Lib/test/test_robotparser.pyhttps://github.com/python/cpython/blob/master/Lib/test/test_robotparser.py
issue 25497https://bugs.python.org/issue25497
msg276897https://bugs.python.org/issue25400#msg276897
(view)https://bugs.python.org/msg276897
msg276900https://bugs.python.org/issue25400#msg276900
(view)https://bugs.python.org/msg276900
d5d910cfd288https://hg.python.org/lookup/d5d910cfd288
#25400https://bugs.python.org/issue25400
https://hg.python.org/cpython/rev/d5d910cfd288https://hg.python.org/cpython/rev/d5d910cfd288
911070065e38https://hg.python.org/lookup/911070065e38
#25400https://bugs.python.org/issue25400
https://hg.python.org/cpython/rev/911070065e38https://hg.python.org/cpython/rev/911070065e38
pull_request1034https://bugs.python.org/pull_request1034
python-devhttps://bugs.python.org/user13902
msg276900https://bugs.python.org/msg276900
issue25400_v3.diffhttps://bugs.python.org/file44740
issue25400_v2.diffhttps://bugs.python.org/file44739
msg276897https://bugs.python.org/msg276897
msg275776https://bugs.python.org/msg275776
robotparser_crawl_delay_v2.patchhttps://bugs.python.org/file40784
msg253017https://bugs.python.org/msg253017
msg253016https://bugs.python.org/msg253016
msg253015https://bugs.python.org/msg253015
berker.peksaghttps://bugs.python.org/user14674
msg252972https://bugs.python.org/msg252972
The Python Software Foundationhttps://python.org/psf-landing/
Rounduphttp://roundup.sourceforge.net
Python Software Foundationhttp://python.org/psf
Legal Statementshttp://python.org/about/legal
URLs of crawlers that visited me.