René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"robotparser doesn't return crawl delay for default entry","articleBody":"BPO | [25400](https://bugs.python.org/issue25400)\n--- | :---\nNosy | @berkerpeksag\nPRs | \u003cli\u003epython/cpython#552\u003c/li\u003e\nFiles | \u003cli\u003e[robotparser_crawl_delay.patch](https://bugs.python.org/file40777/robotparser_crawl_delay.patch \"Uploaded as text/plain at 2015-10-14.01:21:41 by pwirtz\"): patch\u003c/li\u003e\u003cli\u003e[robotparser_crawl_delay_v2.patch](https://bugs.python.org/file40784/robotparser_crawl_delay_v2.patch \"Uploaded as text/plain at 2015-10-14.18:35:13 by pwirtz\")\u003c/li\u003e\u003cli\u003e[issue25400_v2.diff](https://bugs.python.org/file44739/issue25400_v2.diff \"Uploaded as text/plain at 2016-09-18.15:36:20 by @berkerpeksag\")\u003c/li\u003e\u003cli\u003e[issue25400_v3.diff](https://bugs.python.org/file44740/issue25400_v3.diff \"Uploaded as text/plain at 2016-09-18.16:01:20 by @berkerpeksag\")\u003c/li\u003e\n\n\u003csup\u003e*Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.*\u003c/sup\u003e\n\n\u003cdetails\u003e\u003csummary\u003eShow more details\u003c/summary\u003e\u003cp\u003e\n\nGitHub fields:\n```python\nassignee = None\nclosed_at = \u003cDate 2016-09-18.17:18:17.950\u003e\ncreated_at = \u003cDate 2015-10-14.01:21:42.690\u003e\nlabels = ['3.7', 'type-bug', 'library']\ntitle = \"robotparser doesn't return crawl delay for default entry\"\nupdated_at = \u003cDate 2017-03-31.16:36:30.705\u003e\nuser = 'https://bugs.python.org/pwirtz'\n```\n\nbugs.python.org fields:\n```python\nactivity = \u003cDate 2017-03-31.16:36:30.705\u003e\nactor = 'dstufft'\nassignee = 'none'\nclosed = True\nclosed_date = \u003cDate 2016-09-18.17:18:17.950\u003e\ncloser = 'berker.peksag'\ncomponents = ['Library (Lib)']\ncreation = \u003cDate 2015-10-14.01:21:42.690\u003e\ncreator = 'pwirtz'\ndependencies = []\nfiles = ['40777', '40784', '44739', '44740']\nhgrepos = []\nissue_num = 25400\nkeywords = ['patch']\nmessage_count = 8.0\nmessages = ['252971', '252972', '253015', '253016', '253017', '275776', '276897', '276900']\nnosy_count = 3.0\nnosy_names = ['python-dev', 'berker.peksag', 'pwirtz']\npr_nums = ['552']\npriority = 'normal'\nresolution = 'fixed'\nstage = 'resolved'\nstatus = 'closed'\nsuperseder = None\ntype = 'behavior'\nurl = 'https://bugs.python.org/issue25400'\nversions = ['Python 3.6', 'Python 3.7']\n```\n\n\u003c/p\u003e\u003c/details\u003e\n","author":{"url":"https://github.com/pwirtz","@type":"Person","name":"pwirtz"},"datePublished":"2015-10-14T01:21:43.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":8},"url":"https://github.com/69586/cpython/issues/69586"}