René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Datastore query limits are silently truncated by the v1beta3 API","articleBody":"This bug manifests itself in a couple of \"fun\" ways:\n\n``` python\nlen(list(client.query(kind=\"Foo\").fetch(limit=300)))\n```\n\nWill yield `300`, assuming there are `300` or more entities of that kind.\n\n``` python\nlen(list(client.query(kind=\"Foo\").fetch(limit=500)))\n```\n\nAssuming there are `500` entities of that kind, will yield `500`. If there are `n` entities where `n \u003e 500`, it will yield `n`.\n\nThis all seems to be caused by the `v1beta3` api truncating the limits to `300`:\n\n``` python\nentities, more, cursor = client.query(kind=\"Foo\").fetch(limit=500).next_page()\n```\n\n`len(entities)` will be `300` and _not_ `500` even if there are `500` or more entities of that kind. \n\nWe're currently using the following snippet to work around this issue:\n\n``` python\n\ndef _all_entities(iterator):\n    entities, cursor = [], None\n    while iterator._limit \u003e 0:\n        xs, more, cursor = iterator.next_page()\n        iterator._limit -= len(xs)\n        entities.extend(xs)\n        if not more:\n            break\n\n    return entities, cursor\n```\n","author":{"url":"https://github.com/Bogdanp","@type":"Person","name":"Bogdanp"},"datePublished":"2016-04-28T12:48:00.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":19},"url":"https://github.com/1763/google-cloud-python/issues/1763"}