René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"PubSub Publisher 504 Deadline Exceeded when sending bulk messages","articleBody":"#### Environment details\r\n\r\n  - OS type and version: `PRETTY_NAME=\"Debian GNU/Linux 10 (buster)\"`\r\n  - Python version: `python --version` python3.7\r\n  - pip version: `pip --version`  20.0.2\r\n  - `google-cloud-pubsub` version: `pip show google-cloud-pubsub` 1.4.2\r\n\r\n#### Steps to reproduce\r\n\r\n  1. Send large number of messages to a PubSub Topic fails when I try to send 5000 without pausing and waiting, for example.\r\n  2. Check logs\r\n\r\n#### Code example\r\n\r\n```python\r\n# I have also tried this using the callback and hit the same error. This is what I'm doing now though.\r\niter_size = 5000\r\niter_count = 0\r\nfutures = []\r\nfor row in rows:\r\n     data = json.dumps(row, default=lambda x: str(x)).encode('utf-8')\r\n     future = publish_client.publish(topic, data, origin='xxx')\r\n     futures.append(future)\r\n     published_count += 1\r\n     iter_count += 1\r\n     if iter_count \u003e= iter_size:\r\n           [f.result() for f in futures]\r\n           futures = []\r\n           iter_count = 0\r\n     count += 1\r\n     [f.result() for f in futures]\r\n```\r\n\r\n#### Stack trace\r\n```\r\n[2020-04-14 14:19:23,788] {{thread.py:264}} ERROR - Failed to publish 141 messages.\r\nTraceback (most recent call last):\r\nFile \"/usr/local/lib/python3.7/site-packages/google/api_core/grpc_helpers.py\", line 57, in error_remapped_callable\r\n     return callable_(*args, **kwargs)\r\n   File \"/usr/local/lib/python3.7/site-packages/grpc/_channel.py\", line 826, in __call__\r\n     return _end_unary_response_blocking(state, call, False, None)\r\n   File \"/usr/local/lib/python3.7/site-packages/grpc/_channel.py\", line 729, in _end_unary_response_blocking\r\n     raise _InactiveRpcError(state)\r\n grpc._channel._InactiveRpcError: \u003c_InactiveRpcError of RPC that terminated with:\r\n \tstatus = StatusCode.DEADLINE_EXCEEDED\r\n \tdetails = \"Deadline Exceeded\"\r\n \tdebug_error_string = \"{\"created\":\"@1586873963.056617563\",\"description\":\"Error received from peer ipv4:108.177.122.95:443\",\"file\":\"src/core/lib/surface/call.cc\",\"file_line\":1056,\"grpc_message\":\"Deadline Exceeded\",\"grpc_status\":4}\"\r\n \u003e\r\n```\r\n\r\nOther Details:\r\n\r\nI've found a similar issue here \r\nhttps://github.com/googleapis/google-cloud-java/issues/3867\r\n\r\nWhich references to this issue\r\nhttps://github.com/googleapis/google-cloud-java/issues/3003\r\n\r\nThen\r\nhttps://github.com/googleapis/java-pubsub/issues/31\r\n\r\nThis will normally be running on GKE, so I understand me running it locally may have some variation of behavior due to network speed. However, we would prefer to avoid having this issue either way.\r\n\r\nIs this something that is planned/intended to be supported or should I implement auto-throttling?","author":{"url":"https://github.com/dillonjohnson","@type":"Person","name":"dillonjohnson"},"datePublished":"2020-04-14T14:37:23.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":8},"url":"https://github.com/72/python-pubsub/issues/72"}