René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Retry decorator should support generator functions","articleBody":" **Is your feature request related to a problem? Please describe.**\r\n\r\nServer streaming libraries [return an iterable](https://github.com/googleapis/python-bigtable/blob/a6cfb021e1b158b81879b115868112875b1e4162/google/cloud/bigtable_v2/services/bigtable/client.py#L471) that can asynchronously yield data from the backend over time. Some of our libraries need to provide a wrapper around the raw stream to do some local processing, before passing the data to the user.\r\n\r\nIt would be useful to wrap this whole pipeline in a [retry decorator](https://github.com/googleapis/python-api-core/blob/b8e75cff8bf6772ab76ca6f8d3c80dc2580075c7/google/api_core/retry.py#L222), so that if the stream breaks mid-way through, we can recover and continue yielding data through our generator as if nothing happened. \r\n\r\nUnfortunately, the [current implementation ](https://github.com/googleapis/python-api-core/blob/b8e75cff8bf6772ab76ca6f8d3c80dc2580075c7/google/api_core/retry.py#L191) returns the result of the target function directly, so generators will not yield values and exceptions through the retry block\r\n\r\n **Describe the solution you'd like**\r\n\r\nAdd some code to detect when a target function is a generator. If so, Replace: https://github.com/googleapis/python-api-core/blob/b8e75cff8bf6772ab76ca6f8d3c80dc2580075c7/google/api_core/retry.py#L191\r\nwith:\r\n```\r\nyield from target()\r\n```\r\n\r\nSome extra work will also be needed to detect generator `.close()`, and async generators\r\n\r\nI plan on putting together a PR for this shortly","author":{"url":"https://github.com/daniel-sanche","@type":"Person","name":"daniel-sanche"},"datePublished":"2023-02-10T21:01:39.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":1},"url":"https://github.com/485/python-api-core/issues/485"}