René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Support for running code after the response has been returned ","articleBody":"While this request might sound similar to the `streaming response` feature [see https://github.com/aws/aws-lambda-python-runtime-interface-client/issues/100] now available to Node.js Lambda functions (see https://docs.aws.amazon.com/lambda/latest/dg/configuration-response-streaming.html), it is a separate topic.  \r\n\r\nWe have come across two different use cases where we'd like to run some Python code _after_ returning our response to, say, API Gateway.  One use case is running Python's garbage collector \"manually\" instead of automatically.  Rather than have Python decide to run garbage collection in the middle of our processing of an incoming `event`, and cause our users extra latency, we want to collect the garbage after returning the response.  \r\n\r\nThe other use case involves updating DynamoDb with some bookkeeping about the `event` just serviced.  While we can use an external Lambda Extension to do this, it requires moving a non-trivial amount of data to the Extension process, which seems wasteful assuming we could run this DynamoDb update after returning the response.\r\n\r\nAs a proof of concept, I wrote a monkeypatch to explore feasibility.  I wrote it as a class that I can choose to instance or not at the top of my lambda handler.\r\n\r\n```python\r\nclass PostResponseHook:\r\n    def __init__(self):\r\n        import awslambdaric.bootstrap\r\n\r\n        self.original_handle_event_request = awslambdaric.bootstrap.handle_event_request\r\n        awslambdaric.bootstrap.handle_event_request = self.new_handle_event_request\r\n\r\n    def new_handle_event_request(self, *args, **kwargs):\r\n        self.original_handle_event_request(*args, **kwargs)\r\n        self.hook()\r\n\r\n    def hook(self, *args, **kwargs):\r\n        # do something after the response was returned to the caller here\r\n        pass\r\n```\r\n\r\nThe monkeypatch relies on the current structure of `handle_event_request` in [bootstrap.py](https://github.com/aws/aws-lambda-python-runtime-interface-client/blob/main/awslambdaric/bootstrap.py).  The Lambda function is not finished processing the incoming Event in `handle_event_request`, but, rather, continues back to the \"infinite loop\" in [run](https://github.com/aws/aws-lambda-python-runtime-interface-client/blob/2d0c421ec588a05e6efd8773fa1416fe5433bae0/awslambdaric/bootstrap.py#L461C5-L461C8).\r\n\r\n```python\r\n        while True:\r\n            event_request = lambda_runtime_client.wait_next_invocation()\r\n\r\n            _GLOBAL_AWS_REQUEST_ID = event_request.invoke_id\r\n\r\n            update_xray_env_variable(event_request.x_amzn_trace_id)\r\n\r\n            handle_event_request(\r\n                lambda_runtime_client,\r\n                request_handler,\r\n                event_request.invoke_id,\r\n                event_request.event_body,\r\n                event_request.content_type,\r\n                event_request.client_context,\r\n                event_request.cognito_identity,\r\n                event_request.invoked_function_arn,\r\n                event_request.deadline_time_in_ms,\r\n                log_sink,\r\n            )\r\n```\r\n\r\nThe call to `lambda_runtime_client.wait_next_invocation()` in this loop is where the \"long poll\" for the next Lambda Event occurs (and, presumably, is where the Lambda service will freeze or shutdown this Lambda function instance under most circumstances (see https://docs.aws.amazon.com/lambda/latest/dg/lambda-runtime-environment.html for details.)\r\n\r\n=============================================\r\n\r\nGiven that it seems technically feasible to offer this hook, how could we add this as a supported feature instead of relying on monkeypatching?  It seems that we'd need a way to optionally \"register\" our hook method.  Which would mean exposing a callable from somewhere in `awslambdaric`.  Since I don't know of an existing API already exposed to user code by `awslambdaric`, I don't know where this `register_post_response_hook` method belongs.  \r\n\r\nAlternatively, maybe opting in for this feature would be by means of some special Layer that `awslambdaric` would look for, avoiding the need for explicit opt-in registration by the user's handler?  \r\n\r\n=============================================\r\n\r\nBut I'm probably getting ahead of myself here!  The first question is:  would the `awslambdaric` project consider this kind of hook as desirable, given that it can make a really big difference to latency-sensitive customer use-cases? ","author":{"url":"https://github.com/jrobbins-LiveData","@type":"Person","name":"jrobbins-LiveData"},"datePublished":"2023-09-07T11:49:30.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":1},"url":"https://github.com/113/aws-lambda-python-runtime-interface-client/issues/113"}