René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Multiple asyncio runs cause SSLWantReadError","articleBody":"Hi,\r\n\r\nI would like to use the Microsoft graph SDK for Python with Django DB transaction.\r\nAs Django DB transaction `with transaction.atomic()` must be in sync context, I must use multiple `asyncio.run` calls.\r\n\r\n\u003e The question is how can we mix async graph requests and sync calls with multiple async calls?\r\n\r\nThe first `asyncio.run` works correctly, I am able to retrieve two `MailFolder` with their ID and messages in one of these folders.\r\n\r\n```python\r\nmailfolders = await asyncio.gather(\r\n    self._retrieve_mailfolder_source(),\r\n    self._retrieve_mailfolder_backup(),\r\n    return_exceptions=False\r\n)\r\n\r\n# Same async event loop, no SSLWantReadError raised\r\nresult = await asyncio.gather(self._get_messages(mailfolders[0]))\r\n```\r\n\r\nThe issue is for the second `asyncio.run`, the second call raise a `SSLWantReadError` exception.\r\n\r\nFor your information, when I run all graph requests in the same event loop, it works.\r\nI don't know why with a second/different event loop, the graph request causes `SSLWantReadError` error.\r\n\r\nIt should be possible to execute many async calls with `asyncio.run`, correct?\r\n\r\n```python\r\ndef _retrieve_mailfolders(self):\r\n    mailfolders = await asyncio.gather(\r\n        self._retrieve_mailfolder_source(),\r\n        self._retrieve_mailfolder_backup(),\r\n        return_exceptions=False\r\n    )\r\n    return mailfolders\r\n\r\ndef _retrieve(self):\r\n    mailfolders = asyncio.run(self._retrieve_mailfolders())\r\n    \r\n    with transaction.atomic():\r\n        # Second async run causes SSLWantReadError\r\n        messages = asyncio.run(self._get_messages(mailfolders[0]))\r\n```\r\n\r\n## Exception\r\n\r\n```\r\nScopes:\r\n('https://graph.microsoft.com/.default',)\r\n\r\nToken:\r\nAccessToken(token='eyJ0eXAiOiJKV1QiLCJub25jZSI6Imo*********************************', expires_on=1675276095)\r\n\r\nSuccessfully authenticated to Azure\r\n\r\n\r\n\r\nTraceback (most recent call last):\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/anyio/streams/tls.py\", line 130, in _call_sslobject_method\r\n    result = func(*args)\r\n  File \"/usr/lib/python3.10/ssl.py\", line 917, in read\r\n    v = self._sslobj.read(len)\r\nssl.SSLWantReadError: The operation did not complete (read) (_ssl.c:2548)\r\n\r\nDuring handling of the above exception, another exception occurred:\r\n\r\nTraceback (most recent call last):\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/httpcore/_async/http11.py\", line 91, in handle_async_request\r\n    ) = await self._receive_response_headers(**kwargs)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/httpcore/_async/http11.py\", line 155, in _receive_response_headers\r\n    event = await self._receive_event(timeout=timeout)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/httpcore/_async/http11.py\", line 191, in _receive_event\r\n    data = await self._network_stream.read(\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/httpcore/backends/asyncio.py\", line 34, in read\r\n    return await self._stream.receive(max_bytes=max_bytes)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/anyio/streams/tls.py\", line 195, in receive\r\n    data = await self._call_sslobject_method(self._ssl_object.read, max_bytes)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/anyio/streams/tls.py\", line 137, in _call_sslobject_method\r\n    data = await self.transport_stream.receive()\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/anyio/_backends/_asyncio.py\", line 1264, in receive\r\n    self._transport.resume_reading()\r\n  File \"/usr/lib/python3.10/asyncio/selector_events.py\", line 814, in resume_reading\r\n    self._add_reader(self._sock_fd, self._read_ready)\r\n  File \"/usr/lib/python3.10/asyncio/selector_events.py\", line 760, in _add_reader\r\n    self._loop._add_reader(fd, callback, *args)\r\n  File \"/usr/lib/python3.10/asyncio/selector_events.py\", line 253, in _add_reader\r\n    self._check_closed()\r\n  File \"/usr/lib/python3.10/asyncio/base_events.py\", line 515, in _check_closed\r\n    raise RuntimeError('Event loop is closed')\r\nRuntimeError: Event loop is closed\r\n\r\nDuring handling of the above exception, another exception occurred:\r\n\r\nTraceback (most recent call last):\r\n  File \"/home/renji/scripts/f5/circuitMaintenanceParser/src/app_discover/core/adapters/emailMsGraph/msGraphAdapter.py\", line 314, in _move_message\r\n    message = await self._msgraph_client.me.messages_by_id(message.id).move.post(\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/msgraph/generated/me/messages/item/move/move_request_builder.py\", line 58, in post\r\n    return await self.request_adapter.send_async(request_info, message.Message, error_mapping)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/kiota_http/httpx_request_adapter.py\", line 112, in send_async\r\n    response = await self.get_http_response_message(request_info)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/kiota_http/httpx_request_adapter.py\", line 320, in get_http_response_message\r\n    resp = await self._http_client.send(request)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/httpx/_client.py\", line 1620, in send\r\n    response = await self._send_handling_auth(\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/httpx/_client.py\", line 1648, in _send_handling_auth\r\n    response = await self._send_handling_redirects(\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/httpx/_client.py\", line 1685, in _send_handling_redirects\r\n    response = await self._send_single_request(request)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/httpx/_client.py\", line 1722, in _send_single_request\r\n    response = await transport.handle_async_request(request)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/msgraph_core/middleware/async_graph_transport.py\", line 21, in handle_async_request\r\n    response = await self.pipeline.send(request)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/kiota_http/middleware/middleware.py\", line 31, in send\r\n    return await self._first_middleware.send(request, self._transport)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/kiota_http/middleware/redirect_handler.py\", line 65, in send\r\n    response = await super().send(request, transport)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/kiota_http/middleware/middleware.py\", line 57, in send\r\n    return await self.next.send(request, transport)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/kiota_http/middleware/retry_handler.py\", line 77, in send\r\n    response = await super().send(request, transport)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/kiota_http/middleware/middleware.py\", line 57, in send\r\n    return await self.next.send(request, transport)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/kiota_http/middleware/parameters_name_decoding_handler.py\", line 48, in send\r\n    response = await super().send(request, transport)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/kiota_http/middleware/middleware.py\", line 57, in send\r\n    return await self.next.send(request, transport)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/msgraph_core/middleware/telemetry.py\", line 48, in send\r\n    response = await super().send(request, transport)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/kiota_http/middleware/middleware.py\", line 54, in send\r\n    response = await transport.handle_async_request(request)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/msgraph_core/middleware/async_graph_transport.py\", line 21, in handle_async_request\r\n    response = await self.pipeline.send(request)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/kiota_http/middleware/middleware.py\", line 31, in send\r\n    return await self._first_middleware.send(request, self._transport)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/kiota_http/middleware/redirect_handler.py\", line 65, in send\r\n    response = await super().send(request, transport)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/kiota_http/middleware/middleware.py\", line 57, in send\r\n    return await self.next.send(request, transport)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/kiota_http/middleware/retry_handler.py\", line 77, in send\r\n    response = await super().send(request, transport)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/kiota_http/middleware/middleware.py\", line 57, in send\r\n    return await self.next.send(request, transport)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/kiota_http/middleware/parameters_name_decoding_handler.py\", line 48, in send\r\n    response = await super().send(request, transport)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/kiota_http/middleware/middleware.py\", line 57, in send\r\n    return await self.next.send(request, transport)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/msgraph_core/middleware/telemetry.py\", line 48, in send\r\n    response = await super().send(request, transport)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/kiota_http/middleware/middleware.py\", line 54, in send\r\n    response = await transport.handle_async_request(request)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/httpx/_transports/default.py\", line 353, in handle_async_request\r\n    resp = await self._pool.handle_async_request(req)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/httpcore/_async/connection_pool.py\", line 253, in handle_async_request\r\n    raise exc\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/httpcore/_async/connection_pool.py\", line 237, in handle_async_request\r\n    response = await connection.handle_async_request(request)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/httpcore/_async/connection.py\", line 90, in handle_async_request\r\n    return await self._connection.handle_async_request(request)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/httpcore/_async/http11.py\", line 111, in handle_async_request\r\n    await self._response_closed()\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/httpcore/_async/http11.py\", line 224, in _response_closed\r\n    await self.aclose()\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/httpcore/_async/http11.py\", line 232, in aclose\r\n    await self._network_stream.aclose()\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/httpcore/backends/asyncio.py\", line 54, in aclose\r\n    await self._stream.aclose()\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/anyio/streams/tls.py\", line 192, in aclose\r\n    await self.transport_stream.aclose()\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/anyio/_backends/_asyncio.py\", line 1323, in aclose\r\n    self._transport.close()\r\n  File \"/usr/lib/python3.10/asyncio/selector_events.py\", line 706, in close\r\n    self._loop.call_soon(self._call_connection_lost, None)\r\n  File \"/usr/lib/python3.10/asyncio/base_events.py\", line 753, in call_soon\r\n    self._check_closed()\r\n  File \"/usr/lib/python3.10/asyncio/base_events.py\", line 515, in _check_closed\r\n    raise RuntimeError('Event loop is closed')\r\nRuntimeError: Event loop is closed\r\n\r\nDuring handling of the above exception, another exception occurred:\r\n\r\nTraceback (most recent call last):\r\n  File \"/home/renji/scripts/f5/circuitMaintenanceParser/src/manage.py\", line 22, in \u003cmodule\u003e\r\n    main()\r\n  File \"/home/renji/scripts/f5/circuitMaintenanceParser/src/manage.py\", line 18, in main\r\n    execute_from_command_line(sys.argv)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/django/core/management/__init__.py\", line 446, in execute_from_command_line\r\n    utility.execute()\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/django/core/management/__init__.py\", line 440, in execute\r\n    self.fetch_command(subcommand).run_from_argv(self.argv)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/django/core/management/base.py\", line 402, in run_from_argv\r\n    self.execute(*args, **cmd_options)\r\n  File \"/home/renji/virtualenvs/f5/maintenanceManager_3.10/lib/python3.10/site-packages/django/core/management/base.py\", line 448, in execute\r\n    output = self.handle(*args, **options)\r\n  File \"/home/renji/scripts/f5/circuitMaintenanceParser/src/app_discover/management/commands/discover.py\", line 109, in handle\r\n    raise e\r\n  File \"/home/renji/scripts/f5/circuitMaintenanceParser/src/app_discover/management/commands/discover.py\", line 103, in handle\r\n    messages = adapter.retrieve(store, range)\r\n  File \"/home/renji/scripts/f5/circuitMaintenanceParser/src/app_discover/core/adapters/emailMsGraph/msGraphAdapter.py\", line 358, in retrieve\r\n    raise e\r\n  File \"/home/renji/scripts/f5/circuitMaintenanceParser/src/app_discover/core/adapters/emailMsGraph/msGraphAdapter.py\", line 355, in retrieve\r\n    return self._retrieve(store, limit)\r\n  File \"/home/renji/scripts/f5/circuitMaintenanceParser/src/app_discover/core/adapters/emailMsGraph/msGraphAdapter.py\", line 452, in _retrieve\r\n    move, = asyncio.run(self._move_message(message, mailfolder_backup))\r\n  File \"/usr/lib/python3.10/asyncio/runners.py\", line 44, in run\r\n    return loop.run_until_complete(main)\r\n  File \"/usr/lib/python3.10/asyncio/base_events.py\", line 649, in run_until_complete\r\n    return future.result()\r\n  File \"/home/renji/scripts/f5/circuitMaintenanceParser/src/app_discover/core/adapters/emailMsGraph/msGraphAdapter.py\", line 321, in _move_message\r\n    raise DiscoverAdapterError(\r\napp_discover.errors.DiscoverAdapterError: Unable to move the message 'TCL TT: \"*******\" / \"Emergency\" / \"Scheduled\" / Planned Work Notification' to the mail folder 'Backup':\r\nEvent loop is closed\r\n```\r\n\r\n## Environment\r\n\r\nPython version 3.10.9 (Ubuntu 20.04)\r\n\r\n- azure-core :                                           1.26.2\r\n- azure-identity :                                      1.12.0\r\n- microsoft-kiota-abstractions :               0.3.0\r\n- microsoft-kiota-authentication-azure : 0.2.0\r\n- microsoft-kiota-http :                            0.3.1\r\n- microsoft-kiota-serialization-json :       0.2.1\r\n- microsoft-kiota-serialization-text :        0.2.0\r\n- msgraph-core :                                      1.0.0a3\r\n- msgraph-sdk :                                       1.0.0a9","author":{"url":"https://github.com/Renji-FR","@type":"Person","name":"Renji-FR"},"datePublished":"2023-02-01T18:18:19.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":11},"url":"https://github.com/82/msgraph-sdk-python/issues/82"}