René's URL Explorer Experiment

Title: bpo-41279: Add StreamReaderBufferedProtocol by tontinton · Pull Request #21446 · python/cpython · GitHub

Open Graph Title: bpo-41279: Add StreamReaderBufferedProtocol by tontinton · Pull Request #21446 · python/cpython

X Title: bpo-41279: Add StreamReaderBufferedProtocol by tontinton · Pull Request #21446 · python/cpython

Description: https://bugs.python.org/issue41279 I got way better performance on await reader.read() using this branch on linux (check out the chart on the server.py script's comments). The way I tested was writing a server / client: server.py: import asyncio import contextlib import time async def client_connected(reader, writer): start = time.time() with contextlib.closing(writer): for i in range(1000): # the more this parameter's distance from 65536 is greater the better the performance global_buffer gives # On linux: # 65536 * 2 -> Gives about 160% better performance # 4096 -> Gives about 155% better performance # 65536 -> Gives about 125% better performance # On windows using 65536 gives the same performance for some reason, which is interesting # But any other value gives a bit better performance, for example 65536 * 2 gives about 120% better performance await reader.read(65536 * 2) print(f'{time.time() - start}') async def main(): server = await asyncio.start_server(client_connected, '127.0.0.1', 8888, global_buffer=True) addr = server.sockets[0].getsockname() print(f'Serving on {addr}') async with server: await server.serve_forever() if __name__ == "__main__": asyncio.run(main()) client.py: import asyncio import contextlib async def flood(ip, port): message = b'A' * 1024 * 64 # tweak this parameter as much as you want reader, writer = await asyncio.open_connection(ip, port) with contextlib.closing(writer): while True: writer.write(message) await writer.drain() if __name__ == "__main__": asyncio.run(flood('127.0.0.1', 8888))

Open Graph Description: https://bugs.python.org/issue41279 I got way better performance on await reader.read() using this branch on linux (check out the chart on the server.py script's comments). The way I tested was...

X Description: https://bugs.python.org/issue41279 I got way better performance on await reader.read() using this branch on linux (check out the chart on the server.py script's comments). The way I tested...

Opengraph URL: https://github.com/python/cpython/pull/21446

X: @github

direct link

Domain: github.com

Links:

Viewport: width=device-width