René's URL Explorer Experiment

Title: gh-146192: Add base32 support to binascii by kangtastic · Pull Request #146193 · python/cpython · GitHub

Open Graph Title: gh-146192: Add base32 support to binascii by kangtastic · Pull Request #146193 · python/cpython

X Title: gh-146192: Add base32 support to binascii by kangtastic · Pull Request #146193 · python/cpython

Description: Synopsis Add base32 encoder and decoder functions implemented in C to binascii and use them to greatly improve the performance and reduce the memory usage of the existing base32 codec functions in base64. No API or documentation changes are necessary with respect to any functions in base64, and all existing unit tests for those functions continue to pass without modification. Resolves: gh-146192 Discussion The base32-related functions in base64 are now wrappers for the new functions in binascii, as envisioned in the docs: The binascii module contains a number of methods to convert between binary and various ASCII-encoded binary representations. Normally, you will not use these functions directly but use wrapper modules like uu or base64 instead. The binascii module contains low-level functions written in C for greater speed that are used by the higher-level modules. Comments and questions are welcome. Benchmarks Benchmark script # bench_b32.py # Note: Can be EXTREMELY SLOW on unmodified mainline CPython. import base64 import sys import timeit import tracemalloc funcs = [(base64.b64encode, base64.b64decode), # sanity check/comparison (base64.b32encode, base64.b32decode), (base64.b32hexencode, base64.b32hexdecode)] def mb(n): return f"{n / 1024 / 1024:.3f}" def stats(func, data, t, m): name, n, bps = func.__qualname__, len(data), len(data) / t print(f"{name:<16}{n:<16}{t:<11.3f}{mb(bps):<13}{mb(m)}") if __name__ == "__main__": print(f"Python {sys.version}\n") print(f"function processed (b) time (s) avg (MB/s) mem (MB)\n") data = b"a" * int(sys.argv[1]) * 1024 * 1024 for fenc, fdec in funcs: tracemalloc.start() enc = fenc(data) menc = tracemalloc.get_traced_memory()[1] - len(enc) tracemalloc.stop() tenc = timeit.timeit("fenc(data)", number=1, globals=globals()) stats(fenc, data, tenc, menc) tracemalloc.start() dec = fenc(enc) mdec = tracemalloc.get_traced_memory()[1] - len(dec) tracemalloc.stop() tdec = timeit.timeit("fdec(enc)", number=1, globals=globals()) stats(fdec, enc, tdec, mdec) Unmodified mainline CPython $ ./python bench_b32.py 16 Python 3.15.0a7+ (heads/main:d357a7dbf38, Mar 19 2026, 23:22:25) [GCC 15.2.0] function processed (b) time (s) avg (MB/s) mem (MB) b64encode 16777216 0.015 1088.370 0.000 b64decode 22369624 0.017 1264.389 0.000 b32encode 16777216 2.308 6.933 17.382 b32decode 26843552 3.389 7.553 27.787 b32hexencode 16777216 2.338 6.843 17.379 b32hexdecode 26843552 3.388 7.557 27.787 With this PR $ ./python bench_b32.py 16 Python 3.15.0a7+ (heads/base32-accel:72fd0f0302a, Mar 20 2026, 00:04:23) [GCC 15.2.0] function processed (b) time (s) avg (MB/s) mem (MB) b64encode 16777216 0.015 1084.957 0.000 b64decode 22369624 0.016 1363.524 0.000 b32encode 16777216 0.017 967.528 0.000 b32decode 26843552 0.016 1581.002 0.000 b32hexencode 16777216 0.016 995.277 0.000 b32hexdecode 26843552 0.016 1588.353 0.000 Encoding performance is improved by ~150x, decoding performance is improved by ~200x, and no auxiliary memory is used. 📚 Documentation preview 📚: https://cpython-previews--146193.org.readthedocs.build/

Open Graph Description: Synopsis Add base32 encoder and decoder functions implemented in C to binascii and use them to greatly improve the performance and reduce the memory usage of the existing base32 codec functions in ...

X Description: Synopsis Add base32 encoder and decoder functions implemented in C to binascii and use them to greatly improve the performance and reduce the memory usage of the existing base32 codec functions in ...

Opengraph URL: https://github.com/python/cpython/pull/146193

X: @github

direct link

Domain: github.com

Links:

Viewport: width=device-width