René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"base64.b85encode uses significant amount of RAM","articleBody":"# Bug report\r\n\r\nOn the same string:\r\n - b64encode: RAM: 604MB, CPU: 79%, Time taken: 1.18sec and gave a result\r\n - b85encode: RAM: 6.9GB, CPU: 64%, Time taken: 45sec and crashed due to insufficient RAM (most likely)\r\n\r\nb85encode takes up my entire RAM and crashes\r\n\r\nOn IPython:\r\n```\r\nIn [1]: import base64\r\n\r\nIn [2]: contents = b'a' * 250 * 1024 * 1024\r\n\r\nIn [3]: %time len(base64.b64encode(contents).decode(\"ascii\")) / 1024 / 1024\r\nCPU times: user 489 ms, sys: 414 ms, total: 904 ms\r\nWall time: 974 ms\r\nOut[3]: 333.33333587646484\r\n\r\nIn [4]: %time len(base64.b85encode(contents).decode(\"ascii\")) / 1024 / 1024\r\nKilled\r\n```\r\n\r\nHere is the GNU time stats:\r\n```\r\n$ /usr/bin/time /opt/python3.9/bin/python -c \"import base64; print(len(base64.b64encode(b'a' * 250 * 1024 * 1024)) / 1024 / 1024)\"\r\n333.33333587646484\r\n0.55user 0.39system 0:01.18elapsed 79%CPU (0avgtext+0avgdata 604008maxresident)k\r\n0inputs+0outputs (0major+151155minor)pagefaults 0swaps\r\n\r\n$ /usr/bin/time /opt/python3.9/bin/python -c \"import base64; print(len(base64.b85encode(b'a' * 250 * 1024 * 1024)) / 1024 / 1024)\"\r\n26.08user 3.39system 0:45.86elapsed 64%CPU (0avgtext+0avgdata 6966080maxresident)k\r\n512inputs+0outputs (2major+1756895minor)pagefaults 0swaps\r\n```\r\n\r\nI have gotten same results in Python 3.6, 3.7, 3.8, 3.9\r\n\r\n# Your environment\r\n\r\n- CPython versions tested on: Python 3.9 installed with miniconda\r\n- Operating system and architecture: CentOS 7, AWS t3.large machine\r\n\r\n\n\n\u003c!-- gh-linked-prs --\u003e\n### Linked PRs\n* gh-102753\n* gh-112248\n\u003c!-- /gh-linked-prs --\u003e\n","author":{"url":"https://github.com/AbdealiLoKo","@type":"Person","name":"AbdealiLoKo"},"datePublished":"2023-01-20T06:27:42.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":4},"url":"https://github.com/101178/cpython/issues/101178"}