René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"RFC: Statically link to cudart","articleBody":"Currently CUDA Python has a Cython-based reimplementation of CUDA runtime on top of the CUDA driver APIs. This is significant effort in terms of maintenance, requiring a lot of engineering time, as we have to catch up with every new cudart APIs indefinitely. \n\nThis RFC reflects the team's plan that we will switch to statically linking to cudart on all platforms (Linux & Windows) instead, starting from the next CUDA major release. That is, for `cuda-python` X.Y.Z we statically link to `libcudart_static.a` on Linux (or `cudart_static.lib` on Windows) from CUDA Toolkit X.Y.Z.\n\nBy doing this, the benefits include:\n- We can remove tens of thousands of lines of Cython code\n- We can avoid chasing indefinitely after latest cudart APIs\n- We can avoid potential possibilities of misaligned reimplementation, in favor of directly using the \"official\" cudart implementation\n- We can reduce significantly the build time of cuda-python wheels and conda packages\n- We continue offering CUDA minor version compatibility as well as all other functionalities and expectations that the current implementation offers, e.g.\n   - We align with the expectation of normal CUDA applications compiled by NVCC that cudart is statically linked into the executable\n   - Additional context: https://github.com/NVIDIA/cuda-python/issues/16#issuecomment-1774395711\n\nPlease let us know if this could be a concern to your project, as we do not anticipate any issue or any user-visible effects. Thanks!","author":{"url":"https://github.com/leofang","@type":"Person","name":"leofang"},"datePublished":"2024-09-11T03:10:02Z","url":"https://github.com/NVIDIA/cuda-python/issues/100"}