René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"WHLs for cuda 11.7, 11.8, and 12.0 for future Releases","articleBody":"Currently the bitblas whl support is too limited \u003e= 12.1.  I understand that building so many whl/python/torch combos is a headache but I think it may be worth it.\r\n\r\nInclude support for all Cuda supported by Torch \u003e= 2.0.0 which need to add 11.7, 11.8, and 12.0 to the WHL builds. \r\n\r\nReasons:\r\n\r\n1. Lots of gpu-poor academics are locked to institution provided envs where drivers are often locked to cuda 11.7, 11.8 version. \r\n2. Compiling bitblas has large os lib dependency and a simple git clone + build is not possible even on ubuntu without adding ubuntu pkgs. But if env is not ubuntu the problem becomes quite a problem for users that has no clue about builds.\r\n3. Allow 3rd party to fully embed Bitblas without raising Torch/Cuda requirements. GPTQModel, for example, has integrated bitblas right now as a non-optional integration but need to add cuda checks for pkg compat and redirect users to src compile during runtime.\r\n\r\n```[tasklist]\r\n### Tasks\r\n- [x] Append cuda 11.7, 11.8, and 12.0 for future Releases\r\n```\r\n","author":{"url":"https://github.com/Qubitium","@type":"Person","name":"Qubitium"},"datePublished":"2024-06-26T12:01:42.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":5},"url":"https://github.com/62/BitBLAS/issues/62"}