René's URL Explorer Experiment

Title: GitHub - microsoft/BitNet: Official inference framework for 1-bit LLMs

Open Graph Title: GitHub - microsoft/BitNet: Official inference framework for 1-bit LLMs

X Title: GitHub - microsoft/BitNet: Official inference framework for 1-bit LLMs

Description: Official inference framework for 1-bit LLMs. Contribute to microsoft/BitNet development by creating an account on GitHub.

Open Graph Description: Official inference framework for 1-bit LLMs. Contribute to microsoft/BitNet development by creating an account on GitHub.

X Description: Official inference framework for 1-bit LLMs. Contribute to microsoft/BitNet development by creating an account on GitHub.

Opengraph URL: https://github.com/microsoft/BitNet

X: @github

direct link

Domain: patch-diff.githubusercontent.com

route-pattern	/:user_id/:repository
route-controller	files
route-action	disambiguate
fetch-nonce	v2:850f0e28-0ee4-2c61-d200-e0ca146f6066
current-catalog-service-hash	f3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-id	87CC:373734:2AAF24:3BC0FD:6970A4E4
html-safe-nonce	1fbf3551678ddfcb166e69dfa01876138b2ad14e79b04ad39971c37b75978e58
visitor-payload	eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI4N0NDOjM3MzczNDoyQUFGMjQ6M0JDMEZEOjY5NzBBNEU0IiwidmlzaXRvcl9pZCI6IjUwMDU0NzMwMTczMDc4OTkxMDgiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmac	5090895dc5fb1d1cb6cedfdc4775eee32239a219e70b7ee36df443f860e36716
hovercard-subject-tag	repository:838253246
github-keyboard-shortcuts	repository,copilot
google-site-verification	Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-url	https://collector.github.com/github/collect
analytics-location	//
fb:app_id	1401488693436528
apple-itunes-app	app-id=1477376905, app-argument=https://github.com/microsoft/BitNet
twitter:image	https://opengraph.githubassets.com/ed7c60bf32136312e76166fb6bff527f5abc6c79bda920e9541886e1d9917fb1/microsoft/BitNet
twitter:card	summary_large_image
og:image	https://opengraph.githubassets.com/ed7c60bf32136312e76166fb6bff527f5abc6c79bda920e9541886e1d9917fb1/microsoft/BitNet
og:image:alt	Official inference framework for 1-bit LLMs. Contribute to microsoft/BitNet development by creating an account on GitHub.
og:image:width	1200
og:image:height	600
og:site_name	GitHub
og:type	object
hostname	github.com
expected-hostname	github.com
None	b06a4c45c45fd0bb038b3759265ea6e38211f45d18130bc65261990be6b5972a
turbo-cache-control	no-preview
go-import	github.com/microsoft/BitNet git https://github.com/microsoft/BitNet.git
octolytics-dimension-user_id	6154722
octolytics-dimension-user_login	microsoft
octolytics-dimension-repository_id	838253246
octolytics-dimension-repository_nwo	microsoft/BitNet
octolytics-dimension-repository_public	true
octolytics-dimension-repository_is_fork	false
octolytics-dimension-repository_network_root_id	838253246
octolytics-dimension-repository_network_root_nwo	microsoft/BitNet
turbo-body-classes	logged-out env-production page-responsive
disable-turbo	false
browser-stats-url	https://api.github.com/_private/browser/stats
browser-errors-url	https://api.github.com/_private/browser/errors
release	0e1c4964831785bd64cb22d82e7cf2391ae01f45
ui-target	full
theme-color	#1e2327
color-scheme	light dark

Links:

Skip to content	https://patch-diff.githubusercontent.com/microsoft/BitNet#start-of-content
	https://patch-diff.githubusercontent.com/
Sign in	https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Fmicrosoft%2FBitNet
GitHub CopilotWrite better code with AI	https://github.com/features/copilot
GitHub SparkBuild and deploy intelligent apps	https://github.com/features/spark
GitHub ModelsManage and compare prompts	https://github.com/features/models
MCP RegistryNewIntegrate external tools	https://github.com/mcp
ActionsAutomate any workflow	https://github.com/features/actions
CodespacesInstant dev environments	https://github.com/features/codespaces
IssuesPlan and track work	https://github.com/features/issues
Code ReviewManage code changes	https://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilities	https://github.com/security/advanced-security
Code securitySecure your code as you build	https://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they start	https://github.com/security/advanced-security/secret-protection
Why GitHub	https://github.com/why-github
Documentation	https://docs.github.com
Blog	https://github.blog
Changelog	https://github.blog/changelog
Marketplace	https://github.com/marketplace
View all features	https://github.com/features
Enterprises	https://github.com/enterprise
Small and medium teams	https://github.com/team
Startups	https://github.com/enterprise/startups
Nonprofits	https://github.com/solutions/industry/nonprofits
App Modernization	https://github.com/solutions/use-case/app-modernization
DevSecOps	https://github.com/solutions/use-case/devsecops
DevOps	https://github.com/solutions/use-case/devops
CI/CD	https://github.com/solutions/use-case/ci-cd
View all use cases	https://github.com/solutions/use-case
Healthcare	https://github.com/solutions/industry/healthcare
Financial services	https://github.com/solutions/industry/financial-services
Manufacturing	https://github.com/solutions/industry/manufacturing
Government	https://github.com/solutions/industry/government
View all industries	https://github.com/solutions/industry
View all solutions	https://github.com/solutions
AI	https://github.com/resources/articles?topic=ai
Software Development	https://github.com/resources/articles?topic=software-development
DevOps	https://github.com/resources/articles?topic=devops
Security	https://github.com/resources/articles?topic=security
View all topics	https://github.com/resources/articles
Customer stories	https://github.com/customer-stories
Events & webinars	https://github.com/resources/events
Ebooks & reports	https://github.com/resources/whitepapers
Business insights	https://github.com/solutions/executive-insights
GitHub Skills	https://skills.github.com
Documentation	https://docs.github.com
Customer support	https://support.github.com
Community forum	https://github.com/orgs/community/discussions
Trust center	https://github.com/trust-center
Partners	https://github.com/partners
GitHub SponsorsFund open source developers	https://github.com/sponsors
Security Lab	https://securitylab.github.com
Maintainer Community	https://maintainers.github.com
Accelerator	https://github.com/accelerator
Archive Program	https://archiveprogram.github.com
Topics	https://github.com/topics
Trending	https://github.com/trending
Collections	https://github.com/collections
Enterprise platformAI-powered developer platform	https://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security features	https://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI features	https://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 support	https://github.com/premium-support
Pricing	https://github.com/pricing
Search syntax tips	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentation	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in	https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Fmicrosoft%2FBitNet
Sign up	https://patch-diff.githubusercontent.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=microsoft%2FBitNet
Reload	https://patch-diff.githubusercontent.com/microsoft/BitNet
Reload	https://patch-diff.githubusercontent.com/microsoft/BitNet
Reload	https://patch-diff.githubusercontent.com/microsoft/BitNet
microsoft	https://patch-diff.githubusercontent.com/microsoft
BitNet	https://patch-diff.githubusercontent.com/microsoft/BitNet
Notifications	https://patch-diff.githubusercontent.com/login?return_to=%2Fmicrosoft%2FBitNet
Fork 2.1k	https://patch-diff.githubusercontent.com/login?return_to=%2Fmicrosoft%2FBitNet
Star 25.8k	https://patch-diff.githubusercontent.com/login?return_to=%2Fmicrosoft%2FBitNet
MIT license	https://patch-diff.githubusercontent.com/microsoft/BitNet/blob/main/LICENSE
25.8k stars	https://patch-diff.githubusercontent.com/microsoft/BitNet/stargazers
2.1k forks	https://patch-diff.githubusercontent.com/microsoft/BitNet/forks
Branches	https://patch-diff.githubusercontent.com/microsoft/BitNet/branches
Tags	https://patch-diff.githubusercontent.com/microsoft/BitNet/tags
Activity	https://patch-diff.githubusercontent.com/microsoft/BitNet/activity
Star	https://patch-diff.githubusercontent.com/login?return_to=%2Fmicrosoft%2FBitNet
Notifications	https://patch-diff.githubusercontent.com/login?return_to=%2Fmicrosoft%2FBitNet
Code	https://patch-diff.githubusercontent.com/microsoft/BitNet
Issues 144	https://patch-diff.githubusercontent.com/microsoft/BitNet/issues
Pull requests 38	https://patch-diff.githubusercontent.com/microsoft/BitNet/pulls
Discussions	https://patch-diff.githubusercontent.com/microsoft/BitNet/discussions
Actions	https://patch-diff.githubusercontent.com/microsoft/BitNet/actions
Projects 0	https://patch-diff.githubusercontent.com/microsoft/BitNet/projects
Models	https://patch-diff.githubusercontent.com/microsoft/BitNet/models
Security Uh oh! There was an error while loading. Please reload this page.	https://patch-diff.githubusercontent.com/microsoft/BitNet/security
Please reload this page	https://patch-diff.githubusercontent.com/microsoft/BitNet
Insights	https://patch-diff.githubusercontent.com/microsoft/BitNet/pulse
Code	https://patch-diff.githubusercontent.com/microsoft/BitNet
Issues	https://patch-diff.githubusercontent.com/microsoft/BitNet/issues
Pull requests	https://patch-diff.githubusercontent.com/microsoft/BitNet/pulls
Discussions	https://patch-diff.githubusercontent.com/microsoft/BitNet/discussions
Actions	https://patch-diff.githubusercontent.com/microsoft/BitNet/actions
Projects	https://patch-diff.githubusercontent.com/microsoft/BitNet/projects
Models	https://patch-diff.githubusercontent.com/microsoft/BitNet/models
Security	https://patch-diff.githubusercontent.com/microsoft/BitNet/security
Insights	https://patch-diff.githubusercontent.com/microsoft/BitNet/pulse
Branches	https://patch-diff.githubusercontent.com/microsoft/BitNet/branches
Tags	https://patch-diff.githubusercontent.com/microsoft/BitNet/tags
	https://patch-diff.githubusercontent.com/microsoft/BitNet/branches
	https://patch-diff.githubusercontent.com/microsoft/BitNet/tags
76 Commits	https://patch-diff.githubusercontent.com/microsoft/BitNet/commits/main/
	https://patch-diff.githubusercontent.com/microsoft/BitNet/commits/main/
3rdparty	https://patch-diff.githubusercontent.com/microsoft/BitNet/tree/main/3rdparty
3rdparty	https://patch-diff.githubusercontent.com/microsoft/BitNet/tree/main/3rdparty
assets	https://patch-diff.githubusercontent.com/microsoft/BitNet/tree/main/assets
assets	https://patch-diff.githubusercontent.com/microsoft/BitNet/tree/main/assets
docs	https://patch-diff.githubusercontent.com/microsoft/BitNet/tree/main/docs
docs	https://patch-diff.githubusercontent.com/microsoft/BitNet/tree/main/docs
gpu	https://patch-diff.githubusercontent.com/microsoft/BitNet/tree/main/gpu
gpu	https://patch-diff.githubusercontent.com/microsoft/BitNet/tree/main/gpu
include	https://patch-diff.githubusercontent.com/microsoft/BitNet/tree/main/include
include	https://patch-diff.githubusercontent.com/microsoft/BitNet/tree/main/include
media	https://patch-diff.githubusercontent.com/microsoft/BitNet/tree/main/media
media	https://patch-diff.githubusercontent.com/microsoft/BitNet/tree/main/media
preset_kernels	https://patch-diff.githubusercontent.com/microsoft/BitNet/tree/main/preset_kernels
preset_kernels	https://patch-diff.githubusercontent.com/microsoft/BitNet/tree/main/preset_kernels
src	https://patch-diff.githubusercontent.com/microsoft/BitNet/tree/main/src
src	https://patch-diff.githubusercontent.com/microsoft/BitNet/tree/main/src
utils	https://patch-diff.githubusercontent.com/microsoft/BitNet/tree/main/utils
utils	https://patch-diff.githubusercontent.com/microsoft/BitNet/tree/main/utils
.gitignore	https://patch-diff.githubusercontent.com/microsoft/BitNet/blob/main/.gitignore
.gitignore	https://patch-diff.githubusercontent.com/microsoft/BitNet/blob/main/.gitignore
.gitmodules	https://patch-diff.githubusercontent.com/microsoft/BitNet/blob/main/.gitmodules
.gitmodules	https://patch-diff.githubusercontent.com/microsoft/BitNet/blob/main/.gitmodules
CMakeLists.txt	https://patch-diff.githubusercontent.com/microsoft/BitNet/blob/main/CMakeLists.txt
CMakeLists.txt	https://patch-diff.githubusercontent.com/microsoft/BitNet/blob/main/CMakeLists.txt
CODE_OF_CONDUCT.md	https://patch-diff.githubusercontent.com/microsoft/BitNet/blob/main/CODE_OF_CONDUCT.md
CODE_OF_CONDUCT.md	https://patch-diff.githubusercontent.com/microsoft/BitNet/blob/main/CODE_OF_CONDUCT.md
LICENSE	https://patch-diff.githubusercontent.com/microsoft/BitNet/blob/main/LICENSE
LICENSE	https://patch-diff.githubusercontent.com/microsoft/BitNet/blob/main/LICENSE
README.md	https://patch-diff.githubusercontent.com/microsoft/BitNet/blob/main/README.md
README.md	https://patch-diff.githubusercontent.com/microsoft/BitNet/blob/main/README.md
SECURITY.md	https://patch-diff.githubusercontent.com/microsoft/BitNet/blob/main/SECURITY.md
SECURITY.md	https://patch-diff.githubusercontent.com/microsoft/BitNet/blob/main/SECURITY.md
requirements.txt	https://patch-diff.githubusercontent.com/microsoft/BitNet/blob/main/requirements.txt
requirements.txt	https://patch-diff.githubusercontent.com/microsoft/BitNet/blob/main/requirements.txt
run_inference.py	https://patch-diff.githubusercontent.com/microsoft/BitNet/blob/main/run_inference.py
run_inference.py	https://patch-diff.githubusercontent.com/microsoft/BitNet/blob/main/run_inference.py
run_inference_server.py	https://patch-diff.githubusercontent.com/microsoft/BitNet/blob/main/run_inference_server.py
run_inference_server.py	https://patch-diff.githubusercontent.com/microsoft/BitNet/blob/main/run_inference_server.py
setup_env.py	https://patch-diff.githubusercontent.com/microsoft/BitNet/blob/main/setup_env.py
setup_env.py	https://patch-diff.githubusercontent.com/microsoft/BitNet/blob/main/setup_env.py
README	https://patch-diff.githubusercontent.com/microsoft/BitNet
Code of conduct	https://patch-diff.githubusercontent.com/microsoft/BitNet
MIT license	https://patch-diff.githubusercontent.com/microsoft/BitNet
Security	https://patch-diff.githubusercontent.com/microsoft/BitNet
	https://patch-diff.githubusercontent.com/microsoft/BitNet#bitnetcpp
	https://opensource.org/licenses/MIT
	https://camo.githubusercontent.com/ac0e6350bd1a747fd6c3ffa64781612d3997df0c837a082a30d7af82a79ee225/68747470733a2f2f696d672e736869656c64732e696f2f62616467652f76657273696f6e2d312e302d626c7565
	https://huggingface.co/microsoft/BitNet-b1.58-2B-4T
demo	https://bitnet-demo.azurewebsites.net/
CPU	https://github.com/microsoft/BitNet?tab=readme-ov-file#build-from-source
GPU	https://github.com/microsoft/BitNet/blob/main/gpu/README.md
technical report	https://arxiv.org/abs/2410.16144
	https://patch-diff.githubusercontent.com/microsoft/BitNet/blob/main/assets/m2_performance.jpg
	https://patch-diff.githubusercontent.com/microsoft/BitNet/blob/main/assets/intel_performance.jpg
	https://patch-diff.githubusercontent.com/microsoft/BitNet#demo
	https://patch-diff.githubusercontent.com/microsoft/BitNet#whats-new
BitNet Official GPU inference kernel	https://github.com/microsoft/BitNet/blob/main/gpu/README.md
	https://camo.githubusercontent.com/78f781c13c1240ba64b2be628840d5f7da48faa1ca3ea8a6648e01238e07e0b2/68747470733a2f2f696d672e736869656c64732e696f2f62616467652f4e45572d726564
BitNet Official 2B Parameter Model on Hugging Face	https://huggingface.co/microsoft/BitNet-b1.58-2B-4T
Bitnet.cpp: Efficient Edge Inference for Ternary LLMs	https://arxiv.org/abs/2502.11880
BitNet a4.8: 4-bit Activations for 1-bit LLMs	https://arxiv.org/abs/2411.04965
1-bit AI Infra: Part 1.1, Fast and Lossless BitNet b1.58 Inference on CPUs	https://arxiv.org/abs/2410.16144
The-Era-of-1-bit-LLMs__Training_Tips_Code_FAQ	https://github.com/microsoft/unilm/blob/master/bitnet/The-Era-of-1-bit-LLMs__Training_Tips_Code_FAQ.pdf
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits	https://arxiv.org/abs/2402.17764
BitNet: Scaling 1-bit Transformers for Large Language Models	https://arxiv.org/abs/2310.11453
	https://patch-diff.githubusercontent.com/microsoft/BitNet#acknowledgements
llama.cpp	https://github.com/ggerganov/llama.cpp
T-MAC	https://github.com/microsoft/T-MAC/
	https://patch-diff.githubusercontent.com/microsoft/BitNet#official-models
BitNet-b1.58-2B-4T	https://huggingface.co/microsoft/BitNet-b1.58-2B-4T
	https://patch-diff.githubusercontent.com/microsoft/BitNet#supported-models
Hugging Face	https://huggingface.co/
bitnet_b1_58-large	https://huggingface.co/1bitLLM/bitnet_b1_58-large
bitnet_b1_58-3B	https://huggingface.co/1bitLLM/bitnet_b1_58-3B
Llama3-8B-1.58-100B-tokens	https://huggingface.co/HF1BitLLM/Llama3-8B-1.58-100B-tokens
Falcon3 Family	https://huggingface.co/collections/tiiuae/falcon3-67605ae03578be86e4e87026
Falcon-E Family	https://huggingface.co/collections/tiiuae/falcon-edge-series-6804fd13344d6d8a8fa71130
	https://patch-diff.githubusercontent.com/microsoft/BitNet#installation
	https://patch-diff.githubusercontent.com/microsoft/BitNet#requirements
Visual Studio 2022	https://visualstudio.microsoft.com/downloads/
Automatic installation script	https://apt.llvm.org/
	https://patch-diff.githubusercontent.com/microsoft/BitNet#build-from-source
	https://patch-diff.githubusercontent.com/microsoft/BitNet#usage
	https://patch-diff.githubusercontent.com/microsoft/BitNet#basic-usage
	https://patch-diff.githubusercontent.com/microsoft/BitNet#benchmark
	https://patch-diff.githubusercontent.com/microsoft/BitNet#convert-from-safetensors-checkpoints
	https://patch-diff.githubusercontent.com/microsoft/BitNet#faq-frequently-asked-questions
	https://patch-diff.githubusercontent.com/microsoft/BitNet#q1-the-build-dies-with-errors-building-llamacpp-due-to-issues-with-stdchrono-in-logcpp
commit	https://github.com/tinglou/llama.cpp/commit/4e3db1e3d78cc1bcd22bcb3af54bd2a4628dd323
discussion	https://github.com/abetlen/llama-cpp-python/issues/1942
	https://patch-diff.githubusercontent.com/microsoft/BitNet#q2-how-to-build-with-clang-in-conda-environment-on-windows
Readme	https://patch-diff.githubusercontent.com/microsoft/BitNet#readme-ov-file
MIT license	https://patch-diff.githubusercontent.com/microsoft/BitNet#MIT-1-ov-file
Code of conduct	https://patch-diff.githubusercontent.com/microsoft/BitNet#coc-ov-file
Security policy	https://patch-diff.githubusercontent.com/microsoft/BitNet#security-ov-file
Please reload this page	https://patch-diff.githubusercontent.com/microsoft/BitNet
Activity	https://patch-diff.githubusercontent.com/microsoft/BitNet/activity
Custom properties	https://patch-diff.githubusercontent.com/microsoft/BitNet/custom-properties
25.8k stars	https://patch-diff.githubusercontent.com/microsoft/BitNet/stargazers
232 watching	https://patch-diff.githubusercontent.com/microsoft/BitNet/watchers
2.1k forks	https://patch-diff.githubusercontent.com/microsoft/BitNet/forks
Report repository	https://patch-diff.githubusercontent.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Fmicrosoft%2FBitNet&report=microsoft+%28user%29
Releases	https://patch-diff.githubusercontent.com/microsoft/BitNet/releases
Packages 0	https://patch-diff.githubusercontent.com/orgs/microsoft/packages?repo_name=BitNet
Please reload this page	https://patch-diff.githubusercontent.com/microsoft/BitNet
Contributors 14	https://patch-diff.githubusercontent.com/microsoft/BitNet/graphs/contributors
	https://github.com/potassiummmm
	https://github.com/younesbelkada
	https://github.com/tsong-ms
	https://github.com/dawnmsg
	https://github.com/sd983527
	https://github.com/JCGoran
	https://github.com/junhuihe-hjh
	https://github.com/Eddie-Wang1120
	https://github.com/shumingma
	https://github.com/Benjamin-Wegener
	https://github.com/lfoppiano
	https://github.com/jasondavies
	https://github.com/deiteris
	https://github.com/MrEcco
Python 50.5%	https://patch-diff.githubusercontent.com/microsoft/BitNet/search?l=python
C++ 48.5%	https://patch-diff.githubusercontent.com/microsoft/BitNet/search?l=c%2B%2B
	https://github.com
Terms	https://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacy	https://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Security	https://github.com/security
Status	https://www.githubstatus.com/
Community	https://github.community/
Docs	https://docs.github.com/
Contact	https://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.