René's URL Explorer Experiment

Title: GitHub - DT-Foss/BitNet: Official inference framework for 1-bit LLMs

Open Graph Title: GitHub - DT-Foss/BitNet: Official inference framework for 1-bit LLMs

X Title: GitHub - DT-Foss/BitNet: Official inference framework for 1-bit LLMs

Description: Official inference framework for 1-bit LLMs. Contribute to DT-Foss/BitNet development by creating an account on GitHub.

Open Graph Description: Official inference framework for 1-bit LLMs. Contribute to DT-Foss/BitNet development by creating an account on GitHub.

X Description: Official inference framework for 1-bit LLMs. Contribute to DT-Foss/BitNet development by creating an account on GitHub.

Opengraph URL: https://github.com/DT-Foss/BitNet

X: @github

direct link

Domain: patch-diff.githubusercontent.com

route-pattern	/:user_id/:repository
route-controller	files
route-action	disambiguate
fetch-nonce	v2:bf8b557e-e432-f9ad-1d1b-0e3bd27a9843
current-catalog-service-hash	f3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-id	CC92:1484E9:157698:1C186D:698D5536
html-safe-nonce	23855f0d032ffdf6330a1d1ff41392f8538d36ec5ffd4795180f085ed6f01992
visitor-payload	eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJDQzkyOjE0ODRFOToxNTc2OTg6MUMxODZEOjY5OEQ1NTM2IiwidmlzaXRvcl9pZCI6IjIwMjQ1ODQ3MDI0ODkwODkzMzQiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmac	311def398ddee44dafa3ac1433e5ef7313da1dec346a6ce4e65a219f0bc0d0df
hovercard-subject-tag	repository:1145367035
github-keyboard-shortcuts	repository,copilot
google-site-verification	Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-url	https://collector.github.com/github/collect
analytics-location	//
fb:app_id	1401488693436528
apple-itunes-app	app-id=1477376905, app-argument=https://github.com/DT-Foss/BitNet
twitter:image	https://opengraph.githubassets.com/98c74c48c3ae0ed6c088d98dc704be71de7559d749fd3ead1d82243ad6affd4b/DT-Foss/BitNet
twitter:card	summary_large_image
og:image	https://opengraph.githubassets.com/98c74c48c3ae0ed6c088d98dc704be71de7559d749fd3ead1d82243ad6affd4b/DT-Foss/BitNet
og:image:alt	Official inference framework for 1-bit LLMs. Contribute to DT-Foss/BitNet development by creating an account on GitHub.
og:image:width	1200
og:image:height	600
og:site_name	GitHub
og:type	object
hostname	github.com
expected-hostname	github.com
None	c0818105fa276287e9369cfdefa0a0fa7953719791ceff9b94d69623c0a4fe8a
turbo-cache-control	no-preview
go-import	github.com/DT-Foss/BitNet git https://github.com/DT-Foss/BitNet.git
octolytics-dimension-user_id	248709196
octolytics-dimension-user_login	DT-Foss
octolytics-dimension-repository_id	1145367035
octolytics-dimension-repository_nwo	DT-Foss/BitNet
octolytics-dimension-repository_public	true
octolytics-dimension-repository_is_fork	true
octolytics-dimension-repository_parent_id	838253246
octolytics-dimension-repository_parent_nwo	microsoft/BitNet
octolytics-dimension-repository_network_root_id	838253246
octolytics-dimension-repository_network_root_nwo	microsoft/BitNet
turbo-body-classes	logged-out env-production page-responsive
disable-turbo	false
browser-stats-url	https://api.github.com/_private/browser/stats
browser-errors-url	https://api.github.com/_private/browser/errors
release	a95a17cc440c14d4fcddc0641bc1136fa8d908f0
ui-target	full
theme-color	#1e2327
color-scheme	light dark

Links:

Skip to content	https://patch-diff.githubusercontent.com/DT-Foss/BitNet#start-of-content
	https://patch-diff.githubusercontent.com/
Sign in	https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2FDT-Foss%2FBitNet
GitHub CopilotWrite better code with AI	https://github.com/features/copilot
GitHub SparkBuild and deploy intelligent apps	https://github.com/features/spark
GitHub ModelsManage and compare prompts	https://github.com/features/models
MCP RegistryNewIntegrate external tools	https://github.com/mcp
ActionsAutomate any workflow	https://github.com/features/actions
CodespacesInstant dev environments	https://github.com/features/codespaces
IssuesPlan and track work	https://github.com/features/issues
Code ReviewManage code changes	https://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilities	https://github.com/security/advanced-security
Code securitySecure your code as you build	https://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they start	https://github.com/security/advanced-security/secret-protection
Why GitHub	https://github.com/why-github
Documentation	https://docs.github.com
Blog	https://github.blog
Changelog	https://github.blog/changelog
Marketplace	https://github.com/marketplace
View all features	https://github.com/features
Enterprises	https://github.com/enterprise
Small and medium teams	https://github.com/team
Startups	https://github.com/enterprise/startups
Nonprofits	https://github.com/solutions/industry/nonprofits
App Modernization	https://github.com/solutions/use-case/app-modernization
DevSecOps	https://github.com/solutions/use-case/devsecops
DevOps	https://github.com/solutions/use-case/devops
CI/CD	https://github.com/solutions/use-case/ci-cd
View all use cases	https://github.com/solutions/use-case
Healthcare	https://github.com/solutions/industry/healthcare
Financial services	https://github.com/solutions/industry/financial-services
Manufacturing	https://github.com/solutions/industry/manufacturing
Government	https://github.com/solutions/industry/government
View all industries	https://github.com/solutions/industry
View all solutions	https://github.com/solutions
AI	https://github.com/resources/articles?topic=ai
Software Development	https://github.com/resources/articles?topic=software-development
DevOps	https://github.com/resources/articles?topic=devops
Security	https://github.com/resources/articles?topic=security
View all topics	https://github.com/resources/articles
Customer stories	https://github.com/customer-stories
Events & webinars	https://github.com/resources/events
Ebooks & reports	https://github.com/resources/whitepapers
Business insights	https://github.com/solutions/executive-insights
GitHub Skills	https://skills.github.com
Documentation	https://docs.github.com
Customer support	https://support.github.com
Community forum	https://github.com/orgs/community/discussions
Trust center	https://github.com/trust-center
Partners	https://github.com/partners
GitHub SponsorsFund open source developers	https://github.com/sponsors
Security Lab	https://securitylab.github.com
Maintainer Community	https://maintainers.github.com
Accelerator	https://github.com/accelerator
Archive Program	https://archiveprogram.github.com
Topics	https://github.com/topics
Trending	https://github.com/trending
Collections	https://github.com/collections
Enterprise platformAI-powered developer platform	https://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security features	https://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI features	https://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 support	https://github.com/premium-support
Pricing	https://github.com/pricing
Search syntax tips	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentation	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in	https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2FDT-Foss%2FBitNet
Sign up	https://patch-diff.githubusercontent.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=DT-Foss%2FBitNet
Reload	https://patch-diff.githubusercontent.com/DT-Foss/BitNet
Reload	https://patch-diff.githubusercontent.com/DT-Foss/BitNet
Reload	https://patch-diff.githubusercontent.com/DT-Foss/BitNet
DT-Foss	https://patch-diff.githubusercontent.com/DT-Foss
BitNet	https://patch-diff.githubusercontent.com/DT-Foss/BitNet
microsoft/BitNet	https://patch-diff.githubusercontent.com/microsoft/BitNet
Notifications	https://patch-diff.githubusercontent.com/login?return_to=%2FDT-Foss%2FBitNet
Fork 0	https://patch-diff.githubusercontent.com/login?return_to=%2FDT-Foss%2FBitNet
Star 0	https://patch-diff.githubusercontent.com/login?return_to=%2FDT-Foss%2FBitNet
MIT license	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/blob/main/LICENSE
0 stars	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/stargazers
2.3k forks	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/forks
Branches	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/branches
Tags	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/tags
Activity	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/activity
Star	https://patch-diff.githubusercontent.com/login?return_to=%2FDT-Foss%2FBitNet
Notifications	https://patch-diff.githubusercontent.com/login?return_to=%2FDT-Foss%2FBitNet
Code	https://patch-diff.githubusercontent.com/DT-Foss/BitNet
Pull requests 0	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/pulls
Actions	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/actions
Projects 0	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/projects
Security 0	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/security
Insights	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/pulse
Code	https://patch-diff.githubusercontent.com/DT-Foss/BitNet
Pull requests	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/pulls
Actions	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/actions
Projects	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/projects
Security	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/security
Insights	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/pulse
Branches	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/branches
Tags	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/tags
	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/branches
	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/tags
91 Commits	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/commits/main/
	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/commits/main/
3rdparty	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/tree/main/3rdparty
3rdparty	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/tree/main/3rdparty
assets	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/tree/main/assets
assets	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/tree/main/assets
docs	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/tree/main/docs
docs	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/tree/main/docs
gpu	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/tree/main/gpu
gpu	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/tree/main/gpu
include	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/tree/main/include
include	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/tree/main/include
media	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/tree/main/media
media	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/tree/main/media
preset_kernels	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/tree/main/preset_kernels
preset_kernels	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/tree/main/preset_kernels
src	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/tree/main/src
src	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/tree/main/src
utils	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/tree/main/utils
utils	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/tree/main/utils
.gitignore	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/blob/main/.gitignore
.gitignore	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/blob/main/.gitignore
.gitmodules	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/blob/main/.gitmodules
.gitmodules	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/blob/main/.gitmodules
CMakeLists.txt	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/blob/main/CMakeLists.txt
CMakeLists.txt	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/blob/main/CMakeLists.txt
CODE_OF_CONDUCT.md	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/blob/main/CODE_OF_CONDUCT.md
CODE_OF_CONDUCT.md	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/blob/main/CODE_OF_CONDUCT.md
LICENSE	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/blob/main/LICENSE
LICENSE	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/blob/main/LICENSE
README.md	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/blob/main/README.md
README.md	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/blob/main/README.md
SECURITY.md	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/blob/main/SECURITY.md
SECURITY.md	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/blob/main/SECURITY.md
requirements.txt	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/blob/main/requirements.txt
requirements.txt	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/blob/main/requirements.txt
run_inference.py	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/blob/main/run_inference.py
run_inference.py	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/blob/main/run_inference.py
run_inference_server.py	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/blob/main/run_inference_server.py
run_inference_server.py	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/blob/main/run_inference_server.py
setup_env.py	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/blob/main/setup_env.py
setup_env.py	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/blob/main/setup_env.py
README	https://patch-diff.githubusercontent.com/DT-Foss/BitNet
Code of conduct	https://patch-diff.githubusercontent.com/DT-Foss/BitNet
License	https://patch-diff.githubusercontent.com/DT-Foss/BitNet
Security	https://patch-diff.githubusercontent.com/DT-Foss/BitNet
	https://patch-diff.githubusercontent.com/DT-Foss/BitNet#bitnetcpp
	https://opensource.org/licenses/MIT
	https://camo.githubusercontent.com/ac0e6350bd1a747fd6c3ffa64781612d3997df0c837a082a30d7af82a79ee225/68747470733a2f2f696d672e736869656c64732e696f2f62616467652f76657273696f6e2d312e302d626c7565
	https://huggingface.co/microsoft/BitNet-b1.58-2B-4T
demo	https://bitnet-demo.azurewebsites.net/
CPU	https://github.com/microsoft/BitNet?tab=readme-ov-file#build-from-source
GPU	https://github.com/microsoft/BitNet/blob/main/gpu/README.md
technical report	https://arxiv.org/abs/2410.16144
optimization guide	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/blob/main/src/README.md
	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/blob/main/assets/performance.png
	https://patch-diff.githubusercontent.com/DT-Foss/BitNet#demo
	https://patch-diff.githubusercontent.com/DT-Foss/BitNet#whats-new
BitNet CPU Inference Optimization	https://github.com/microsoft/BitNet/blob/main/src/README.md
	https://camo.githubusercontent.com/78f781c13c1240ba64b2be628840d5f7da48faa1ca3ea8a6648e01238e07e0b2/68747470733a2f2f696d672e736869656c64732e696f2f62616467652f4e45572d726564
BitNet Official GPU inference kernel	https://github.com/microsoft/BitNet/blob/main/gpu/README.md
BitNet Official 2B Parameter Model on Hugging Face	https://huggingface.co/microsoft/BitNet-b1.58-2B-4T
Bitnet.cpp: Efficient Edge Inference for Ternary LLMs	https://arxiv.org/abs/2502.11880
BitNet a4.8: 4-bit Activations for 1-bit LLMs	https://arxiv.org/abs/2411.04965
1-bit AI Infra: Part 1.1, Fast and Lossless BitNet b1.58 Inference on CPUs	https://arxiv.org/abs/2410.16144
The-Era-of-1-bit-LLMs__Training_Tips_Code_FAQ	https://github.com/microsoft/unilm/blob/master/bitnet/The-Era-of-1-bit-LLMs__Training_Tips_Code_FAQ.pdf
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits	https://arxiv.org/abs/2402.17764
BitNet: Scaling 1-bit Transformers for Large Language Models	https://arxiv.org/abs/2310.11453
	https://patch-diff.githubusercontent.com/DT-Foss/BitNet#acknowledgements
llama.cpp	https://github.com/ggerganov/llama.cpp
T-MAC	https://github.com/microsoft/T-MAC/
	https://patch-diff.githubusercontent.com/DT-Foss/BitNet#official-models
BitNet-b1.58-2B-4T	https://huggingface.co/microsoft/BitNet-b1.58-2B-4T
	https://patch-diff.githubusercontent.com/DT-Foss/BitNet#supported-models
Hugging Face	https://huggingface.co/
bitnet_b1_58-large	https://huggingface.co/1bitLLM/bitnet_b1_58-large
bitnet_b1_58-3B	https://huggingface.co/1bitLLM/bitnet_b1_58-3B
Llama3-8B-1.58-100B-tokens	https://huggingface.co/HF1BitLLM/Llama3-8B-1.58-100B-tokens
Falcon3 Family	https://huggingface.co/collections/tiiuae/falcon3-67605ae03578be86e4e87026
Falcon-E Family	https://huggingface.co/collections/tiiuae/falcon-edge-series-6804fd13344d6d8a8fa71130
	https://patch-diff.githubusercontent.com/DT-Foss/BitNet#installation
	https://patch-diff.githubusercontent.com/DT-Foss/BitNet#requirements
Visual Studio 2022	https://visualstudio.microsoft.com/downloads/
Automatic installation script	https://apt.llvm.org/
	https://patch-diff.githubusercontent.com/DT-Foss/BitNet#build-from-source
	https://patch-diff.githubusercontent.com/DT-Foss/BitNet#usage
	https://patch-diff.githubusercontent.com/DT-Foss/BitNet#basic-usage
	https://patch-diff.githubusercontent.com/DT-Foss/BitNet#benchmark
	https://patch-diff.githubusercontent.com/DT-Foss/BitNet#convert-from-safetensors-checkpoints
	https://patch-diff.githubusercontent.com/DT-Foss/BitNet#faq-frequently-asked-questions
	https://patch-diff.githubusercontent.com/DT-Foss/BitNet#q1-the-build-dies-with-errors-building-llamacpp-due-to-issues-with-stdchrono-in-logcpp
commit	https://github.com/tinglou/llama.cpp/commit/4e3db1e3d78cc1bcd22bcb3af54bd2a4628dd323
discussion	https://github.com/abetlen/llama-cpp-python/issues/1942
	https://patch-diff.githubusercontent.com/DT-Foss/BitNet#q2-how-to-build-with-clang-in-conda-environment-on-windows
Readme	https://patch-diff.githubusercontent.com/DT-Foss/BitNet#readme-ov-file
MIT license	https://patch-diff.githubusercontent.com/DT-Foss/BitNet#MIT-1-ov-file
Code of conduct	https://patch-diff.githubusercontent.com/DT-Foss/BitNet#coc-ov-file
Security policy	https://patch-diff.githubusercontent.com/DT-Foss/BitNet#security-ov-file
Please reload this page	https://patch-diff.githubusercontent.com/DT-Foss/BitNet
Activity	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/activity
0 stars	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/stargazers
0 watching	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/watchers
0 forks	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/forks
Report repository	https://patch-diff.githubusercontent.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2FDT-Foss%2FBitNet&report=DT-Foss+%28user%29
Releases	https://patch-diff.githubusercontent.com/DT-Foss/BitNet/releases
Packages 0	https://patch-diff.githubusercontent.com/users/DT-Foss/packages?repo_name=BitNet
	https://github.com
Terms	https://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacy	https://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Security	https://github.com/security
Status	https://www.githubstatus.com/
Community	https://github.community/
Docs	https://docs.github.com/
Contact	https://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.