René's URL Explorer Experiment

Title: quantization · GitHub Topics · GitHub

Open Graph Title: Build software better, together

X Title: GitHub

Description: GitHub is where people build software. More than 150 million people use GitHub to discover, fork, and contribute to over 420 million projects.

Open Graph Description: GitHub is where people build software. More than 150 million people use GitHub to discover, fork, and contribute to over 420 million projects.

X Description: GitHub is where people build software. More than 150 million people use GitHub to discover, fork, and contribute to over 420 million projects.

Opengraph URL: https://github.com

X: github

direct link

Domain: patch-diff.githubusercontent.com

route-pattern	/topics/:topic_name(.:format)
route-controller	topics
route-action	show
fetch-nonce	v2:d1c5cb23-7ad6-9a7b-88cb-5c59dcdb104e
current-catalog-service-hash	82c569b93da5c18ed649ebd4c2c79437db4611a6a1373e805a3cb001c64130b7
request-id	C4B2:193CDB:3C86129:4F64933:696BA6CE
html-safe-nonce	7e1b826614ed418b2ecd8a236d325659890d15e7c1874ec46b9da83fd08ffbbe
visitor-payload	eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJDNEIyOjE5M0NEQjozQzg2MTI5OjRGNjQ5MzM6Njk2QkE2Q0UiLCJ2aXNpdG9yX2lkIjoiNjcxNzQzMDIzMTEyMDcxNzUxOCIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmac	2b83372c108c4af65949b073fc9436b0542bd2667d32496961cd189e562092f6
github-keyboard-shortcuts	copilot
google-site-verification	Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-url	https://collector.github.com/github/collect
fb:app_id	1401488693436528
apple-itunes-app	app-id=1477376905, app-argument=https://github.com/topics/quantization
og:site_name	GitHub
og:image	https://github.githubassets.com/assets/github-octocat-13c86b8b336d.png
og:image:type	image/png
og:image:width	1200
og:image:height	620
twitter:site:id	13334762
twitter:creator	github
twitter:creator:id	13334762
twitter:card	summary_large_image
twitter:image	https://github.githubassets.com/assets/github-logo-55c5b9a1fe52.png
twitter:image:width	1200
twitter:image:height	1200
hostname	github.com
expected-hostname	github.com
None	5f99f7c1d70f01da5b93e5ca90303359738944d8ab470e396496262c66e60b8d
turbo-cache-control	no-preview
turbo-body-classes	logged-out env-production page-responsive
disable-turbo	false
browser-stats-url	https://api.github.com/_private/browser/stats
browser-errors-url	https://api.github.com/_private/browser/errors
release	82560a55c6b2054555076f46e683151ee28a19bc
ui-target	full
theme-color	#1e2327
color-scheme	light dark

Links:

Skip to content	https://patch-diff.githubusercontent.com/topics/quantization#start-of-content
	https://patch-diff.githubusercontent.com/
Sign in	https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Ftopics%2Fquantization
GitHub CopilotWrite better code with AI	https://github.com/features/copilot
GitHub SparkBuild and deploy intelligent apps	https://github.com/features/spark
GitHub ModelsManage and compare prompts	https://github.com/features/models
MCP RegistryNewIntegrate external tools	https://github.com/mcp
ActionsAutomate any workflow	https://github.com/features/actions
CodespacesInstant dev environments	https://github.com/features/codespaces
IssuesPlan and track work	https://github.com/features/issues
Code ReviewManage code changes	https://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilities	https://github.com/security/advanced-security
Code securitySecure your code as you build	https://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they start	https://github.com/security/advanced-security/secret-protection
Why GitHub	https://github.com/why-github
Documentation	https://docs.github.com
Blog	https://github.blog
Changelog	https://github.blog/changelog
Marketplace	https://github.com/marketplace
View all features	https://github.com/features
Enterprises	https://github.com/enterprise
Small and medium teams	https://github.com/team
Startups	https://github.com/enterprise/startups
Nonprofits	https://github.com/solutions/industry/nonprofits
App Modernization	https://github.com/solutions/use-case/app-modernization
DevSecOps	https://github.com/solutions/use-case/devsecops
DevOps	https://github.com/solutions/use-case/devops
CI/CD	https://github.com/solutions/use-case/ci-cd
View all use cases	https://github.com/solutions/use-case
Healthcare	https://github.com/solutions/industry/healthcare
Financial services	https://github.com/solutions/industry/financial-services
Manufacturing	https://github.com/solutions/industry/manufacturing
Government	https://github.com/solutions/industry/government
View all industries	https://github.com/solutions/industry
View all solutions	https://github.com/solutions
AI	https://github.com/resources/articles?topic=ai
Software Development	https://github.com/resources/articles?topic=software-development
DevOps	https://github.com/resources/articles?topic=devops
Security	https://github.com/resources/articles?topic=security
View all topics	https://github.com/resources/articles
Customer stories	https://github.com/customer-stories
Events & webinars	https://github.com/resources/events
Ebooks & reports	https://github.com/resources/whitepapers
Business insights	https://github.com/solutions/executive-insights
GitHub Skills	https://skills.github.com
Documentation	https://docs.github.com
Customer support	https://support.github.com
Community forum	https://github.com/orgs/community/discussions
Trust center	https://github.com/trust-center
Partners	https://github.com/partners
GitHub SponsorsFund open source developers	https://github.com/sponsors
Security Lab	https://securitylab.github.com
Maintainer Community	https://maintainers.github.com
Accelerator	https://github.com/accelerator
Archive Program	https://archiveprogram.github.com
Topics	https://github.com/topics
Trending	https://github.com/trending
Collections	https://github.com/collections
Enterprise platformAI-powered developer platform	https://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security features	https://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI features	https://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 support	https://github.com/premium-support
Pricing	https://github.com/pricing
Search syntax tips	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentation	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in	https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Ftopics%2Fquantization
Sign up	https://patch-diff.githubusercontent.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2Ftopics%2Fquantization&source=header
Reload	https://patch-diff.githubusercontent.com/topics/quantization
Reload	https://patch-diff.githubusercontent.com/topics/quantization
Reload	https://patch-diff.githubusercontent.com/topics/quantization
Explore	https://patch-diff.githubusercontent.com/explore
Topics	https://patch-diff.githubusercontent.com/topics
Trending	https://patch-diff.githubusercontent.com/trending
Collections	https://patch-diff.githubusercontent.com/collections
Events	https://patch-diff.githubusercontent.com/events
GitHub Sponsors	https://patch-diff.githubusercontent.com/sponsors/explore
Star	https://patch-diff.githubusercontent.com/login?return_to=%2Ftopic.quantization
All 1,047	https://github.com/topics/quantization
Python 520	https://github.com/topics/quantization?l=python
Jupyter Notebook 233	https://github.com/topics/quantization?l=jupyter+notebook
C++ 46	https://github.com/topics/quantization?l=c%2B%2B
MATLAB 30	https://github.com/topics/quantization?l=matlab
C 27	https://github.com/topics/quantization?l=c
JavaScript 18	https://github.com/topics/quantization?l=javascript
Java 16	https://github.com/topics/quantization?l=java
Rust 16	https://github.com/topics/quantization?l=rust
HTML 9	https://github.com/topics/quantization?l=html
TypeScript 9	https://github.com/topics/quantization?l=typescript
Most stars	https://patch-diff.githubusercontent.com/topics/quantization?o=desc&s=stars
Fewest stars	https://patch-diff.githubusercontent.com/topics/quantization?o=asc&s=stars
Most forks	https://patch-diff.githubusercontent.com/topics/quantization?o=desc&s=forks
Fewest forks	https://patch-diff.githubusercontent.com/topics/quantization?o=asc&s=forks
Recently updated	https://patch-diff.githubusercontent.com/topics/quantization?o=desc&s=updated
Least recently updated	https://patch-diff.githubusercontent.com/topics/quantization?o=asc&s=updated
	https://patch-diff.githubusercontent.com/hiyouga/LlamaFactory
hiyouga	https://patch-diff.githubusercontent.com/hiyouga
LlamaFactory	https://patch-diff.githubusercontent.com/hiyouga/LlamaFactory
Star 65.9k	https://patch-diff.githubusercontent.com/login?return_to=%2Fhiyouga%2FLlamaFactory
Code	https://patch-diff.githubusercontent.com/hiyouga/LlamaFactory
Issues	https://patch-diff.githubusercontent.com/hiyouga/LlamaFactory/issues
Pull requests	https://patch-diff.githubusercontent.com/hiyouga/LlamaFactory/pulls
Discussions	https://patch-diff.githubusercontent.com/hiyouga/LlamaFactory/discussions
nlp	https://patch-diff.githubusercontent.com/topics/nlp
agent	https://patch-diff.githubusercontent.com/topics/agent
ai	https://patch-diff.githubusercontent.com/topics/ai
transformers	https://patch-diff.githubusercontent.com/topics/transformers
moe	https://patch-diff.githubusercontent.com/topics/moe
llama	https://patch-diff.githubusercontent.com/topics/llama
gpt	https://patch-diff.githubusercontent.com/topics/gpt
lora	https://patch-diff.githubusercontent.com/topics/lora
quantization	https://patch-diff.githubusercontent.com/topics/quantization
gemma	https://patch-diff.githubusercontent.com/topics/gemma
fine-tuning	https://patch-diff.githubusercontent.com/topics/fine-tuning
peft	https://patch-diff.githubusercontent.com/topics/peft
large-language-models	https://patch-diff.githubusercontent.com/topics/large-language-models
llm	https://patch-diff.githubusercontent.com/topics/llm
rlhf	https://patch-diff.githubusercontent.com/topics/rlhf
instruction-tuning	https://patch-diff.githubusercontent.com/topics/instruction-tuning
qlora	https://patch-diff.githubusercontent.com/topics/qlora
qwen	https://patch-diff.githubusercontent.com/topics/qwen
deepseek	https://patch-diff.githubusercontent.com/topics/deepseek
llama3	https://patch-diff.githubusercontent.com/topics/llama3
SYSTRAN	https://patch-diff.githubusercontent.com/SYSTRAN
faster-whisper	https://patch-diff.githubusercontent.com/SYSTRAN/faster-whisper
Star 20.4k	https://patch-diff.githubusercontent.com/login?return_to=%2FSYSTRAN%2Ffaster-whisper
Code	https://patch-diff.githubusercontent.com/SYSTRAN/faster-whisper
Issues	https://patch-diff.githubusercontent.com/SYSTRAN/faster-whisper/issues
Pull requests	https://patch-diff.githubusercontent.com/SYSTRAN/faster-whisper/pulls
Discussions	https://patch-diff.githubusercontent.com/SYSTRAN/faster-whisper/discussions
deep-learning	https://patch-diff.githubusercontent.com/topics/deep-learning
inference	https://patch-diff.githubusercontent.com/topics/inference
transformer	https://patch-diff.githubusercontent.com/topics/transformer
speech-recognition	https://patch-diff.githubusercontent.com/topics/speech-recognition
openai	https://patch-diff.githubusercontent.com/topics/openai
speech-to-text	https://patch-diff.githubusercontent.com/topics/speech-to-text
quantization	https://patch-diff.githubusercontent.com/topics/quantization
whisper	https://patch-diff.githubusercontent.com/topics/whisper
	https://patch-diff.githubusercontent.com/ymcui/Chinese-LLaMA-Alpaca
ymcui	https://patch-diff.githubusercontent.com/ymcui
Chinese-LLaMA-Alpaca	https://patch-diff.githubusercontent.com/ymcui/Chinese-LLaMA-Alpaca
Star 19k	https://patch-diff.githubusercontent.com/login?return_to=%2Fymcui%2FChinese-LLaMA-Alpaca
Code	https://patch-diff.githubusercontent.com/ymcui/Chinese-LLaMA-Alpaca
Issues	https://patch-diff.githubusercontent.com/ymcui/Chinese-LLaMA-Alpaca/issues
Pull requests	https://patch-diff.githubusercontent.com/ymcui/Chinese-LLaMA-Alpaca/pulls
Discussions	https://patch-diff.githubusercontent.com/ymcui/Chinese-LLaMA-Alpaca/discussions
nlp	https://patch-diff.githubusercontent.com/topics/nlp
llama	https://patch-diff.githubusercontent.com/topics/llama
lora	https://patch-diff.githubusercontent.com/topics/lora
quantization	https://patch-diff.githubusercontent.com/topics/quantization
alpaca	https://patch-diff.githubusercontent.com/topics/alpaca
plm	https://patch-diff.githubusercontent.com/topics/plm
pre-trained-language-models	https://patch-diff.githubusercontent.com/topics/pre-trained-language-models
large-language-models	https://patch-diff.githubusercontent.com/topics/large-language-models
llm	https://patch-diff.githubusercontent.com/topics/llm
llama-2	https://patch-diff.githubusercontent.com/topics/llama-2
alpaca-2	https://patch-diff.githubusercontent.com/topics/alpaca-2
	https://patch-diff.githubusercontent.com/UFund-Me/Qbot
UFund-Me	https://patch-diff.githubusercontent.com/UFund-Me
Qbot	https://patch-diff.githubusercontent.com/UFund-Me/Qbot
Star 15.9k	https://patch-diff.githubusercontent.com/login?return_to=%2FUFund-Me%2FQbot
Code	https://patch-diff.githubusercontent.com/UFund-Me/Qbot
Issues	https://patch-diff.githubusercontent.com/UFund-Me/Qbot/issues
Pull requests	https://patch-diff.githubusercontent.com/UFund-Me/Qbot/pulls
https://ufund-me.github.io/Qbot	https://ufund-me.github.io/Qbot
https://github.com/Charmve/iQuant	https://github.com/Charmve/iQuant
machine-learning	https://patch-diff.githubusercontent.com/topics/machine-learning
deep-learning	https://patch-diff.githubusercontent.com/topics/deep-learning
bitcoin	https://patch-diff.githubusercontent.com/topics/bitcoin
blockchain	https://patch-diff.githubusercontent.com/topics/blockchain
fintech	https://patch-diff.githubusercontent.com/topics/fintech
quantitative-finance	https://patch-diff.githubusercontent.com/topics/quantitative-finance
trademarks	https://patch-diff.githubusercontent.com/topics/trademarks
quantization	https://patch-diff.githubusercontent.com/topics/quantization
funds	https://patch-diff.githubusercontent.com/topics/funds
strategies	https://patch-diff.githubusercontent.com/topics/strategies
backtest	https://patch-diff.githubusercontent.com/topics/backtest
quantitative-trading	https://patch-diff.githubusercontent.com/topics/quantitative-trading
pytrade	https://patch-diff.githubusercontent.com/topics/pytrade
qlib	https://patch-diff.githubusercontent.com/topics/qlib
quant-trade	https://patch-diff.githubusercontent.com/topics/quant-trade
trade-bot	https://patch-diff.githubusercontent.com/topics/trade-bot
quant-trader	https://patch-diff.githubusercontent.com/topics/quant-trader
	https://patch-diff.githubusercontent.com/bitsandbytes-foundation/bitsandbytes
bitsandbytes-foundation	https://patch-diff.githubusercontent.com/bitsandbytes-foundation
bitsandbytes	https://patch-diff.githubusercontent.com/bitsandbytes-foundation/bitsandbytes
Sponsor	https://patch-diff.githubusercontent.com/sponsors/bitsandbytes-foundation
Star 7.9k	https://patch-diff.githubusercontent.com/login?return_to=%2Fbitsandbytes-foundation%2Fbitsandbytes
Code	https://patch-diff.githubusercontent.com/bitsandbytes-foundation/bitsandbytes
Issues	https://patch-diff.githubusercontent.com/bitsandbytes-foundation/bitsandbytes/issues
Pull requests	https://patch-diff.githubusercontent.com/bitsandbytes-foundation/bitsandbytes/pulls
Discussions	https://patch-diff.githubusercontent.com/bitsandbytes-foundation/bitsandbytes/discussions
machine-learning	https://patch-diff.githubusercontent.com/topics/machine-learning
pytorch	https://patch-diff.githubusercontent.com/topics/pytorch
quantization	https://patch-diff.githubusercontent.com/topics/quantization
llm	https://patch-diff.githubusercontent.com/topics/llm
qlora	https://patch-diff.githubusercontent.com/topics/qlora
kornelski	https://patch-diff.githubusercontent.com/kornelski
pngquant	https://patch-diff.githubusercontent.com/kornelski/pngquant
Star 5.5k	https://patch-diff.githubusercontent.com/login?return_to=%2Fkornelski%2Fpngquant
Code	https://patch-diff.githubusercontent.com/kornelski/pngquant
Issues	https://patch-diff.githubusercontent.com/kornelski/pngquant/issues
Pull requests	https://patch-diff.githubusercontent.com/kornelski/pngquant/pulls
c	https://patch-diff.githubusercontent.com/topics/c
palette	https://patch-diff.githubusercontent.com/topics/palette
quality	https://patch-diff.githubusercontent.com/topics/quality
png	https://patch-diff.githubusercontent.com/topics/png
png-compression	https://patch-diff.githubusercontent.com/topics/png-compression
conversion	https://patch-diff.githubusercontent.com/topics/conversion
smaller	https://patch-diff.githubusercontent.com/topics/smaller
stdin	https://patch-diff.githubusercontent.com/topics/stdin
image-optimization	https://patch-diff.githubusercontent.com/topics/image-optimization
quantization	https://patch-diff.githubusercontent.com/topics/quantization
pngquant	https://patch-diff.githubusercontent.com/topics/pngquant
AutoGPTQ	https://patch-diff.githubusercontent.com/AutoGPTQ
AutoGPTQ	https://patch-diff.githubusercontent.com/AutoGPTQ/AutoGPTQ
Star 5k	https://patch-diff.githubusercontent.com/login?return_to=%2FAutoGPTQ%2FAutoGPTQ
Code	https://patch-diff.githubusercontent.com/AutoGPTQ/AutoGPTQ
Issues	https://patch-diff.githubusercontent.com/AutoGPTQ/AutoGPTQ/issues
Pull requests	https://patch-diff.githubusercontent.com/AutoGPTQ/AutoGPTQ/pulls
Discussions	https://patch-diff.githubusercontent.com/AutoGPTQ/AutoGPTQ/discussions
nlp	https://patch-diff.githubusercontent.com/topics/nlp
deep-learning	https://patch-diff.githubusercontent.com/topics/deep-learning
transformers	https://patch-diff.githubusercontent.com/topics/transformers
inference	https://patch-diff.githubusercontent.com/topics/inference
pytorch	https://patch-diff.githubusercontent.com/topics/pytorch
transformer	https://patch-diff.githubusercontent.com/topics/transformer
quantization	https://patch-diff.githubusercontent.com/topics/quantization
large-language-models	https://patch-diff.githubusercontent.com/topics/large-language-models
llms	https://patch-diff.githubusercontent.com/topics/llms
OpenNMT	https://patch-diff.githubusercontent.com/OpenNMT
CTranslate2	https://patch-diff.githubusercontent.com/OpenNMT/CTranslate2
Star 4.3k	https://patch-diff.githubusercontent.com/login?return_to=%2FOpenNMT%2FCTranslate2
Code	https://patch-diff.githubusercontent.com/OpenNMT/CTranslate2
Issues	https://patch-diff.githubusercontent.com/OpenNMT/CTranslate2/issues
Pull requests	https://patch-diff.githubusercontent.com/OpenNMT/CTranslate2/pulls
deep-neural-networks	https://patch-diff.githubusercontent.com/topics/deep-neural-networks
deep-learning	https://patch-diff.githubusercontent.com/topics/deep-learning
cpp	https://patch-diff.githubusercontent.com/topics/cpp
neon	https://patch-diff.githubusercontent.com/topics/neon
machine-translation	https://patch-diff.githubusercontent.com/topics/machine-translation
openmp	https://patch-diff.githubusercontent.com/topics/openmp
parallel-computing	https://patch-diff.githubusercontent.com/topics/parallel-computing
cuda	https://patch-diff.githubusercontent.com/topics/cuda
inference	https://patch-diff.githubusercontent.com/topics/inference
avx	https://patch-diff.githubusercontent.com/topics/avx
intrinsics	https://patch-diff.githubusercontent.com/topics/intrinsics
avx2	https://patch-diff.githubusercontent.com/topics/avx2
neural-machine-translation	https://patch-diff.githubusercontent.com/topics/neural-machine-translation
opennmt	https://patch-diff.githubusercontent.com/topics/opennmt
quantization	https://patch-diff.githubusercontent.com/topics/quantization
gemm	https://patch-diff.githubusercontent.com/topics/gemm
mkl	https://patch-diff.githubusercontent.com/topics/mkl
thrust	https://patch-diff.githubusercontent.com/topics/thrust
transformer-models	https://patch-diff.githubusercontent.com/topics/transformer-models
onednn	https://patch-diff.githubusercontent.com/topics/onednn
nunchaku-ai	https://patch-diff.githubusercontent.com/nunchaku-ai
nunchaku	https://patch-diff.githubusercontent.com/nunchaku-ai/nunchaku
Star 3.6k	https://patch-diff.githubusercontent.com/login?return_to=%2Fnunchaku-ai%2Fnunchaku
Code	https://patch-diff.githubusercontent.com/nunchaku-ai/nunchaku
Issues	https://patch-diff.githubusercontent.com/nunchaku-ai/nunchaku/issues
Pull requests	https://patch-diff.githubusercontent.com/nunchaku-ai/nunchaku/pulls
Discussions	https://patch-diff.githubusercontent.com/nunchaku-ai/nunchaku/discussions
flux	https://patch-diff.githubusercontent.com/topics/flux
lora	https://patch-diff.githubusercontent.com/topics/lora
quantization	https://patch-diff.githubusercontent.com/topics/quantization
iclr	https://patch-diff.githubusercontent.com/topics/iclr
diffusion-models	https://patch-diff.githubusercontent.com/topics/diffusion-models
mlsys	https://patch-diff.githubusercontent.com/topics/mlsys
comfyui	https://patch-diff.githubusercontent.com/topics/comfyui
genai	https://patch-diff.githubusercontent.com/topics/genai
iclr2025	https://patch-diff.githubusercontent.com/topics/iclr2025
huggingface	https://patch-diff.githubusercontent.com/huggingface
optimum	https://patch-diff.githubusercontent.com/huggingface/optimum
Star 3.3k	https://patch-diff.githubusercontent.com/login?return_to=%2Fhuggingface%2Foptimum
Code	https://patch-diff.githubusercontent.com/huggingface/optimum
Issues	https://patch-diff.githubusercontent.com/huggingface/optimum/issues
Pull requests	https://patch-diff.githubusercontent.com/huggingface/optimum/pulls
training	https://patch-diff.githubusercontent.com/topics/training
optimization	https://patch-diff.githubusercontent.com/topics/optimization
intel	https://patch-diff.githubusercontent.com/topics/intel
transformers	https://patch-diff.githubusercontent.com/topics/transformers
inference	https://patch-diff.githubusercontent.com/topics/inference
pytorch	https://patch-diff.githubusercontent.com/topics/pytorch
quantization	https://patch-diff.githubusercontent.com/topics/quantization
onnx	https://patch-diff.githubusercontent.com/topics/onnx
tflite	https://patch-diff.githubusercontent.com/topics/tflite
onnxruntime	https://patch-diff.githubusercontent.com/topics/onnxruntime
graphcore	https://patch-diff.githubusercontent.com/topics/graphcore
habana	https://patch-diff.githubusercontent.com/topics/habana
	https://patch-diff.githubusercontent.com/neuralmagic/deepsparse
neuralmagic	https://patch-diff.githubusercontent.com/neuralmagic
deepsparse	https://patch-diff.githubusercontent.com/neuralmagic/deepsparse
Star 3.2k	https://patch-diff.githubusercontent.com/login?return_to=%2Fneuralmagic%2Fdeepsparse
Code	https://patch-diff.githubusercontent.com/neuralmagic/deepsparse
Issues	https://patch-diff.githubusercontent.com/neuralmagic/deepsparse/issues
Pull requests	https://patch-diff.githubusercontent.com/neuralmagic/deepsparse/pulls
nlp	https://patch-diff.githubusercontent.com/topics/nlp
performance	https://patch-diff.githubusercontent.com/topics/performance
computer-vision	https://patch-diff.githubusercontent.com/topics/computer-vision
inference	https://patch-diff.githubusercontent.com/topics/inference
machinelearning	https://patch-diff.githubusercontent.com/topics/machinelearning
pruning	https://patch-diff.githubusercontent.com/topics/pruning
object-detection	https://patch-diff.githubusercontent.com/topics/object-detection
pretrained-models	https://patch-diff.githubusercontent.com/topics/pretrained-models
quantization	https://patch-diff.githubusercontent.com/topics/quantization
cpus	https://patch-diff.githubusercontent.com/topics/cpus
onnx	https://patch-diff.githubusercontent.com/topics/onnx
sparsification	https://patch-diff.githubusercontent.com/topics/sparsification
llm-inference	https://patch-diff.githubusercontent.com/topics/llm-inference
deepsparse	https://patch-diff.githubusercontent.com/topics/deepsparse
huawei-noah	https://patch-diff.githubusercontent.com/huawei-noah
Pretrained-Language-Model	https://patch-diff.githubusercontent.com/huawei-noah/Pretrained-Language-Model
Star 3.2k	https://patch-diff.githubusercontent.com/login?return_to=%2Fhuawei-noah%2FPretrained-Language-Model
Code	https://patch-diff.githubusercontent.com/huawei-noah/Pretrained-Language-Model
Issues	https://patch-diff.githubusercontent.com/huawei-noah/Pretrained-Language-Model/issues
Pull requests	https://patch-diff.githubusercontent.com/huawei-noah/Pretrained-Language-Model/pulls
pretrained-models	https://patch-diff.githubusercontent.com/topics/pretrained-models
quantization	https://patch-diff.githubusercontent.com/topics/quantization
knowledge-distillation	https://patch-diff.githubusercontent.com/topics/knowledge-distillation
model-compression	https://patch-diff.githubusercontent.com/topics/model-compression
large-scale-distributed	https://patch-diff.githubusercontent.com/topics/large-scale-distributed
thu-ml	https://patch-diff.githubusercontent.com/thu-ml
SageAttention	https://patch-diff.githubusercontent.com/thu-ml/SageAttention
Star 3.1k	https://patch-diff.githubusercontent.com/login?return_to=%2Fthu-ml%2FSageAttention
Code	https://patch-diff.githubusercontent.com/thu-ml/SageAttention
Issues	https://patch-diff.githubusercontent.com/thu-ml/SageAttention/issues
Pull requests	https://patch-diff.githubusercontent.com/thu-ml/SageAttention/pulls
cuda	https://patch-diff.githubusercontent.com/topics/cuda
triton	https://patch-diff.githubusercontent.com/topics/triton
attention	https://patch-diff.githubusercontent.com/topics/attention
vit	https://patch-diff.githubusercontent.com/topics/vit
quantization	https://patch-diff.githubusercontent.com/topics/quantization
video-generation	https://patch-diff.githubusercontent.com/topics/video-generation
mlsys	https://patch-diff.githubusercontent.com/topics/mlsys
inference-acceleration	https://patch-diff.githubusercontent.com/topics/inference-acceleration
efficient-attention	https://patch-diff.githubusercontent.com/topics/efficient-attention
llm	https://patch-diff.githubusercontent.com/topics/llm
llm-infra	https://patch-diff.githubusercontent.com/topics/llm-infra
video-generate	https://patch-diff.githubusercontent.com/topics/video-generate
	https://patch-diff.githubusercontent.com/IntelLabs/nlp-architect
IntelLabs	https://patch-diff.githubusercontent.com/IntelLabs
nlp-architect	https://patch-diff.githubusercontent.com/IntelLabs/nlp-architect
Star 2.9k	https://patch-diff.githubusercontent.com/login?return_to=%2FIntelLabs%2Fnlp-architect
Code	https://patch-diff.githubusercontent.com/IntelLabs/nlp-architect
Issues	https://patch-diff.githubusercontent.com/IntelLabs/nlp-architect/issues
Pull requests	https://patch-diff.githubusercontent.com/IntelLabs/nlp-architect/pulls
Discussions	https://patch-diff.githubusercontent.com/IntelLabs/nlp-architect/discussions
nlp	https://patch-diff.githubusercontent.com/topics/nlp
deep-learning	https://patch-diff.githubusercontent.com/topics/deep-learning
tensorflow	https://patch-diff.githubusercontent.com/topics/tensorflow
nlu	https://patch-diff.githubusercontent.com/topics/nlu
transformers	https://patch-diff.githubusercontent.com/topics/transformers
pytorch	https://patch-diff.githubusercontent.com/topics/pytorch
deeplearning	https://patch-diff.githubusercontent.com/topics/deeplearning
quantization	https://patch-diff.githubusercontent.com/topics/quantization
bert	https://patch-diff.githubusercontent.com/topics/bert
dynet	https://patch-diff.githubusercontent.com/topics/dynet
aaron-xichen	https://patch-diff.githubusercontent.com/aaron-xichen
pytorch-playground	https://patch-diff.githubusercontent.com/aaron-xichen/pytorch-playground
Star 2.7k	https://patch-diff.githubusercontent.com/login?return_to=%2Faaron-xichen%2Fpytorch-playground
Code	https://patch-diff.githubusercontent.com/aaron-xichen/pytorch-playground
Issues	https://patch-diff.githubusercontent.com/aaron-xichen/pytorch-playground/issues
Pull requests	https://patch-diff.githubusercontent.com/aaron-xichen/pytorch-playground/pulls
pytorch	https://patch-diff.githubusercontent.com/topics/pytorch
quantization	https://patch-diff.githubusercontent.com/topics/quantization
pytorch-tutorial	https://patch-diff.githubusercontent.com/topics/pytorch-tutorial
pytorch-tutorials	https://patch-diff.githubusercontent.com/topics/pytorch-tutorials
nunchaku-ai	https://patch-diff.githubusercontent.com/nunchaku-ai
ComfyUI-nunchaku	https://patch-diff.githubusercontent.com/nunchaku-ai/ComfyUI-nunchaku
Star 2.7k	https://patch-diff.githubusercontent.com/login?return_to=%2Fnunchaku-ai%2FComfyUI-nunchaku
Code	https://patch-diff.githubusercontent.com/nunchaku-ai/ComfyUI-nunchaku
Issues	https://patch-diff.githubusercontent.com/nunchaku-ai/ComfyUI-nunchaku/issues
Pull requests	https://patch-diff.githubusercontent.com/nunchaku-ai/ComfyUI-nunchaku/pulls
Discussions	https://patch-diff.githubusercontent.com/nunchaku-ai/ComfyUI-nunchaku/discussions
flux	https://patch-diff.githubusercontent.com/topics/flux
quantization	https://patch-diff.githubusercontent.com/topics/quantization
diffusion	https://patch-diff.githubusercontent.com/topics/diffusion
mlsys	https://patch-diff.githubusercontent.com/topics/mlsys
comfyui	https://patch-diff.githubusercontent.com/topics/comfyui
genai	https://patch-diff.githubusercontent.com/topics/genai
stochasticai	https://patch-diff.githubusercontent.com/stochasticai
xTuring	https://patch-diff.githubusercontent.com/stochasticai/xTuring
Star 2.7k	https://patch-diff.githubusercontent.com/login?return_to=%2Fstochasticai%2FxTuring
Code	https://patch-diff.githubusercontent.com/stochasticai/xTuring
Issues	https://patch-diff.githubusercontent.com/stochasticai/xTuring/issues
Pull requests	https://patch-diff.githubusercontent.com/stochasticai/xTuring/pulls
Discussions	https://patch-diff.githubusercontent.com/stochasticai/xTuring/discussions
https://discord.gg/TgHXuSJEk6	https://discord.gg/TgHXuSJEk6
adapter	https://patch-diff.githubusercontent.com/topics/adapter
deep-learning	https://patch-diff.githubusercontent.com/topics/deep-learning
llama	https://patch-diff.githubusercontent.com/topics/llama
lora	https://patch-diff.githubusercontent.com/topics/lora
quantization	https://patch-diff.githubusercontent.com/topics/quantization
language-model	https://patch-diff.githubusercontent.com/topics/language-model
mistral	https://patch-diff.githubusercontent.com/topics/mistral
fine-tuning	https://patch-diff.githubusercontent.com/topics/fine-tuning
peft	https://patch-diff.githubusercontent.com/topics/peft
finetuning	https://patch-diff.githubusercontent.com/topics/finetuning
mixed-precision	https://patch-diff.githubusercontent.com/topics/mixed-precision
gpt-2	https://patch-diff.githubusercontent.com/topics/gpt-2
gpt-j	https://patch-diff.githubusercontent.com/topics/gpt-j
llm	https://patch-diff.githubusercontent.com/topics/llm
generative-ai	https://patch-diff.githubusercontent.com/topics/generative-ai
gen-ai	https://patch-diff.githubusercontent.com/topics/gen-ai
pytorch	https://patch-diff.githubusercontent.com/pytorch
ao	https://patch-diff.githubusercontent.com/pytorch/ao
Star 2.6k	https://patch-diff.githubusercontent.com/login?return_to=%2Fpytorch%2Fao
Code	https://patch-diff.githubusercontent.com/pytorch/ao
Issues	https://patch-diff.githubusercontent.com/pytorch/ao/issues
Pull requests	https://patch-diff.githubusercontent.com/pytorch/ao/pulls
Discussions	https://patch-diff.githubusercontent.com/pytorch/ao/discussions
training	https://patch-diff.githubusercontent.com/topics/training
sparsity	https://patch-diff.githubusercontent.com/topics/sparsity
cuda	https://patch-diff.githubusercontent.com/topics/cuda
inference	https://patch-diff.githubusercontent.com/topics/inference
optimizer	https://patch-diff.githubusercontent.com/topics/optimizer
pytorch	https://patch-diff.githubusercontent.com/topics/pytorch
transformer	https://patch-diff.githubusercontent.com/topics/transformer
offloading	https://patch-diff.githubusercontent.com/topics/offloading
llama	https://patch-diff.githubusercontent.com/topics/llama
quantization	https://patch-diff.githubusercontent.com/topics/quantization
mx	https://patch-diff.githubusercontent.com/topics/mx
brrr	https://patch-diff.githubusercontent.com/topics/brrr
dtypes	https://patch-diff.githubusercontent.com/topics/dtypes
float8	https://patch-diff.githubusercontent.com/topics/float8
vllm-project	https://patch-diff.githubusercontent.com/vllm-project
llm-compressor	https://patch-diff.githubusercontent.com/vllm-project/llm-compressor
Sponsor	https://patch-diff.githubusercontent.com/sponsors/vllm-project
Star 2.6k	https://patch-diff.githubusercontent.com/login?return_to=%2Fvllm-project%2Fllm-compressor
Code	https://patch-diff.githubusercontent.com/vllm-project/llm-compressor
Issues	https://patch-diff.githubusercontent.com/vllm-project/llm-compressor/issues
Pull requests	https://patch-diff.githubusercontent.com/vllm-project/llm-compressor/pulls
Discussions	https://patch-diff.githubusercontent.com/vllm-project/llm-compressor/discussions
sparsity	https://patch-diff.githubusercontent.com/topics/sparsity
compression	https://patch-diff.githubusercontent.com/topics/compression
quantization	https://patch-diff.githubusercontent.com/topics/quantization
intel	https://patch-diff.githubusercontent.com/intel
neural-compressor	https://patch-diff.githubusercontent.com/intel/neural-compressor
Star 2.6k	https://patch-diff.githubusercontent.com/login?return_to=%2Fintel%2Fneural-compressor
Code	https://patch-diff.githubusercontent.com/intel/neural-compressor
Issues	https://patch-diff.githubusercontent.com/intel/neural-compressor/issues
Pull requests	https://patch-diff.githubusercontent.com/intel/neural-compressor/pulls
Discussions	https://patch-diff.githubusercontent.com/intel/neural-compressor/discussions
sparsity	https://patch-diff.githubusercontent.com/topics/sparsity
pruning	https://patch-diff.githubusercontent.com/topics/pruning
quantization	https://patch-diff.githubusercontent.com/topics/quantization
knowledge-distillation	https://patch-diff.githubusercontent.com/topics/knowledge-distillation
auto-tuning	https://patch-diff.githubusercontent.com/topics/auto-tuning
int8	https://patch-diff.githubusercontent.com/topics/int8
low-precision	https://patch-diff.githubusercontent.com/topics/low-precision
quantization-aware-training	https://patch-diff.githubusercontent.com/topics/quantization-aware-training
post-training-quantization	https://patch-diff.githubusercontent.com/topics/post-training-quantization
awq	https://patch-diff.githubusercontent.com/topics/awq
int4	https://patch-diff.githubusercontent.com/topics/int4
large-language-models	https://patch-diff.githubusercontent.com/topics/large-language-models
gptq	https://patch-diff.githubusercontent.com/topics/gptq
smoothquant	https://patch-diff.githubusercontent.com/topics/smoothquant
sparsegpt	https://patch-diff.githubusercontent.com/topics/sparsegpt
fp4	https://patch-diff.githubusercontent.com/topics/fp4
mxformat	https://patch-diff.githubusercontent.com/topics/mxformat
Curate this topic	https://github.com/github/explore/tree/master/CONTRIBUTING.md?source=add-description-quantization
Learn more	https://docs.github.com/en/articles/classifying-your-repository-with-topics
	https://github.com
Terms	https://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacy	https://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Security	https://github.com/security
Status	https://www.githubstatus.com/
Community	https://github.community/
Docs	https://docs.github.com/
Contact	https://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.