René's URL Explorer Experiment

Title: inference · GitHub Topics · GitHub

Open Graph Title: Build software better, together

X Title: GitHub

Description: GitHub is where people build software. More than 150 million people use GitHub to discover, fork, and contribute to over 420 million projects.

Open Graph Description: GitHub is where people build software. More than 150 million people use GitHub to discover, fork, and contribute to over 420 million projects.

X Description: GitHub is where people build software. More than 150 million people use GitHub to discover, fork, and contribute to over 420 million projects.

Opengraph URL: https://github.com

X: github

direct link

Domain: patch-diff.githubusercontent.com

route-pattern	/topics/:topic_name(.:format)
route-controller	topics
route-action	show
fetch-nonce	v2:3ab48b1a-44b8-ba5e-628e-9c412166ed66
current-catalog-service-hash	82c569b93da5c18ed649ebd4c2c79437db4611a6a1373e805a3cb001c64130b7
request-id	A842:2DE4E0:18AD3C7:2078F8D:696B8CE9
html-safe-nonce	b15c577ad474b2a70b682b99d0dcf6253c2fa18e6d10d134d435adc74947cc21
visitor-payload	eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJBODQyOjJERTRFMDoxOEFEM0M3OjIwNzhGOEQ6Njk2QjhDRTkiLCJ2aXNpdG9yX2lkIjoiMTI0NDE4NzcwNDcyNzY2Njk3IiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0=
visitor-hmac	4bdffef1cc390cf7c95954ef31635c754051cba0fc345811dba413776e3455ac
github-keyboard-shortcuts	copilot
google-site-verification	Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-url	https://collector.github.com/github/collect
fb:app_id	1401488693436528
apple-itunes-app	app-id=1477376905, app-argument=https://github.com/topics/inference
og:site_name	GitHub
og:image	https://github.githubassets.com/assets/github-octocat-13c86b8b336d.png
og:image:type	image/png
og:image:width	1200
og:image:height	620
twitter:site:id	13334762
twitter:creator	github
twitter:creator:id	13334762
twitter:card	summary_large_image
twitter:image	https://github.githubassets.com/assets/github-logo-55c5b9a1fe52.png
twitter:image:width	1200
twitter:image:height	1200
hostname	github.com
expected-hostname	github.com
None	5f99f7c1d70f01da5b93e5ca90303359738944d8ab470e396496262c66e60b8d
turbo-cache-control	no-preview
turbo-body-classes	logged-out env-production page-responsive
disable-turbo	false
browser-stats-url	https://api.github.com/_private/browser/stats
browser-errors-url	https://api.github.com/_private/browser/errors
release	82560a55c6b2054555076f46e683151ee28a19bc
ui-target	full
theme-color	#1e2327
color-scheme	light dark

Links:

Skip to content	https://patch-diff.githubusercontent.com/topics/inference#start-of-content
	https://patch-diff.githubusercontent.com/
Sign in	https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Ftopics%2Finference
GitHub CopilotWrite better code with AI	https://github.com/features/copilot
GitHub SparkBuild and deploy intelligent apps	https://github.com/features/spark
GitHub ModelsManage and compare prompts	https://github.com/features/models
MCP RegistryNewIntegrate external tools	https://github.com/mcp
ActionsAutomate any workflow	https://github.com/features/actions
CodespacesInstant dev environments	https://github.com/features/codespaces
IssuesPlan and track work	https://github.com/features/issues
Code ReviewManage code changes	https://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilities	https://github.com/security/advanced-security
Code securitySecure your code as you build	https://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they start	https://github.com/security/advanced-security/secret-protection
Why GitHub	https://github.com/why-github
Documentation	https://docs.github.com
Blog	https://github.blog
Changelog	https://github.blog/changelog
Marketplace	https://github.com/marketplace
View all features	https://github.com/features
Enterprises	https://github.com/enterprise
Small and medium teams	https://github.com/team
Startups	https://github.com/enterprise/startups
Nonprofits	https://github.com/solutions/industry/nonprofits
App Modernization	https://github.com/solutions/use-case/app-modernization
DevSecOps	https://github.com/solutions/use-case/devsecops
DevOps	https://github.com/solutions/use-case/devops
CI/CD	https://github.com/solutions/use-case/ci-cd
View all use cases	https://github.com/solutions/use-case
Healthcare	https://github.com/solutions/industry/healthcare
Financial services	https://github.com/solutions/industry/financial-services
Manufacturing	https://github.com/solutions/industry/manufacturing
Government	https://github.com/solutions/industry/government
View all industries	https://github.com/solutions/industry
View all solutions	https://github.com/solutions
AI	https://github.com/resources/articles?topic=ai
Software Development	https://github.com/resources/articles?topic=software-development
DevOps	https://github.com/resources/articles?topic=devops
Security	https://github.com/resources/articles?topic=security
View all topics	https://github.com/resources/articles
Customer stories	https://github.com/customer-stories
Events & webinars	https://github.com/resources/events
Ebooks & reports	https://github.com/resources/whitepapers
Business insights	https://github.com/solutions/executive-insights
GitHub Skills	https://skills.github.com
Documentation	https://docs.github.com
Customer support	https://support.github.com
Community forum	https://github.com/orgs/community/discussions
Trust center	https://github.com/trust-center
Partners	https://github.com/partners
GitHub SponsorsFund open source developers	https://github.com/sponsors
Security Lab	https://securitylab.github.com
Maintainer Community	https://maintainers.github.com
Accelerator	https://github.com/accelerator
Archive Program	https://archiveprogram.github.com
Topics	https://github.com/topics
Trending	https://github.com/trending
Collections	https://github.com/collections
Enterprise platformAI-powered developer platform	https://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security features	https://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI features	https://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 support	https://github.com/premium-support
Pricing	https://github.com/pricing
Search syntax tips	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentation	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in	https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Ftopics%2Finference
Sign up	https://patch-diff.githubusercontent.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2Ftopics%2Finference&source=header
Reload	https://patch-diff.githubusercontent.com/topics/inference
Reload	https://patch-diff.githubusercontent.com/topics/inference
Reload	https://patch-diff.githubusercontent.com/topics/inference
Explore	https://patch-diff.githubusercontent.com/explore
Topics	https://patch-diff.githubusercontent.com/topics
Trending	https://patch-diff.githubusercontent.com/trending
Collections	https://patch-diff.githubusercontent.com/collections
Events	https://patch-diff.githubusercontent.com/events
GitHub Sponsors	https://patch-diff.githubusercontent.com/sponsors/explore
Star	https://patch-diff.githubusercontent.com/login?return_to=%2Ftopic.inference
All 1,884	https://github.com/topics/inference
Python 771	https://github.com/topics/inference?l=python
Jupyter Notebook 255	https://github.com/topics/inference?l=jupyter+notebook
C++ 177	https://github.com/topics/inference?l=c%2B%2B
Rust 59	https://github.com/topics/inference?l=rust
R 54	https://github.com/topics/inference?l=r
TypeScript 54	https://github.com/topics/inference?l=typescript
HTML 52	https://github.com/topics/inference?l=html
Go 50	https://github.com/topics/inference?l=go
JavaScript 50	https://github.com/topics/inference?l=javascript
Java 42	https://github.com/topics/inference?l=java
Most stars	https://patch-diff.githubusercontent.com/topics/inference?o=desc&s=stars
Fewest stars	https://patch-diff.githubusercontent.com/topics/inference?o=asc&s=stars
Most forks	https://patch-diff.githubusercontent.com/topics/inference?o=desc&s=forks
Fewest forks	https://patch-diff.githubusercontent.com/topics/inference?o=asc&s=forks
Recently updated	https://patch-diff.githubusercontent.com/topics/inference?o=desc&s=updated
Least recently updated	https://patch-diff.githubusercontent.com/topics/inference?o=asc&s=updated
vllm-project	https://patch-diff.githubusercontent.com/vllm-project
vllm	https://patch-diff.githubusercontent.com/vllm-project/vllm
Sponsor	https://patch-diff.githubusercontent.com/sponsors/vllm-project
Star 67.7k	https://patch-diff.githubusercontent.com/login?return_to=%2Fvllm-project%2Fvllm
Code	https://patch-diff.githubusercontent.com/vllm-project/vllm
Issues	https://patch-diff.githubusercontent.com/vllm-project/vllm/issues
Pull requests	https://patch-diff.githubusercontent.com/vllm-project/vllm/pulls
Discussions	https://patch-diff.githubusercontent.com/vllm-project/vllm/discussions
amd	https://patch-diff.githubusercontent.com/topics/amd
cuda	https://patch-diff.githubusercontent.com/topics/cuda
inference	https://patch-diff.githubusercontent.com/topics/inference
pytorch	https://patch-diff.githubusercontent.com/topics/pytorch
transformer	https://patch-diff.githubusercontent.com/topics/transformer
openai	https://patch-diff.githubusercontent.com/topics/openai
moe	https://patch-diff.githubusercontent.com/topics/moe
llama	https://patch-diff.githubusercontent.com/topics/llama
gpt	https://patch-diff.githubusercontent.com/topics/gpt
model-serving	https://patch-diff.githubusercontent.com/topics/model-serving
tpu	https://patch-diff.githubusercontent.com/topics/tpu
kimi	https://patch-diff.githubusercontent.com/topics/kimi
blackwell	https://patch-diff.githubusercontent.com/topics/blackwell
llm	https://patch-diff.githubusercontent.com/topics/llm
llm-serving	https://patch-diff.githubusercontent.com/topics/llm-serving
qwen	https://patch-diff.githubusercontent.com/topics/qwen
deepseek	https://patch-diff.githubusercontent.com/topics/deepseek
deepseek-v3	https://patch-diff.githubusercontent.com/topics/deepseek-v3
qwen3	https://patch-diff.githubusercontent.com/topics/qwen3
gpt-oss	https://patch-diff.githubusercontent.com/topics/gpt-oss
	https://patch-diff.githubusercontent.com/ggml-org/whisper.cpp
ggml-org	https://patch-diff.githubusercontent.com/ggml-org
whisper.cpp	https://patch-diff.githubusercontent.com/ggml-org/whisper.cpp
Star 45.8k	https://patch-diff.githubusercontent.com/login?return_to=%2Fggml-org%2Fwhisper.cpp
Code	https://patch-diff.githubusercontent.com/ggml-org/whisper.cpp
Issues	https://patch-diff.githubusercontent.com/ggml-org/whisper.cpp/issues
Pull requests	https://patch-diff.githubusercontent.com/ggml-org/whisper.cpp/pulls
Discussions	https://patch-diff.githubusercontent.com/ggml-org/whisper.cpp/discussions
inference	https://patch-diff.githubusercontent.com/topics/inference
transformer	https://patch-diff.githubusercontent.com/topics/transformer
speech-recognition	https://patch-diff.githubusercontent.com/topics/speech-recognition
openai	https://patch-diff.githubusercontent.com/topics/openai
speech-to-text	https://patch-diff.githubusercontent.com/topics/speech-to-text
whisper	https://patch-diff.githubusercontent.com/topics/whisper
	https://patch-diff.githubusercontent.com/hpcaitech/ColossalAI
hpcaitech	https://patch-diff.githubusercontent.com/hpcaitech
ColossalAI	https://patch-diff.githubusercontent.com/hpcaitech/ColossalAI
Star 41.3k	https://patch-diff.githubusercontent.com/login?return_to=%2Fhpcaitech%2FColossalAI
Code	https://patch-diff.githubusercontent.com/hpcaitech/ColossalAI
Issues	https://patch-diff.githubusercontent.com/hpcaitech/ColossalAI/issues
Pull requests	https://patch-diff.githubusercontent.com/hpcaitech/ColossalAI/pulls
Discussions	https://patch-diff.githubusercontent.com/hpcaitech/ColossalAI/discussions
ai	https://patch-diff.githubusercontent.com/topics/ai
deep-learning	https://patch-diff.githubusercontent.com/topics/deep-learning
hpc	https://patch-diff.githubusercontent.com/topics/hpc
distributed-computing	https://patch-diff.githubusercontent.com/topics/distributed-computing
inference	https://patch-diff.githubusercontent.com/topics/inference
big-model	https://patch-diff.githubusercontent.com/topics/big-model
large-scale	https://patch-diff.githubusercontent.com/topics/large-scale
data-parallelism	https://patch-diff.githubusercontent.com/topics/data-parallelism
model-parallelism	https://patch-diff.githubusercontent.com/topics/model-parallelism
pipeline-parallelism	https://patch-diff.githubusercontent.com/topics/pipeline-parallelism
foundation-models	https://patch-diff.githubusercontent.com/topics/foundation-models
heterogeneous-training	https://patch-diff.githubusercontent.com/topics/heterogeneous-training
deepspeedai	https://patch-diff.githubusercontent.com/deepspeedai
DeepSpeed	https://patch-diff.githubusercontent.com/deepspeedai/DeepSpeed
Star 41.3k	https://patch-diff.githubusercontent.com/login?return_to=%2Fdeepspeedai%2FDeepSpeed
Code	https://patch-diff.githubusercontent.com/deepspeedai/DeepSpeed
Issues	https://patch-diff.githubusercontent.com/deepspeedai/DeepSpeed/issues
Pull requests	https://patch-diff.githubusercontent.com/deepspeedai/DeepSpeed/pulls
Discussions	https://patch-diff.githubusercontent.com/deepspeedai/DeepSpeed/discussions
machine-learning	https://patch-diff.githubusercontent.com/topics/machine-learning
compression	https://patch-diff.githubusercontent.com/topics/compression
deep-learning	https://patch-diff.githubusercontent.com/topics/deep-learning
gpu	https://patch-diff.githubusercontent.com/topics/gpu
inference	https://patch-diff.githubusercontent.com/topics/inference
pytorch	https://patch-diff.githubusercontent.com/topics/pytorch
zero	https://patch-diff.githubusercontent.com/topics/zero
data-parallelism	https://patch-diff.githubusercontent.com/topics/data-parallelism
model-parallelism	https://patch-diff.githubusercontent.com/topics/model-parallelism
mixture-of-experts	https://patch-diff.githubusercontent.com/topics/mixture-of-experts
pipeline-parallelism	https://patch-diff.githubusercontent.com/topics/pipeline-parallelism
billion-parameters	https://patch-diff.githubusercontent.com/topics/billion-parameters
trillion-parameters	https://patch-diff.githubusercontent.com/topics/trillion-parameters
google-ai-edge	https://patch-diff.githubusercontent.com/google-ai-edge
mediapipe	https://patch-diff.githubusercontent.com/google-ai-edge/mediapipe
Star 33.3k	https://patch-diff.githubusercontent.com/login?return_to=%2Fgoogle-ai-edge%2Fmediapipe
Code	https://patch-diff.githubusercontent.com/google-ai-edge/mediapipe
Issues	https://patch-diff.githubusercontent.com/google-ai-edge/mediapipe/issues
Pull requests	https://patch-diff.githubusercontent.com/google-ai-edge/mediapipe/pulls
android	https://patch-diff.githubusercontent.com/topics/android
c-plus-plus	https://patch-diff.githubusercontent.com/topics/c-plus-plus
calculator	https://patch-diff.githubusercontent.com/topics/calculator
machine-learning	https://patch-diff.githubusercontent.com/topics/machine-learning
framework	https://patch-diff.githubusercontent.com/topics/framework
computer-vision	https://patch-diff.githubusercontent.com/topics/computer-vision
deep-learning	https://patch-diff.githubusercontent.com/topics/deep-learning
inference	https://patch-diff.githubusercontent.com/topics/inference
pipeline-framework	https://patch-diff.githubusercontent.com/topics/pipeline-framework
stream-processing	https://patch-diff.githubusercontent.com/topics/stream-processing
video-processing	https://patch-diff.githubusercontent.com/topics/video-processing
perception	https://patch-diff.githubusercontent.com/topics/perception
mobile-development	https://patch-diff.githubusercontent.com/topics/mobile-development
audio-processing	https://patch-diff.githubusercontent.com/topics/audio-processing
graph-framework	https://patch-diff.githubusercontent.com/topics/graph-framework
graph-based	https://patch-diff.githubusercontent.com/topics/graph-based
mediapipe	https://patch-diff.githubusercontent.com/topics/mediapipe
Tencent	https://patch-diff.githubusercontent.com/Tencent
ncnn	https://patch-diff.githubusercontent.com/Tencent/ncnn
Star 22.6k	https://patch-diff.githubusercontent.com/login?return_to=%2FTencent%2Fncnn
Code	https://patch-diff.githubusercontent.com/Tencent/ncnn
Issues	https://patch-diff.githubusercontent.com/Tencent/ncnn/issues
Pull requests	https://patch-diff.githubusercontent.com/Tencent/ncnn/pulls
Discussions	https://patch-diff.githubusercontent.com/Tencent/ncnn/discussions
android	https://patch-diff.githubusercontent.com/topics/android
ios	https://patch-diff.githubusercontent.com/topics/ios
caffe	https://patch-diff.githubusercontent.com/topics/caffe
deep-learning	https://patch-diff.githubusercontent.com/topics/deep-learning
neural-network	https://patch-diff.githubusercontent.com/topics/neural-network
mxnet	https://patch-diff.githubusercontent.com/topics/mxnet
tensorflow	https://patch-diff.githubusercontent.com/topics/tensorflow
vulkan	https://patch-diff.githubusercontent.com/topics/vulkan
keras	https://patch-diff.githubusercontent.com/topics/keras
inference	https://patch-diff.githubusercontent.com/topics/inference
pytorch	https://patch-diff.githubusercontent.com/topics/pytorch
artificial-intelligence	https://patch-diff.githubusercontent.com/topics/artificial-intelligence
simd	https://patch-diff.githubusercontent.com/topics/simd
riscv	https://patch-diff.githubusercontent.com/topics/riscv
darknet	https://patch-diff.githubusercontent.com/topics/darknet
arm-neon	https://patch-diff.githubusercontent.com/topics/arm-neon
high-preformance	https://patch-diff.githubusercontent.com/topics/high-preformance
ncnn	https://patch-diff.githubusercontent.com/topics/ncnn
onnx	https://patch-diff.githubusercontent.com/topics/onnx
mlir	https://patch-diff.githubusercontent.com/topics/mlir
sgl-project	https://patch-diff.githubusercontent.com/sgl-project
sglang	https://patch-diff.githubusercontent.com/sgl-project/sglang
Star 22.5k	https://patch-diff.githubusercontent.com/login?return_to=%2Fsgl-project%2Fsglang
Code	https://patch-diff.githubusercontent.com/sgl-project/sglang
Issues	https://patch-diff.githubusercontent.com/sgl-project/sglang/issues
Pull requests	https://patch-diff.githubusercontent.com/sgl-project/sglang/pulls
Discussions	https://patch-diff.githubusercontent.com/sgl-project/sglang/discussions
reinforcement-learning	https://patch-diff.githubusercontent.com/topics/reinforcement-learning
cuda	https://patch-diff.githubusercontent.com/topics/cuda
inference	https://patch-diff.githubusercontent.com/topics/inference
transformer	https://patch-diff.githubusercontent.com/topics/transformer
moe	https://patch-diff.githubusercontent.com/topics/moe
attention	https://patch-diff.githubusercontent.com/topics/attention
llama	https://patch-diff.githubusercontent.com/topics/llama
glm	https://patch-diff.githubusercontent.com/topics/glm
minimax	https://patch-diff.githubusercontent.com/topics/minimax
wan	https://patch-diff.githubusercontent.com/topics/wan
diffusion	https://patch-diff.githubusercontent.com/topics/diffusion
vlm	https://patch-diff.githubusercontent.com/topics/vlm
blackwell	https://patch-diff.githubusercontent.com/topics/blackwell
llm	https://patch-diff.githubusercontent.com/topics/llm
qwen	https://patch-diff.githubusercontent.com/topics/qwen
deepseek	https://patch-diff.githubusercontent.com/topics/deepseek
gpt-oss	https://patch-diff.githubusercontent.com/topics/gpt-oss
qwen-image	https://patch-diff.githubusercontent.com/topics/qwen-image
SYSTRAN	https://patch-diff.githubusercontent.com/SYSTRAN
faster-whisper	https://patch-diff.githubusercontent.com/SYSTRAN/faster-whisper
Star 20.4k	https://patch-diff.githubusercontent.com/login?return_to=%2FSYSTRAN%2Ffaster-whisper
Code	https://patch-diff.githubusercontent.com/SYSTRAN/faster-whisper
Issues	https://patch-diff.githubusercontent.com/SYSTRAN/faster-whisper/issues
Pull requests	https://patch-diff.githubusercontent.com/SYSTRAN/faster-whisper/pulls
Discussions	https://patch-diff.githubusercontent.com/SYSTRAN/faster-whisper/discussions
deep-learning	https://patch-diff.githubusercontent.com/topics/deep-learning
inference	https://patch-diff.githubusercontent.com/topics/inference
transformer	https://patch-diff.githubusercontent.com/topics/transformer
speech-recognition	https://patch-diff.githubusercontent.com/topics/speech-recognition
openai	https://patch-diff.githubusercontent.com/topics/openai
speech-to-text	https://patch-diff.githubusercontent.com/topics/speech-to-text
quantization	https://patch-diff.githubusercontent.com/topics/quantization
whisper	https://patch-diff.githubusercontent.com/topics/whisper
stas00	https://patch-diff.githubusercontent.com/stas00
ml-engineering	https://patch-diff.githubusercontent.com/stas00/ml-engineering
Star 16.4k	https://patch-diff.githubusercontent.com/login?return_to=%2Fstas00%2Fml-engineering
Code	https://patch-diff.githubusercontent.com/stas00/ml-engineering
Issues	https://patch-diff.githubusercontent.com/stas00/ml-engineering/issues
Pull requests	https://patch-diff.githubusercontent.com/stas00/ml-engineering/pulls
Discussions	https://patch-diff.githubusercontent.com/stas00/ml-engineering/discussions
training	https://patch-diff.githubusercontent.com/topics/training
debugging	https://patch-diff.githubusercontent.com/topics/debugging
machine-learning	https://patch-diff.githubusercontent.com/topics/machine-learning
ai	https://patch-diff.githubusercontent.com/topics/ai
storage	https://patch-diff.githubusercontent.com/topics/storage
network	https://patch-diff.githubusercontent.com/topics/network
scalability	https://patch-diff.githubusercontent.com/topics/scalability
transformers	https://patch-diff.githubusercontent.com/topics/transformers
slurm	https://patch-diff.githubusercontent.com/topics/slurm
inference	https://patch-diff.githubusercontent.com/topics/inference
pytorch	https://patch-diff.githubusercontent.com/topics/pytorch
machine-learning-engineering	https://patch-diff.githubusercontent.com/topics/machine-learning-engineering
gpus	https://patch-diff.githubusercontent.com/topics/gpus
mlops	https://patch-diff.githubusercontent.com/topics/mlops
large-language-models	https://patch-diff.githubusercontent.com/topics/large-language-models
llm	https://patch-diff.githubusercontent.com/topics/llm
	https://patch-diff.githubusercontent.com/gvergnaud/ts-pattern
gvergnaud	https://patch-diff.githubusercontent.com/gvergnaud
ts-pattern	https://patch-diff.githubusercontent.com/gvergnaud/ts-pattern
Sponsor	https://patch-diff.githubusercontent.com/sponsors/gvergnaud
Star 14.7k	https://patch-diff.githubusercontent.com/login?return_to=%2Fgvergnaud%2Fts-pattern
Code	https://patch-diff.githubusercontent.com/gvergnaud/ts-pattern
Issues	https://patch-diff.githubusercontent.com/gvergnaud/ts-pattern/issues
Pull requests	https://patch-diff.githubusercontent.com/gvergnaud/ts-pattern/pulls
Discussions	https://patch-diff.githubusercontent.com/gvergnaud/ts-pattern/discussions
javascript	https://patch-diff.githubusercontent.com/topics/javascript
typescript	https://patch-diff.githubusercontent.com/topics/typescript
matching	https://patch-diff.githubusercontent.com/topics/matching
pattern	https://patch-diff.githubusercontent.com/topics/pattern
pattern-matching	https://patch-diff.githubusercontent.com/topics/pattern-matching
branching	https://patch-diff.githubusercontent.com/topics/branching
inference	https://patch-diff.githubusercontent.com/topics/inference
ts	https://patch-diff.githubusercontent.com/topics/ts
conditions	https://patch-diff.githubusercontent.com/topics/conditions
type-inference	https://patch-diff.githubusercontent.com/topics/type-inference
exhaustive	https://patch-diff.githubusercontent.com/topics/exhaustive
NVIDIA	https://patch-diff.githubusercontent.com/NVIDIA
TensorRT	https://patch-diff.githubusercontent.com/NVIDIA/TensorRT
Star 12.6k	https://patch-diff.githubusercontent.com/login?return_to=%2FNVIDIA%2FTensorRT
Code	https://patch-diff.githubusercontent.com/NVIDIA/TensorRT
Issues	https://patch-diff.githubusercontent.com/NVIDIA/TensorRT/issues
Pull requests	https://patch-diff.githubusercontent.com/NVIDIA/TensorRT/pulls
deep-learning	https://patch-diff.githubusercontent.com/topics/deep-learning
inference	https://patch-diff.githubusercontent.com/topics/inference
nvidia	https://patch-diff.githubusercontent.com/topics/nvidia
gpu-acceleration	https://patch-diff.githubusercontent.com/topics/gpu-acceleration
tensorrt	https://patch-diff.githubusercontent.com/topics/tensorrt
aws	https://patch-diff.githubusercontent.com/aws
amazon-sagemaker-examples	https://patch-diff.githubusercontent.com/aws/amazon-sagemaker-examples
Star 10.9k	https://patch-diff.githubusercontent.com/login?return_to=%2Faws%2Famazon-sagemaker-examples
Code	https://patch-diff.githubusercontent.com/aws/amazon-sagemaker-examples
Issues	https://patch-diff.githubusercontent.com/aws/amazon-sagemaker-examples/issues
Pull requests	https://patch-diff.githubusercontent.com/aws/amazon-sagemaker-examples/pulls
Discussions	https://patch-diff.githubusercontent.com/aws/amazon-sagemaker-examples/discussions
training	https://patch-diff.githubusercontent.com/topics/training
aws	https://patch-diff.githubusercontent.com/topics/aws
data-science	https://patch-diff.githubusercontent.com/topics/data-science
machine-learning	https://patch-diff.githubusercontent.com/topics/machine-learning
reinforcement-learning	https://patch-diff.githubusercontent.com/topics/reinforcement-learning
deep-learning	https://patch-diff.githubusercontent.com/topics/deep-learning
examples	https://patch-diff.githubusercontent.com/topics/examples
jupyter-notebook	https://patch-diff.githubusercontent.com/topics/jupyter-notebook
inference	https://patch-diff.githubusercontent.com/topics/inference
sagemaker	https://patch-diff.githubusercontent.com/topics/sagemaker
mlops	https://patch-diff.githubusercontent.com/topics/mlops
	https://patch-diff.githubusercontent.com/GeeeekExplorer/nano-vllm
GeeeekExplorer	https://patch-diff.githubusercontent.com/GeeeekExplorer
nano-vllm	https://patch-diff.githubusercontent.com/GeeeekExplorer/nano-vllm
Star 10.8k	https://patch-diff.githubusercontent.com/login?return_to=%2FGeeeekExplorer%2Fnano-vllm
Code	https://patch-diff.githubusercontent.com/GeeeekExplorer/nano-vllm
Issues	https://patch-diff.githubusercontent.com/GeeeekExplorer/nano-vllm/issues
Pull requests	https://patch-diff.githubusercontent.com/GeeeekExplorer/nano-vllm/pulls
nlp	https://patch-diff.githubusercontent.com/topics/nlp
deep-learning	https://patch-diff.githubusercontent.com/topics/deep-learning
inference	https://patch-diff.githubusercontent.com/topics/inference
pytorch	https://patch-diff.githubusercontent.com/topics/pytorch
transformer	https://patch-diff.githubusercontent.com/topics/transformer
llm	https://patch-diff.githubusercontent.com/topics/llm
huggingface	https://patch-diff.githubusercontent.com/huggingface
text-generation-inference	https://patch-diff.githubusercontent.com/huggingface/text-generation-inference
Star 10.7k	https://patch-diff.githubusercontent.com/login?return_to=%2Fhuggingface%2Ftext-generation-inference
Code	https://patch-diff.githubusercontent.com/huggingface/text-generation-inference
Issues	https://patch-diff.githubusercontent.com/huggingface/text-generation-inference/issues
Pull requests	https://patch-diff.githubusercontent.com/huggingface/text-generation-inference/pulls
Discussions	https://patch-diff.githubusercontent.com/huggingface/text-generation-inference/discussions
nlp	https://patch-diff.githubusercontent.com/topics/nlp
bloom	https://patch-diff.githubusercontent.com/topics/bloom
deep-learning	https://patch-diff.githubusercontent.com/topics/deep-learning
inference	https://patch-diff.githubusercontent.com/topics/inference
pytorch	https://patch-diff.githubusercontent.com/topics/pytorch
falcon	https://patch-diff.githubusercontent.com/topics/falcon
transformer	https://patch-diff.githubusercontent.com/topics/transformer
gpt	https://patch-diff.githubusercontent.com/topics/gpt
starcoder	https://patch-diff.githubusercontent.com/topics/starcoder
triton-inference-server	https://patch-diff.githubusercontent.com/triton-inference-server
server	https://patch-diff.githubusercontent.com/triton-inference-server/server
Star 10.2k	https://patch-diff.githubusercontent.com/login?return_to=%2Ftriton-inference-server%2Fserver
Code	https://patch-diff.githubusercontent.com/triton-inference-server/server
Issues	https://patch-diff.githubusercontent.com/triton-inference-server/server/issues
Pull requests	https://patch-diff.githubusercontent.com/triton-inference-server/server/pulls
Discussions	https://patch-diff.githubusercontent.com/triton-inference-server/server/discussions
machine-learning	https://patch-diff.githubusercontent.com/topics/machine-learning
cloud	https://patch-diff.githubusercontent.com/topics/cloud
deep-learning	https://patch-diff.githubusercontent.com/topics/deep-learning
gpu	https://patch-diff.githubusercontent.com/topics/gpu
inference	https://patch-diff.githubusercontent.com/topics/inference
edge	https://patch-diff.githubusercontent.com/topics/edge
datacenter	https://patch-diff.githubusercontent.com/topics/datacenter
openvinotoolkit	https://patch-diff.githubusercontent.com/openvinotoolkit
openvino	https://patch-diff.githubusercontent.com/openvinotoolkit/openvino
Star 9.5k	https://patch-diff.githubusercontent.com/login?return_to=%2Fopenvinotoolkit%2Fopenvino
Code	https://patch-diff.githubusercontent.com/openvinotoolkit/openvino
Issues	https://patch-diff.githubusercontent.com/openvinotoolkit/openvino/issues
Pull requests	https://patch-diff.githubusercontent.com/openvinotoolkit/openvino/pulls
Discussions	https://patch-diff.githubusercontent.com/openvinotoolkit/openvino/discussions
nlp	https://patch-diff.githubusercontent.com/topics/nlp
natural-language-processing	https://patch-diff.githubusercontent.com/topics/natural-language-processing
ai	https://patch-diff.githubusercontent.com/topics/ai
computer-vision	https://patch-diff.githubusercontent.com/topics/computer-vision
deep-learning	https://patch-diff.githubusercontent.com/topics/deep-learning
transformers	https://patch-diff.githubusercontent.com/topics/transformers
inference	https://patch-diff.githubusercontent.com/topics/inference
speech-recognition	https://patch-diff.githubusercontent.com/topics/speech-recognition
yolo	https://patch-diff.githubusercontent.com/topics/yolo
recommendation-system	https://patch-diff.githubusercontent.com/topics/recommendation-system
performance-boost	https://patch-diff.githubusercontent.com/topics/performance-boost
good-first-issue	https://patch-diff.githubusercontent.com/topics/good-first-issue
openvino	https://patch-diff.githubusercontent.com/topics/openvino
diffusion-models	https://patch-diff.githubusercontent.com/topics/diffusion-models
stable-diffusion	https://patch-diff.githubusercontent.com/topics/stable-diffusion
generative-ai	https://patch-diff.githubusercontent.com/topics/generative-ai
llm-inference	https://patch-diff.githubusercontent.com/topics/llm-inference
optimize-ai	https://patch-diff.githubusercontent.com/topics/optimize-ai
deploy-ai	https://patch-diff.githubusercontent.com/topics/deploy-ai
xorbitsai	https://patch-diff.githubusercontent.com/xorbitsai
inference	https://patch-diff.githubusercontent.com/xorbitsai/inference
Star 9k	https://patch-diff.githubusercontent.com/login?return_to=%2Fxorbitsai%2Finference
Code	https://patch-diff.githubusercontent.com/xorbitsai/inference
Issues	https://patch-diff.githubusercontent.com/xorbitsai/inference/issues
Pull requests	https://patch-diff.githubusercontent.com/xorbitsai/inference/pulls
machine-learning	https://patch-diff.githubusercontent.com/topics/machine-learning
deployment	https://patch-diff.githubusercontent.com/topics/deployment
inference	https://patch-diff.githubusercontent.com/topics/inference
pytorch	https://patch-diff.githubusercontent.com/topics/pytorch
artificial-intelligence	https://patch-diff.githubusercontent.com/topics/artificial-intelligence
llama	https://patch-diff.githubusercontent.com/topics/llama
whisper	https://patch-diff.githubusercontent.com/topics/whisper
gemma	https://patch-diff.githubusercontent.com/topics/gemma
mistral	https://patch-diff.githubusercontent.com/topics/mistral
openai-api	https://patch-diff.githubusercontent.com/topics/openai-api
llm	https://patch-diff.githubusercontent.com/topics/llm
flan-t5	https://patch-diff.githubusercontent.com/topics/flan-t5
chatglm	https://patch-diff.githubusercontent.com/topics/chatglm
llamacpp	https://patch-diff.githubusercontent.com/topics/llamacpp
vllm	https://patch-diff.githubusercontent.com/topics/vllm
ggml	https://patch-diff.githubusercontent.com/topics/ggml
wizardlm	https://patch-diff.githubusercontent.com/topics/wizardlm
qwen	https://patch-diff.githubusercontent.com/topics/qwen
llama3	https://patch-diff.githubusercontent.com/topics/llama3
glm4	https://patch-diff.githubusercontent.com/topics/glm4
oumi-ai	https://patch-diff.githubusercontent.com/oumi-ai
oumi	https://patch-diff.githubusercontent.com/oumi-ai/oumi
Star 8.8k	https://patch-diff.githubusercontent.com/login?return_to=%2Foumi-ai%2Foumi
Code	https://patch-diff.githubusercontent.com/oumi-ai/oumi
Issues	https://patch-diff.githubusercontent.com/oumi-ai/oumi/issues
Pull requests	https://patch-diff.githubusercontent.com/oumi-ai/oumi/pulls
evaluation	https://patch-diff.githubusercontent.com/topics/evaluation
inference	https://patch-diff.githubusercontent.com/topics/inference
llama	https://patch-diff.githubusercontent.com/topics/llama
fine-tuning	https://patch-diff.githubusercontent.com/topics/fine-tuning
sft	https://patch-diff.githubusercontent.com/topics/sft
dpo	https://patch-diff.githubusercontent.com/topics/dpo
slms	https://patch-diff.githubusercontent.com/topics/slms
llms	https://patch-diff.githubusercontent.com/topics/llms
vlms	https://patch-diff.githubusercontent.com/topics/vlms
gpt-oss	https://patch-diff.githubusercontent.com/topics/gpt-oss
gpt-oss-120b	https://patch-diff.githubusercontent.com/topics/gpt-oss-120b
gpt-oss-20b	https://patch-diff.githubusercontent.com/topics/gpt-oss-20b
	https://patch-diff.githubusercontent.com/dusty-nv/jetson-inference
dusty-nv	https://patch-diff.githubusercontent.com/dusty-nv
jetson-inference	https://patch-diff.githubusercontent.com/dusty-nv/jetson-inference
Star 8.7k	https://patch-diff.githubusercontent.com/login?return_to=%2Fdusty-nv%2Fjetson-inference
Code	https://patch-diff.githubusercontent.com/dusty-nv/jetson-inference
Issues	https://patch-diff.githubusercontent.com/dusty-nv/jetson-inference/issues
Pull requests	https://patch-diff.githubusercontent.com/dusty-nv/jetson-inference/pulls
machine-learning	https://patch-diff.githubusercontent.com/topics/machine-learning
embedded	https://patch-diff.githubusercontent.com/topics/embedded
caffe	https://patch-diff.githubusercontent.com/topics/caffe
computer-vision	https://patch-diff.githubusercontent.com/topics/computer-vision
deep-learning	https://patch-diff.githubusercontent.com/topics/deep-learning
robotics	https://patch-diff.githubusercontent.com/topics/robotics
inference	https://patch-diff.githubusercontent.com/topics/inference
nvidia	https://patch-diff.githubusercontent.com/topics/nvidia
digits	https://patch-diff.githubusercontent.com/topics/digits
image-recognition	https://patch-diff.githubusercontent.com/topics/image-recognition
segmentation	https://patch-diff.githubusercontent.com/topics/segmentation
object-detection	https://patch-diff.githubusercontent.com/topics/object-detection
jetson-tx1	https://patch-diff.githubusercontent.com/topics/jetson-tx1
jetson	https://patch-diff.githubusercontent.com/topics/jetson
tensorrt	https://patch-diff.githubusercontent.com/topics/tensorrt
jetson-tx2	https://patch-diff.githubusercontent.com/topics/jetson-tx2
video-analytics	https://patch-diff.githubusercontent.com/topics/video-analytics
jetson-xavier	https://patch-diff.githubusercontent.com/topics/jetson-xavier
jetson-nano	https://patch-diff.githubusercontent.com/topics/jetson-nano
jetson-xavier-nx	https://patch-diff.githubusercontent.com/topics/jetson-xavier-nx
Linzaer	https://patch-diff.githubusercontent.com/Linzaer
Ultra-Light-Fast-Generic-Face-Detector-1MB	https://patch-diff.githubusercontent.com/Linzaer/Ultra-Light-Fast-Generic-Face-Detector-1MB
Star 7.5k	https://patch-diff.githubusercontent.com/login?return_to=%2FLinzaer%2FUltra-Light-Fast-Generic-Face-Detector-1MB
Code	https://patch-diff.githubusercontent.com/Linzaer/Ultra-Light-Fast-Generic-Face-Detector-1MB
Issues	https://patch-diff.githubusercontent.com/Linzaer/Ultra-Light-Fast-Generic-Face-Detector-1MB/issues
Pull requests	https://patch-diff.githubusercontent.com/Linzaer/Ultra-Light-Fast-Generic-Face-Detector-1MB/pulls
arm	https://patch-diff.githubusercontent.com/topics/arm
inference	https://patch-diff.githubusercontent.com/topics/inference
face-detection	https://patch-diff.githubusercontent.com/topics/face-detection
mnn	https://patch-diff.githubusercontent.com/topics/mnn
ncnn	https://patch-diff.githubusercontent.com/topics/ncnn
Curate this topic	https://github.com/github/explore/tree/master/CONTRIBUTING.md?source=add-description-inference
Learn more	https://docs.github.com/en/articles/classifying-your-repository-with-topics
	https://github.com
Terms	https://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacy	https://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Security	https://github.com/security
Status	https://www.githubstatus.com/
Community	https://github.community/
Docs	https://docs.github.com/
Contact	https://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.