René's URL Explorer Experiment

Title: serving · GitHub Topics · GitHub

Open Graph Title: Build software better, together

X Title: GitHub

Description: GitHub is where people build software. More than 150 million people use GitHub to discover, fork, and contribute to over 420 million projects.

Open Graph Description: GitHub is where people build software. More than 150 million people use GitHub to discover, fork, and contribute to over 420 million projects.

X Description: GitHub is where people build software. More than 150 million people use GitHub to discover, fork, and contribute to over 420 million projects.

Opengraph URL: https://github.com

X: github

direct link

Domain: github.com

route-pattern	/topics/:topic_name(.:format)
route-controller	topics
route-action	show
fetch-nonce	v2:8d3b8508-f284-4b5b-83aa-ee83c916a6cd
current-catalog-service-hash	82c569b93da5c18ed649ebd4c2c79437db4611a6a1373e805a3cb001c64130b7
request-id	AAAA:333234:7CBCC:A2771:696454BA
html-safe-nonce	d884037eecaff8b20108e34fea688f893cc1ec9d2ec88e6701d762b0a6d09be6
visitor-payload	eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJBQUFBOjMzMzIzNDo3Q0JDQzpBMjc3MTo2OTY0NTRCQSIsInZpc2l0b3JfaWQiOiI0NjQ4MTI0MjMwNjc3MDU4NzQ2IiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0=
visitor-hmac	af961eac873d16f6d85690f9b21f44ab2c717446899e4ae83445022219ca2996
github-keyboard-shortcuts	copilot
google-site-verification	Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-url	https://collector.github.com/github/collect
fb:app_id	1401488693436528
apple-itunes-app	app-id=1477376905, app-argument=https://github.com/topics/serving
og:site_name	GitHub
og:image	https://github.githubassets.com/assets/github-octocat-13c86b8b336d.png
og:image:type	image/png
og:image:width	1200
og:image:height	620
twitter:site:id	13334762
twitter:creator	github
twitter:creator:id	13334762
twitter:card	summary_large_image
twitter:image	https://github.githubassets.com/assets/github-logo-55c5b9a1fe52.png
twitter:image:width	1200
twitter:image:height	1200
hostname	github.com
expected-hostname	github.com
None	baa7d9900fdf7b27d604f36887af878d569cfbdcf97126832a5f4f0caf0c6ba5
turbo-cache-control	no-preview
turbo-body-classes	logged-out env-production page-responsive
disable-turbo	false
browser-stats-url	https://api.github.com/_private/browser/stats
browser-errors-url	https://api.github.com/_private/browser/errors
release	842eff1d11f899d02b6b3b98fa3ea4860e64b34e
ui-target	full
theme-color	#1e2327
color-scheme	light dark

Links:

Skip to content	https://github.com/topics/serving#start-of-content
	https://github.com/
Sign in	https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Ftopics%2Fserving
GitHub CopilotWrite better code with AI	https://github.com/features/copilot
GitHub SparkBuild and deploy intelligent apps	https://github.com/features/spark
GitHub ModelsManage and compare prompts	https://github.com/features/models
MCP RegistryNewIntegrate external tools	https://github.com/mcp
ActionsAutomate any workflow	https://github.com/features/actions
CodespacesInstant dev environments	https://github.com/features/codespaces
IssuesPlan and track work	https://github.com/features/issues
Code ReviewManage code changes	https://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilities	https://github.com/security/advanced-security
Code securitySecure your code as you build	https://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they start	https://github.com/security/advanced-security/secret-protection
Why GitHub	https://github.com/why-github
Documentation	https://docs.github.com
Blog	https://github.blog
Changelog	https://github.blog/changelog
Marketplace	https://github.com/marketplace
View all features	https://github.com/features
Enterprises	https://github.com/enterprise
Small and medium teams	https://github.com/team
Startups	https://github.com/enterprise/startups
Nonprofits	https://github.com/solutions/industry/nonprofits
App Modernization	https://github.com/solutions/use-case/app-modernization
DevSecOps	https://github.com/solutions/use-case/devsecops
DevOps	https://github.com/solutions/use-case/devops
CI/CD	https://github.com/solutions/use-case/ci-cd
View all use cases	https://github.com/solutions/use-case
Healthcare	https://github.com/solutions/industry/healthcare
Financial services	https://github.com/solutions/industry/financial-services
Manufacturing	https://github.com/solutions/industry/manufacturing
Government	https://github.com/solutions/industry/government
View all industries	https://github.com/solutions/industry
View all solutions	https://github.com/solutions
AI	https://github.com/resources/articles?topic=ai
Software Development	https://github.com/resources/articles?topic=software-development
DevOps	https://github.com/resources/articles?topic=devops
Security	https://github.com/resources/articles?topic=security
View all topics	https://github.com/resources/articles
Customer stories	https://github.com/customer-stories
Events & webinars	https://github.com/resources/events
Ebooks & reports	https://github.com/resources/whitepapers
Business insights	https://github.com/solutions/executive-insights
GitHub Skills	https://skills.github.com
Documentation	https://docs.github.com
Customer support	https://support.github.com
Community forum	https://github.com/orgs/community/discussions
Trust center	https://github.com/trust-center
Partners	https://github.com/partners
GitHub SponsorsFund open source developers	https://github.com/sponsors
Security Lab	https://securitylab.github.com
Maintainer Community	https://maintainers.github.com
Accelerator	https://github.com/accelerator
Archive Program	https://archiveprogram.github.com
Topics	https://github.com/topics
Trending	https://github.com/trending
Collections	https://github.com/collections
Enterprise platformAI-powered developer platform	https://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security features	https://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI features	https://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 support	https://github.com/premium-support
Pricing	https://github.com/pricing
Search syntax tips	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentation	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in	https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Ftopics%2Fserving
Sign up	https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2Ftopics%2Fserving&source=header
Reload	https://github.com/topics/serving
Reload	https://github.com/topics/serving
Reload	https://github.com/topics/serving
Explore	https://github.com/explore
Topics	https://github.com/topics
Trending	https://github.com/trending
Collections	https://github.com/collections
Events	https://github.com/events
GitHub Sponsors	https://github.com/sponsors/explore
Star	https://github.com/login?return_to=%2Ftopic.serving
All 133	https://github.com/topics/serving
Python 61	https://github.com/topics/serving?l=python
C++ 16	https://github.com/topics/serving?l=c%2B%2B
Jupyter Notebook 13	https://github.com/topics/serving?l=jupyter+notebook
Java 8	https://github.com/topics/serving?l=java
Go 6	https://github.com/topics/serving?l=go
HTML 6	https://github.com/topics/serving?l=html
Shell 3	https://github.com/topics/serving?l=shell
Scala 2	https://github.com/topics/serving?l=scala
C# 1	https://github.com/topics/serving?l=c%23
Dockerfile 1	https://github.com/topics/serving?l=dockerfile
Most stars	https://github.com/topics/serving?o=desc&s=stars
Fewest stars	https://github.com/topics/serving?o=asc&s=stars
Most forks	https://github.com/topics/serving?o=desc&s=forks
Fewest forks	https://github.com/topics/serving?o=asc&s=forks
Recently updated	https://github.com/topics/serving?o=desc&s=updated
Least recently updated	https://github.com/topics/serving?o=asc&s=updated
ray-project	https://github.com/ray-project
ray	https://github.com/ray-project/ray
Star 40.7k	https://github.com/login?return_to=%2Fray-project%2Fray
Code	https://github.com/ray-project/ray
Issues	https://github.com/ray-project/ray/issues
Pull requests	https://github.com/ray-project/ray/pulls
python	https://github.com/topics/python
data-science	https://github.com/topics/data-science
machine-learning	https://github.com/topics/machine-learning
reinforcement-learning	https://github.com/topics/reinforcement-learning
deep-learning	https://github.com/topics/deep-learning
deployment	https://github.com/topics/deployment
tensorflow	https://github.com/topics/tensorflow
optimization	https://github.com/topics/optimization
parallel	https://github.com/topics/parallel
pytorch	https://github.com/topics/pytorch
distributed	https://github.com/topics/distributed
hyperparameter-optimization	https://github.com/topics/hyperparameter-optimization
ray	https://github.com/topics/ray
hyperparameter-search	https://github.com/topics/hyperparameter-search
serving	https://github.com/topics/serving
rllib	https://github.com/topics/rllib
large-language-models	https://github.com/topics/large-language-models
llm	https://github.com/topics/llm
llm-serving	https://github.com/topics/llm-serving
llm-inference	https://github.com/topics/llm-inference
tensorflow	https://github.com/tensorflow
serving	https://github.com/tensorflow/serving
Star 6.3k	https://github.com/login?return_to=%2Ftensorflow%2Fserving
Code	https://github.com/tensorflow/serving
Issues	https://github.com/tensorflow/serving/issues
Pull requests	https://github.com/tensorflow/serving/pulls
python	https://github.com/topics/python
machine-learning	https://github.com/topics/machine-learning
deep-neural-networks	https://github.com/topics/deep-neural-networks
deep-learning	https://github.com/topics/deep-learning
neural-network	https://github.com/topics/neural-network
cpp	https://github.com/topics/cpp
tensorflow	https://github.com/topics/tensorflow
ml	https://github.com/topics/ml
serving	https://github.com/topics/serving
volcano-sh	https://github.com/volcano-sh
volcano	https://github.com/volcano-sh/volcano
Star 5.2k	https://github.com/login?return_to=%2Fvolcano-sh%2Fvolcano
Code	https://github.com/volcano-sh/volcano
Issues	https://github.com/volcano-sh/volcano/issues
Pull requests	https://github.com/volcano-sh/volcano/pulls
training	https://github.com/topics/training
kubernetes	https://github.com/topics/kubernetes
golang	https://github.com/topics/golang
machine-learning	https://github.com/topics/machine-learning
gene	https://github.com/topics/gene
ai	https://github.com/topics/ai
hpc	https://github.com/topics/hpc
bigdata	https://github.com/topics/bigdata
serving	https://github.com/topics/serving
batch-systems	https://github.com/topics/batch-systems
SeldonIO	https://github.com/SeldonIO
seldon-core	https://github.com/SeldonIO/seldon-core
Star 4.7k	https://github.com/login?return_to=%2FSeldonIO%2Fseldon-core
Code	https://github.com/SeldonIO/seldon-core
Issues	https://github.com/SeldonIO/seldon-core/issues
Pull requests	https://github.com/SeldonIO/seldon-core/pulls
kubernetes	https://github.com/topics/kubernetes
machine-learning	https://github.com/topics/machine-learning
deployment	https://github.com/topics/deployment
serving	https://github.com/topics/serving
aiops	https://github.com/topics/aiops
production-machine-learning	https://github.com/topics/production-machine-learning
mlops	https://github.com/topics/mlops
machine-learning-operations	https://github.com/topics/machine-learning-operations
ahkarami	https://github.com/ahkarami
Deep-Learning-in-Production	https://github.com/ahkarami/Deep-Learning-in-Production
Star 4.4k	https://github.com/login?return_to=%2Fahkarami%2FDeep-Learning-in-Production
Code	https://github.com/ahkarami/Deep-Learning-in-Production
Issues	https://github.com/ahkarami/Deep-Learning-in-Production/issues
Pull requests	https://github.com/ahkarami/Deep-Learning-in-Production/pulls
react	https://github.com/topics/react
python	https://github.com/topics/python
angularjs	https://github.com/topics/angularjs
flask	https://github.com/topics/flask
c-plus-plus	https://github.com/topics/c-plus-plus
tutorial	https://github.com/topics/tutorial
deep-neural-networks	https://github.com/topics/deep-neural-networks
deep-learning	https://github.com/topics/deep-learning
mxnet	https://github.com/topics/mxnet
rest-api	https://github.com/topics/rest-api
production	https://github.com/topics/production
keras	https://github.com/topics/keras
pytorch	https://github.com/topics/pytorch
tensorflow-models	https://github.com/topics/tensorflow-models
tesnorflow	https://github.com/topics/tesnorflow
model-serving	https://github.com/topics/model-serving
caffe2	https://github.com/topics/caffe2
serving	https://github.com/topics/serving
serving-pytorch-models	https://github.com/topics/serving-pytorch-models
convert-pytorch-models	https://github.com/topics/convert-pytorch-models
pytorch	https://github.com/pytorch
serve	https://github.com/pytorch/serve
Star 4.4k	https://github.com/login?return_to=%2Fpytorch%2Fserve
Code	https://github.com/pytorch/serve
Issues	https://github.com/pytorch/serve/issues
Pull requests	https://github.com/pytorch/serve/pulls
docker	https://github.com/topics/docker
kubernetes	https://github.com/topics/kubernetes
machine-learning	https://github.com/topics/machine-learning
cpu	https://github.com/topics/cpu
deep-learning	https://github.com/topics/deep-learning
metrics	https://github.com/topics/metrics
gpu	https://github.com/topics/gpu
optimization	https://github.com/topics/optimization
pytorch	https://github.com/topics/pytorch
serving	https://github.com/topics/serving
mlops	https://github.com/topics/mlops
Lightning-AI	https://github.com/Lightning-AI
LitServe	https://github.com/Lightning-AI/LitServe
Star 3.8k	https://github.com/login?return_to=%2FLightning-AI%2FLitServe
Code	https://github.com/Lightning-AI/LitServe
Issues	https://github.com/Lightning-AI/LitServe/issues
Pull requests	https://github.com/Lightning-AI/LitServe/pulls
api	https://github.com/topics/api
web	https://github.com/topics/web
ai	https://github.com/topics/ai
deep-learning	https://github.com/topics/deep-learning
rest-api	https://github.com/topics/rest-api
artificial-intelligence	https://github.com/topics/artificial-intelligence
developer-tools	https://github.com/topics/developer-tools
serving	https://github.com/topics/serving
fastapi	https://github.com/topics/fastapi
skyzh	https://github.com/skyzh
tiny-llm	https://github.com/skyzh/tiny-llm
Star 3.7k	https://github.com/login?return_to=%2Fskyzh%2Ftiny-llm
Code	https://github.com/skyzh/tiny-llm
Issues	https://github.com/skyzh/tiny-llm/issues
Pull requests	https://github.com/skyzh/tiny-llm/pulls
python	https://github.com/topics/python
course	https://github.com/topics/course
serving	https://github.com/topics/serving
llm	https://github.com/topics/llm
large-language-model	https://github.com/topics/large-language-model
vllm	https://github.com/topics/vllm
qwen	https://github.com/topics/qwen
qwen2	https://github.com/topics/qwen2
PaddlePaddle	https://github.com/PaddlePaddle
FastDeploy	https://github.com/PaddlePaddle/FastDeploy
Star 3.6k	https://github.com/login?return_to=%2FPaddlePaddle%2FFastDeploy
Code	https://github.com/PaddlePaddle/FastDeploy
Issues	https://github.com/PaddlePaddle/FastDeploy/issues
Pull requests	https://github.com/PaddlePaddle/FastDeploy/pulls
Discussions	https://github.com/PaddlePaddle/FastDeploy/discussions
inference	https://github.com/topics/inference
openai	https://github.com/topics/openai
serving	https://github.com/topics/serving
ernie	https://github.com/topics/ernie
llm	https://github.com/topics/llm
llm-serving	https://github.com/topics/llm-serving
vllm	https://github.com/topics/vllm
ernie-45	https://github.com/topics/ernie-45
ernie-45-vl	https://github.com/topics/ernie-45-vl
	https://github.com/georgia-tech-db/evadb
georgia-tech-db	https://github.com/georgia-tech-db
evadb	https://github.com/georgia-tech-db/evadb
Star 2.7k	https://github.com/login?return_to=%2Fgeorgia-tech-db%2Fevadb
Code	https://github.com/georgia-tech-db/evadb
Issues	https://github.com/georgia-tech-db/evadb/issues
Pull requests	https://github.com/georgia-tech-db/evadb/pulls
Discussions	https://github.com/georgia-tech-db/evadb/discussions
agent	https://github.com/topics/agent
database	https://github.com/topics/database
ai	https://github.com/topics/ai
data-analysis	https://github.com/topics/data-analysis
eva	https://github.com/topics/eva
object-detection	https://github.com/topics/object-detection
labeling	https://github.com/topics/labeling
hacktoberfest	https://github.com/topics/hacktoberfest
video-analytics	https://github.com/topics/video-analytics
serving	https://github.com/topics/serving
huggingface	https://github.com/topics/huggingface
gpt-4	https://github.com/topics/gpt-4
llm	https://github.com/topics/llm
chatgpt	https://github.com/topics/chatgpt
langchain	https://github.com/topics/langchain
gpt4all	https://github.com/topics/gpt4all
auto-gpt	https://github.com/topics/auto-gpt
tobegit3hub	https://github.com/tobegit3hub
tensorflow_template_application	https://github.com/tobegit3hub/tensorflow_template_application
Star 1.9k	https://github.com/login?return_to=%2Ftobegit3hub%2Ftensorflow_template_application
Code	https://github.com/tobegit3hub/tensorflow_template_application
Issues	https://github.com/tobegit3hub/tensorflow_template_application/issues
Pull requests	https://github.com/tobegit3hub/tensorflow_template_application/pulls
machine-learning	https://github.com/topics/machine-learning
csv	https://github.com/topics/csv
deep-learning	https://github.com/topics/deep-learning
tensorflow	https://github.com/topics/tensorflow
inference	https://github.com/topics/inference
cnn	https://github.com/topics/cnn
lstm	https://github.com/topics/lstm
tensorboard	https://github.com/topics/tensorboard
mlp	https://github.com/topics/mlp
libsvm	https://github.com/topics/libsvm
tfrecords	https://github.com/topics/tfrecords
wide-and-deep	https://github.com/topics/wide-and-deep
serving	https://github.com/topics/serving
	https://github.com/ray-project/llm-applications
ray-project	https://github.com/ray-project
llm-applications	https://github.com/ray-project/llm-applications
Star 1.8k	https://github.com/login?return_to=%2Fray-project%2Fllm-applications
Code	https://github.com/ray-project/llm-applications
Issues	https://github.com/ray-project/llm-applications/issues
Pull requests	https://github.com/ray-project/llm-applications/pulls
machine-learning	https://github.com/topics/machine-learning
openai	https://github.com/topics/openai
ray	https://github.com/topics/ray
serving	https://github.com/topics/serving
fine-tuning	https://github.com/topics/fine-tuning
anyscale	https://github.com/topics/anyscale
llms	https://github.com/topics/llms
llama2	https://github.com/topics/llama2
dingodb	https://github.com/dingodb
dingo	https://github.com/dingodb/dingo
Star 1.7k	https://github.com/login?return_to=%2Fdingodb%2Fdingo
Code	https://github.com/dingodb/dingo
Issues	https://github.com/dingodb/dingo/issues
Pull requests	https://github.com/dingodb/dingo/pulls
Discussions	https://github.com/dingodb/dingo/discussions
structured-data	https://github.com/topics/structured-data
serving	https://github.com/topics/serving
unstructured-data	https://github.com/topics/unstructured-data
unified-sql	https://github.com/topics/unified-sql
vector-database	https://github.com/topics/vector-database
mysql-compatibility	https://github.com/topics/mysql-compatibility
hybrid-search	https://github.com/topics/hybrid-search
embedding-search	https://github.com/topics/embedding-search
embedding-store	https://github.com/topics/embedding-store
key-value-distributed-store	https://github.com/topics/key-value-distributed-store
vector-ocean	https://github.com/topics/vector-ocean
real-time-semantic-search	https://github.com/topics/real-time-semantic-search
Delta-ML	https://github.com/Delta-ML
delta	https://github.com/Delta-ML/delta
Star 1.6k	https://github.com/login?return_to=%2FDelta-ML%2Fdelta
Code	https://github.com/Delta-ML/delta
Issues	https://github.com/Delta-ML/delta/issues
Pull requests	https://github.com/Delta-ML/delta/pulls
https://lfaidata.foundation/projects/delta/	https://lfaidata.foundation/projects/delta/
nlp	https://github.com/topics/nlp
front-end	https://github.com/topics/front-end
ops	https://github.com/topics/ops
deep-learning	https://github.com/topics/deep-learning
text-classification	https://github.com/topics/text-classification
tensorflow	https://github.com/topics/tensorflow
nlu	https://github.com/topics/nlu
speech	https://github.com/topics/speech
inference	https://github.com/topics/inference
text-generation	https://github.com/topics/text-generation
speech-recognition	https://github.com/topics/speech-recognition
seq2seq	https://github.com/topics/seq2seq
sequence-to-sequence	https://github.com/topics/sequence-to-sequence
speaker-verification	https://github.com/topics/speaker-verification
asr	https://github.com/topics/asr
tensorflow-serving	https://github.com/topics/tensorflow-serving
emotion-recognition	https://github.com/topics/emotion-recognition
custom-ops	https://github.com/topics/custom-ops
serving	https://github.com/topics/serving
tensorflow-lite	https://github.com/topics/tensorflow-lite
PaddlePaddle	https://github.com/PaddlePaddle
Serving	https://github.com/PaddlePaddle/Serving
Star 922	https://github.com/login?return_to=%2FPaddlePaddle%2FServing
Code	https://github.com/PaddlePaddle/Serving
Issues	https://github.com/PaddlePaddle/Serving/issues
Pull requests	https://github.com/PaddlePaddle/Serving/pulls
python	https://github.com/topics/python
docker	https://github.com/topics/docker
deep-learning	https://github.com/topics/deep-learning
pipeline	https://github.com/topics/pipeline
gpu	https://github.com/topics/gpu
prediction	https://github.com/topics/prediction
micro-service	https://github.com/topics/micro-service
rpc-service	https://github.com/topics/rpc-service
dag	https://github.com/topics/dag
paddle	https://github.com/topics/paddle
microservice-toolkit	https://github.com/topics/microservice-toolkit
predictor	https://github.com/topics/predictor
serving	https://github.com/topics/serving
online-service	https://github.com/topics/online-service
paddle-serving	https://github.com/topics/paddle-serving
openvinotoolkit	https://github.com/openvinotoolkit
model_server	https://github.com/openvinotoolkit/model_server
Star 810	https://github.com/login?return_to=%2Fopenvinotoolkit%2Fmodel_server
Code	https://github.com/openvinotoolkit/model_server
Issues	https://github.com/openvinotoolkit/model_server/issues
Pull requests	https://github.com/openvinotoolkit/model_server/pulls
Discussions	https://github.com/openvinotoolkit/model_server/discussions
kubernetes	https://github.com/topics/kubernetes
machine-learning	https://github.com/topics/machine-learning
cloud	https://github.com/topics/cloud
ai	https://github.com/topics/ai
deep-learning	https://github.com/topics/deep-learning
inference	https://github.com/topics/inference
edge	https://github.com/topics/edge
dag	https://github.com/topics/dag
model-serving	https://github.com/topics/model-serving
serving	https://github.com/topics/serving
openvino	https://github.com/topics/openvino
genai	https://github.com/topics/genai
tobegit3hub	https://github.com/tobegit3hub
simple_tensorflow_serving	https://github.com/tobegit3hub/simple_tensorflow_serving
Star 761	https://github.com/login?return_to=%2Ftobegit3hub%2Fsimple_tensorflow_serving
Code	https://github.com/tobegit3hub/simple_tensorflow_serving
Issues	https://github.com/tobegit3hub/simple_tensorflow_serving/issues
Pull requests	https://github.com/tobegit3hub/simple_tensorflow_serving/pulls
http	https://github.com/topics/http
client	https://github.com/topics/client
machine-learning	https://github.com/topics/machine-learning
deep-learning	https://github.com/topics/deep-learning
tensorflow	https://github.com/topics/tensorflow
tensorflow-models	https://github.com/topics/tensorflow-models
serving	https://github.com/topics/serving
savedmodel	https://github.com/topics/savedmodel
underneathall	https://github.com/underneathall
pinferencia	https://github.com/underneathall/pinferencia
Star 544	https://github.com/login?return_to=%2Funderneathall%2Fpinferencia
Code	https://github.com/underneathall/pinferencia
Issues	https://github.com/underneathall/pinferencia/issues
Pull requests	https://github.com/underneathall/pinferencia/pulls
Discussions	https://github.com/underneathall/pinferencia/discussions
python	https://github.com/topics/python
nlp	https://github.com/topics/nlp
data-science	https://github.com/topics/data-science
machine-learning	https://github.com/topics/machine-learning
ai	https://github.com/topics/ai
computer-vision	https://github.com/topics/computer-vision
deep-learning	https://github.com/topics/deep-learning
tensorflow	https://github.com/topics/tensorflow
transformers	https://github.com/topics/transformers
inference	https://github.com/topics/inference
pytorch	https://github.com/topics/pytorch
artificial-intelligence	https://github.com/topics/artificial-intelligence
inference-server	https://github.com/topics/inference-server
predict	https://github.com/topics/predict
paddlepaddle	https://github.com/topics/paddlepaddle
model-deployment	https://github.com/topics/model-deployment
model-serving	https://github.com/topics/model-serving
serving	https://github.com/topics/serving
huggingface	https://github.com/topics/huggingface
modelserver	https://github.com/topics/modelserver
meta-soul	https://github.com/meta-soul
MetaSpore	https://github.com/meta-soul/MetaSpore
Star 540	https://github.com/login?return_to=%2Fmeta-soul%2FMetaSpore
Code	https://github.com/meta-soul/MetaSpore
Issues	https://github.com/meta-soul/MetaSpore/issues
Pull requests	https://github.com/meta-soul/MetaSpore/pulls
Discussions	https://github.com/meta-soul/MetaSpore/discussions
training	https://github.com/topics/training
ai	https://github.com/topics/ai
machinelearning	https://github.com/topics/machinelearning
deeplearning	https://github.com/topics/deeplearning
abtesting	https://github.com/topics/abtesting
serving	https://github.com/topics/serving
vectorch-ai	https://github.com/vectorch-ai
ScaleLLM	https://github.com/vectorch-ai/ScaleLLM
Star 489	https://github.com/login?return_to=%2Fvectorch-ai%2FScaleLLM
Code	https://github.com/vectorch-ai/ScaleLLM
Issues	https://github.com/vectorch-ai/ScaleLLM/issues
Pull requests	https://github.com/vectorch-ai/ScaleLLM/pulls
Discussions	https://github.com/vectorch-ai/ScaleLLM/discussions
performance	https://github.com/topics/performance
gpu	https://github.com/topics/gpu
model	https://github.com/topics/model
production	https://github.com/topics/production
cuda	https://github.com/topics/cuda
efficiency	https://github.com/topics/efficiency
inference	https://github.com/topics/inference
transformer	https://github.com/topics/transformer
llama	https://github.com/topics/llama
speculative	https://github.com/topics/speculative
serving	https://github.com/topics/serving
llm	https://github.com/topics/llm
llm-inference	https://github.com/topics/llm-inference
llama3	https://github.com/topics/llama3
Curate this topic	https://github.com/github/explore/tree/master/CONTRIBUTING.md?source=add-description-serving
Learn more	https://docs.github.com/en/articles/classifying-your-repository-with-topics
	https://github.com
Terms	https://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacy	https://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Security	https://github.com/security
Status	https://www.githubstatus.com/
Community	https://github.community/
Docs	https://docs.github.com/
Contact	https://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.