René's URL Explorer Experiment


Title: GitHub - jangcode/litellm: Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM] · GitHub

Open Graph Title: GitHub - jangcode/litellm: Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

X Title: GitHub - jangcode/litellm: Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

Description: Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM] - jangcode/litellm

Open Graph Description: Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthr...

X Description: Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthr...

Mail addresses
ishaan@berri.ai
krrish@berri.ai

Opengraph URL: https://github.com/jangcode/litellm

X: @github

direct link

Domain: github.com

route-pattern/:user_id/:repository
route-controllerfiles
route-actiondisambiguate
fetch-noncev2:dd991583-aa39-11b2-3178-90fc350d578a
current-catalog-service-hashf3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-idC26E:2B1453:1A4F77:22CACB:6A616C27
html-safe-noncee289eb185dffd907eeb0a1c39139d3fc7beda30e02f50021d0c618b62c65ef88
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJDMjZFOjJCMTQ1MzoxQTRGNzc6MjJDQUNCOjZBNjE2QzI3IiwidmlzaXRvcl9pZCI6IjI2NzQ2MDcxOTM2MzYwMzk3MTkiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmac382336b899df711ffcb19761c9ca241ac8277be334e0fd105e7f4ec421270527
hovercard-subject-tagrepository:1098728024
github-keyboard-shortcutsrepository,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location//
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/jangcode/litellm
twitter:imagehttps://opengraph.githubassets.com/52cc34fa2298e960d385f25e4889822d950aa4d7f10d75833e0554011652558f/jangcode/litellm
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/52cc34fa2298e960d385f25e4889822d950aa4d7f10d75833e0554011652558f/jangcode/litellm
og:image:altPython SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthr...
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
Nonea69385f7d268ece7ad25b131bbd70f457024811fc79afcae43785a6849b724e2
turbo-cache-controlno-cache
go-importgithub.com/jangcode/litellm git https://github.com/jangcode/litellm.git
octolytics-dimension-user_id3041409
octolytics-dimension-user_loginjangcode
octolytics-dimension-repository_id1098728024
octolytics-dimension-repository_nwojangcode/litellm
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forktrue
octolytics-dimension-repository_parent_id671269505
octolytics-dimension-repository_parent_nwoBerriAI/litellm
octolytics-dimension-repository_network_root_id671269505
octolytics-dimension-repository_network_root_nwoBerriAI/litellm
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release484cf265a1f970d5c7a5e7c37cb677d8010aa12f
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/jangcode/litellm#start-of-content
https://github.com/
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fjangcode%2Flitellm
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub Copilot appDirect agents from issue to mergehttps://github.com/features/ai/github-app
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
Code QualityEnforce quality at mergehttps://github.com/features/code-quality
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
View all resourceshttps://github.com/resources
GitHub SponsorsFund open source developershttps://github.com/open-source/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/open-source/accelerator
GitHub Starshttps://stars.github.com
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fjangcode%2Flitellm
Sign up https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=jangcode%2Flitellm
Reloadhttps://github.com/jangcode/litellm
Reloadhttps://github.com/jangcode/litellm
Reloadhttps://github.com/jangcode/litellm
jangcode https://github.com/jangcode
litellmhttps://github.com/jangcode/litellm
BerriAI/litellmhttps://github.com/BerriAI/litellm
Notifications https://github.com/login?return_to=%2Fjangcode%2Flitellm
Fork 0 https://github.com/login?return_to=%2Fjangcode%2Flitellm
Star 0 https://github.com/login?return_to=%2Fjangcode%2Flitellm
Code https://github.com/jangcode/litellm
Pull requests 0 https://github.com/jangcode/litellm/pulls
Actions https://github.com/jangcode/litellm/actions
Projects https://github.com/jangcode/litellm/projects
Security and quality 0 https://github.com/jangcode/litellm/security
Insights https://github.com/jangcode/litellm/pulse
Code https://github.com/jangcode/litellm
Pull requests https://github.com/jangcode/litellm/pulls
Actions https://github.com/jangcode/litellm/actions
Projects https://github.com/jangcode/litellm/projects
Security and quality https://github.com/jangcode/litellm/security
Insights https://github.com/jangcode/litellm/pulse
https://github.com/jangcode/litellm
Brancheshttps://github.com/jangcode/litellm/branches
Tagshttps://github.com/jangcode/litellm/tags
https://github.com/jangcode/litellm/branches
https://github.com/jangcode/litellm/tags
27,464 Commitshttps://github.com/jangcode/litellm/commits/main/
https://github.com/jangcode/litellm/commits/main/
.circlecihttps://github.com/jangcode/litellm/tree/main/.circleci
.circlecihttps://github.com/jangcode/litellm/tree/main/.circleci
.devcontainerhttps://github.com/jangcode/litellm/tree/main/.devcontainer
.devcontainerhttps://github.com/jangcode/litellm/tree/main/.devcontainer
.githubhttps://github.com/jangcode/litellm/tree/main/.github
.githubhttps://github.com/jangcode/litellm/tree/main/.github
ci_cdhttps://github.com/jangcode/litellm/tree/main/ci_cd
ci_cdhttps://github.com/jangcode/litellm/tree/main/ci_cd
cookbookhttps://github.com/jangcode/litellm/tree/main/cookbook
cookbookhttps://github.com/jangcode/litellm/tree/main/cookbook
db_scriptshttps://github.com/jangcode/litellm/tree/main/db_scripts
db_scriptshttps://github.com/jangcode/litellm/tree/main/db_scripts
deployhttps://github.com/jangcode/litellm/tree/main/deploy
deployhttps://github.com/jangcode/litellm/tree/main/deploy
disthttps://github.com/jangcode/litellm/tree/main/dist
disthttps://github.com/jangcode/litellm/tree/main/dist
dockerhttps://github.com/jangcode/litellm/tree/main/docker
dockerhttps://github.com/jangcode/litellm/tree/main/docker
docs/my-websitehttps://github.com/jangcode/litellm/tree/main/docs/my-website
docs/my-websitehttps://github.com/jangcode/litellm/tree/main/docs/my-website
enterprisehttps://github.com/jangcode/litellm/tree/main/enterprise
enterprisehttps://github.com/jangcode/litellm/tree/main/enterprise
litellm-jshttps://github.com/jangcode/litellm/tree/main/litellm-js
litellm-jshttps://github.com/jangcode/litellm/tree/main/litellm-js
litellm-proxy-extrashttps://github.com/jangcode/litellm/tree/main/litellm-proxy-extras
litellm-proxy-extrashttps://github.com/jangcode/litellm/tree/main/litellm-proxy-extras
litellmhttps://github.com/jangcode/litellm/tree/main/litellm
litellmhttps://github.com/jangcode/litellm/tree/main/litellm
scriptshttps://github.com/jangcode/litellm/tree/main/scripts
scriptshttps://github.com/jangcode/litellm/tree/main/scripts
testshttps://github.com/jangcode/litellm/tree/main/tests
testshttps://github.com/jangcode/litellm/tree/main/tests
ui/litellm-dashboardhttps://github.com/jangcode/litellm/tree/main/ui/litellm-dashboard
ui/litellm-dashboardhttps://github.com/jangcode/litellm/tree/main/ui/litellm-dashboard
.dockerignorehttps://github.com/jangcode/litellm/blob/main/.dockerignore
.dockerignorehttps://github.com/jangcode/litellm/blob/main/.dockerignore
.env.examplehttps://github.com/jangcode/litellm/blob/main/.env.example
.env.examplehttps://github.com/jangcode/litellm/blob/main/.env.example
.flake8https://github.com/jangcode/litellm/blob/main/.flake8
.flake8https://github.com/jangcode/litellm/blob/main/.flake8
.git-blame-ignore-revshttps://github.com/jangcode/litellm/blob/main/.git-blame-ignore-revs
.git-blame-ignore-revshttps://github.com/jangcode/litellm/blob/main/.git-blame-ignore-revs
.gitattributeshttps://github.com/jangcode/litellm/blob/main/.gitattributes
.gitattributeshttps://github.com/jangcode/litellm/blob/main/.gitattributes
.gitignorehttps://github.com/jangcode/litellm/blob/main/.gitignore
.gitignorehttps://github.com/jangcode/litellm/blob/main/.gitignore
.pre-commit-config.yamlhttps://github.com/jangcode/litellm/blob/main/.pre-commit-config.yaml
.pre-commit-config.yamlhttps://github.com/jangcode/litellm/blob/main/.pre-commit-config.yaml
AGENTS.mdhttps://github.com/jangcode/litellm/blob/main/AGENTS.md
AGENTS.mdhttps://github.com/jangcode/litellm/blob/main/AGENTS.md
CLAUDE.mdhttps://github.com/jangcode/litellm/blob/main/CLAUDE.md
CLAUDE.mdhttps://github.com/jangcode/litellm/blob/main/CLAUDE.md
CONTRIBUTING.mdhttps://github.com/jangcode/litellm/blob/main/CONTRIBUTING.md
CONTRIBUTING.mdhttps://github.com/jangcode/litellm/blob/main/CONTRIBUTING.md
Dockerfilehttps://github.com/jangcode/litellm/blob/main/Dockerfile
Dockerfilehttps://github.com/jangcode/litellm/blob/main/Dockerfile
GEMINI.mdhttps://github.com/jangcode/litellm/blob/main/GEMINI.md
GEMINI.mdhttps://github.com/jangcode/litellm/blob/main/GEMINI.md
LICENSEhttps://github.com/jangcode/litellm/blob/main/LICENSE
LICENSEhttps://github.com/jangcode/litellm/blob/main/LICENSE
Makefilehttps://github.com/jangcode/litellm/blob/main/Makefile
Makefilehttps://github.com/jangcode/litellm/blob/main/Makefile
README.mdhttps://github.com/jangcode/litellm/blob/main/README.md
README.mdhttps://github.com/jangcode/litellm/blob/main/README.md
VERTEX_ENV_SETUP.mdhttps://github.com/jangcode/litellm/blob/main/VERTEX_ENV_SETUP.md
VERTEX_ENV_SETUP.mdhttps://github.com/jangcode/litellm/blob/main/VERTEX_ENV_SETUP.md
batch_small.jsonlhttps://github.com/jangcode/litellm/blob/main/batch_small.jsonl
batch_small.jsonlhttps://github.com/jangcode/litellm/blob/main/batch_small.jsonl
codecov.yamlhttps://github.com/jangcode/litellm/blob/main/codecov.yaml
codecov.yamlhttps://github.com/jangcode/litellm/blob/main/codecov.yaml
docker-compose.ymlhttps://github.com/jangcode/litellm/blob/main/docker-compose.yml
docker-compose.ymlhttps://github.com/jangcode/litellm/blob/main/docker-compose.yml
index.yamlhttps://github.com/jangcode/litellm/blob/main/index.yaml
index.yamlhttps://github.com/jangcode/litellm/blob/main/index.yaml
mcp_servers.jsonhttps://github.com/jangcode/litellm/blob/main/mcp_servers.json
mcp_servers.jsonhttps://github.com/jangcode/litellm/blob/main/mcp_servers.json
model_prices_and_context_window.jsonhttps://github.com/jangcode/litellm/blob/main/model_prices_and_context_window.json
model_prices_and_context_window.jsonhttps://github.com/jangcode/litellm/blob/main/model_prices_and_context_window.json
package-lock.jsonhttps://github.com/jangcode/litellm/blob/main/package-lock.json
package-lock.jsonhttps://github.com/jangcode/litellm/blob/main/package-lock.json
package.jsonhttps://github.com/jangcode/litellm/blob/main/package.json
package.jsonhttps://github.com/jangcode/litellm/blob/main/package.json
poetry.lockhttps://github.com/jangcode/litellm/blob/main/poetry.lock
poetry.lockhttps://github.com/jangcode/litellm/blob/main/poetry.lock
prometheus.ymlhttps://github.com/jangcode/litellm/blob/main/prometheus.yml
prometheus.ymlhttps://github.com/jangcode/litellm/blob/main/prometheus.yml
provider_endpoints_support.jsonhttps://github.com/jangcode/litellm/blob/main/provider_endpoints_support.json
provider_endpoints_support.jsonhttps://github.com/jangcode/litellm/blob/main/provider_endpoints_support.json
proxy_server_config.yamlhttps://github.com/jangcode/litellm/blob/main/proxy_server_config.yaml
proxy_server_config.yamlhttps://github.com/jangcode/litellm/blob/main/proxy_server_config.yaml
pyproject.tomlhttps://github.com/jangcode/litellm/blob/main/pyproject.toml
pyproject.tomlhttps://github.com/jangcode/litellm/blob/main/pyproject.toml
pyrightconfig.jsonhttps://github.com/jangcode/litellm/blob/main/pyrightconfig.json
pyrightconfig.jsonhttps://github.com/jangcode/litellm/blob/main/pyrightconfig.json
render.yamlhttps://github.com/jangcode/litellm/blob/main/render.yaml
render.yamlhttps://github.com/jangcode/litellm/blob/main/render.yaml
requirements.txthttps://github.com/jangcode/litellm/blob/main/requirements.txt
requirements.txthttps://github.com/jangcode/litellm/blob/main/requirements.txt
ruff.tomlhttps://github.com/jangcode/litellm/blob/main/ruff.toml
ruff.tomlhttps://github.com/jangcode/litellm/blob/main/ruff.toml
schema.prismahttps://github.com/jangcode/litellm/blob/main/schema.prisma
schema.prismahttps://github.com/jangcode/litellm/blob/main/schema.prisma
security.mdhttps://github.com/jangcode/litellm/blob/main/security.md
security.mdhttps://github.com/jangcode/litellm/blob/main/security.md
setup_vertex_env.shhttps://github.com/jangcode/litellm/blob/main/setup_vertex_env.sh
setup_vertex_env.shhttps://github.com/jangcode/litellm/blob/main/setup_vertex_env.sh
test_pydantic_fields.pyhttps://github.com/jangcode/litellm/blob/main/test_pydantic_fields.py
test_pydantic_fields.pyhttps://github.com/jangcode/litellm/blob/main/test_pydantic_fields.py
READMEhttps://github.com/jangcode/litellm
Contributinghttps://github.com/jangcode/litellm
Licensehttps://github.com/jangcode/litellm
Securityhttps://github.com/jangcode/litellm
https://github.com/jangcode/litellm#---------litellm----
https://render.com/deploy?repo=https://github.com/BerriAI/litellm
https://railway.app/template/HLP0Ub?referralCode=jch2ME
LiteLLM Proxy Server (LLM Gateway)https://docs.litellm.ai/docs/simple_proxy
Hosted Proxy (Preview)https://docs.litellm.ai/docs/hosted
Enterprise Tierhttps://docs.litellm.ai/docs/enterprise
https://github.com/jangcode/litellm#litellm-proxy-server-llm-gateway---hosted-proxy-preview--enterprise-tier
https://pypi.org/project/litellm/
https://www.ycombinator.com/companies/berriai
https://wa.link/huol9n
https://discord.gg/wuPM9dRgDw
https://www.litellm.ai/support
https://github.com/jangcode/litellm#--------------------------------------------------------------------------------
Consistent outputhttps://docs.litellm.ai/docs/completion/output
Routerhttps://docs.litellm.ai/docs/routing
LiteLLM Proxy Server (LLM Gateway)https://docs.litellm.ai/docs/simple_proxy
herehttps://docs.litellm.ai/docs/benchmarks
Jump to LiteLLM Proxy (LLM Gateway) Docshttps://github.com/BerriAI/litellm?tab=readme-ov-file#litellm-proxy-server-llm-gateway---docs
Jump to Supported LLM Providershttps://github.com/BerriAI/litellm?tab=readme-ov-file#supported-providers-docs
More information about the release cycle herehttps://docs.litellm.ai/docs/proxy/release_cycle
feature requesthttps://github.com/BerriAI/litellm/issues/new?assignees=&labels=enhancement&projects=&template=feature_request.yml&title=%5BFeature%5D%3A+
Docshttps://docs.litellm.ai/docs/
https://github.com/jangcode/litellm#usage-docs
herehttps://docs.litellm.ai/docs/migration
https://colab.research.google.com/github/BerriAI/litellm/blob/main/cookbook/liteLLM_Getting_Started.ipynb
https://github.com/jangcode/litellm#response-openai-format
provider docs for more informationhttps://docs.litellm.ai/docs/providers
Docshttps://docs.litellm.ai/docs/completion/stream#async-completion
https://github.com/jangcode/litellm#async-docs
Docshttps://docs.litellm.ai/docs/completion/stream
https://github.com/jangcode/litellm#streaming-docs
https://github.com/jangcode/litellm#response-chunk-openai-format
Docshttps://docs.litellm.ai/docs/observability/callbacks
https://github.com/jangcode/litellm#logging-observability-docs
Docshttps://docs.litellm.ai/docs/simple_proxy
https://github.com/jangcode/litellm#litellm-proxy-server-llm-gateway---docs
Hosted Proxy (Preview)https://docs.litellm.ai/docs/hosted
Hooks for authhttps://docs.litellm.ai/docs/proxy/virtual_keys#custom-auth
Hooks for logginghttps://docs.litellm.ai/docs/proxy/logging#step-1---create-your-custom-litellm-callback-class
Cost trackinghttps://docs.litellm.ai/docs/proxy/virtual_keys#tracking-spend
Rate Limitinghttps://docs.litellm.ai/docs/proxy/users#set-rate-limits
Swagger Docshttps://litellm-api.up.railway.app/
https://github.com/jangcode/litellm#-proxy-endpoints---swagger-docs
https://github.com/jangcode/litellm#quick-start-proxy---cli
https://github.com/jangcode/litellm#step-1-start-litellm-proxy
https://github.com/jangcode/litellm#step-2-make-chatcompletions-request-to-proxy
Use LiteLLM Proxy with Langchain (Python, JS), OpenAI SDK (Python, JS) Anthropic SDK, Mistral SDK, LlamaIndex, Instructor, Curlhttps://docs.litellm.ai/docs/proxy/user_keys
Docshttps://docs.litellm.ai/docs/proxy/virtual_keys
https://github.com/jangcode/litellm#proxy-key-management-docs
https://private-user-images.githubusercontent.com/29436595/302077487-47c97d5e-b9be-4839-b28c-43d7f4f10033.gif?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3ODQ3Njk4NzUsIm5iZiI6MTc4NDc2OTU3NSwicGF0aCI6Ii8yOTQzNjU5NS8zMDIwNzc0ODctNDdjOTdkNWUtYjliZS00ODM5LWIyOGMtNDNkN2Y0ZjEwMDMzLmdpZj9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNjA3MjMlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjYwNzIzVDAxMTkzNVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTI0OWNkYmZiN2Y5MzkyZGE0ZjcyMWEyZWFlOTA2MjYwNDdmZjNlNWVmYzY5NTc3ZTYyNTYyYjcxMDIyYWQ4NzgmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JnJlc3BvbnNlLWNvbnRlbnQtdHlwZT1pbWFnZSUyRmdpZiJ9.iKyLiI1xhNKwr8LqSXZ0DbwYJcn9khRD0pjEk996YVc
https://github.com/jangcode/litellm#request
https://github.com/jangcode/litellm#expected-response
Website Supported Modelshttps://models.litellm.ai/
Docshttps://docs.litellm.ai/docs/providers
https://github.com/jangcode/litellm#supported-providers-website-supported-models--docs
AI/ML API (aiml)https://docs.litellm.ai/docs/providers/aiml
AI21 (ai21)https://docs.litellm.ai/docs/providers/ai21
AI21 Chat (ai21_chat)https://docs.litellm.ai/docs/providers/ai21
Aleph Alphahttps://docs.litellm.ai/docs/providers/aleph_alpha
Anthropic (anthropic)https://docs.litellm.ai/docs/providers/anthropic
Anthropic Text (anthropic_text)https://docs.litellm.ai/docs/providers/anthropic
Anyscalehttps://docs.litellm.ai/docs/providers/anyscale
AssemblyAI (assemblyai)https://docs.litellm.ai/docs/pass_through/assembly_ai
Auto Router (auto_router)https://docs.litellm.ai/docs/proxy/auto_routing
AWS - Bedrock (bedrock)https://docs.litellm.ai/docs/providers/bedrock
AWS - Sagemaker (sagemaker)https://docs.litellm.ai/docs/providers/aws_sagemaker
Azure (azure)https://docs.litellm.ai/docs/providers/azure
Azure AI (azure_ai)https://docs.litellm.ai/docs/providers/azure_ai
Azure Text (azure_text)https://docs.litellm.ai/docs/providers/azure
Baseten (baseten)https://docs.litellm.ai/docs/providers/baseten
Bytez (bytez)https://docs.litellm.ai/docs/providers/bytez
Cerebras (cerebras)https://docs.litellm.ai/docs/providers/cerebras
Clarifai (clarifai)https://docs.litellm.ai/docs/providers/clarifai
Cloudflare AI Workers (cloudflare)https://docs.litellm.ai/docs/providers/cloudflare_workers
Codestral (codestral)https://docs.litellm.ai/docs/providers/codestral
Cohere (cohere)https://docs.litellm.ai/docs/providers/cohere
Cohere Chat (cohere_chat)https://docs.litellm.ai/docs/providers/cohere
CometAPI (cometapi)https://docs.litellm.ai/docs/providers/cometapi
CompactifAI (compactifai)https://docs.litellm.ai/docs/providers/compactifai
Custom (custom)https://docs.litellm.ai/docs/providers/custom_llm_server
Custom OpenAI (custom_openai)https://docs.litellm.ai/docs/providers/openai_compatible
Dashscope (dashscope)https://docs.litellm.ai/docs/providers/dashscope
Databricks (databricks)https://docs.litellm.ai/docs/providers/databricks
DataRobot (datarobot)https://docs.litellm.ai/docs/providers/datarobot
Deepgram (deepgram)https://docs.litellm.ai/docs/providers/deepgram
DeepInfra (deepinfra)https://docs.litellm.ai/docs/providers/deepinfra
Deepseek (deepseek)https://docs.litellm.ai/docs/providers/deepseek
ElevenLabs (elevenlabs)https://docs.litellm.ai/docs/providers/elevenlabs
Empower (empower)https://docs.litellm.ai/docs/providers/empower
Fal AI (fal_ai)https://docs.litellm.ai/docs/providers/fal_ai
Featherless AI (featherless_ai)https://docs.litellm.ai/docs/providers/featherless_ai
Fireworks AI (fireworks_ai)https://docs.litellm.ai/docs/providers/fireworks_ai
FriendliAI (friendliai)https://docs.litellm.ai/docs/providers/friendliai
Galadriel (galadriel)https://docs.litellm.ai/docs/providers/galadriel
GitHub Copilot (github_copilot)https://docs.litellm.ai/docs/providers/github_copilot
GitHub Models (github)https://docs.litellm.ai/docs/providers/github
Google - PaLMhttps://docs.litellm.ai/docs/providers/palm
Google - Vertex AI (vertex_ai)https://docs.litellm.ai/docs/providers/vertex
Google AI Studio - Gemini (gemini)https://docs.litellm.ai/docs/providers/gemini
GradientAI (gradient_ai)https://docs.litellm.ai/docs/providers/gradient_ai
Groq AI (groq)https://docs.litellm.ai/docs/providers/groq
Heroku (heroku)https://docs.litellm.ai/docs/providers/heroku
Hosted VLLM (hosted_vllm)https://docs.litellm.ai/docs/providers/vllm
Huggingface (huggingface)https://docs.litellm.ai/docs/providers/huggingface
Hyperbolic (hyperbolic)https://docs.litellm.ai/docs/providers/hyperbolic
IBM - Watsonx.ai (watsonx)https://docs.litellm.ai/docs/providers/watsonx
Infinity (infinity)https://docs.litellm.ai/docs/providers/infinity
Jina AI (jina_ai)https://docs.litellm.ai/docs/providers/jina_ai
Lambda AI (lambda_ai)https://docs.litellm.ai/docs/providers/lambda_ai
Lemonade (lemonade)https://docs.litellm.ai/docs/providers/lemonade
LiteLLM Proxy (litellm_proxy)https://docs.litellm.ai/docs/providers/litellm_proxy
Llamafile (llamafile)https://docs.litellm.ai/docs/providers/llamafile
LM Studio (lm_studio)https://docs.litellm.ai/docs/providers/lm_studio
Maritalk (maritalk)https://docs.litellm.ai/docs/providers/maritalk
Meta - Llama API (meta_llama)https://docs.litellm.ai/docs/providers/meta_llama
Mistral AI API (mistral)https://docs.litellm.ai/docs/providers/mistral
Moonshot (moonshot)https://docs.litellm.ai/docs/providers/moonshot
Morph (morph)https://docs.litellm.ai/docs/providers/morph
Nebius AI Studio (nebius)https://docs.litellm.ai/docs/providers/nebius
NLP Cloud (nlp_cloud)https://docs.litellm.ai/docs/providers/nlp_cloud
Novita AI (novita)https://novita.ai/models/llm?utm_source=github_litellm&utm_medium=github_readme&utm_campaign=github_link
Nscale (nscale)https://docs.litellm.ai/docs/providers/nscale
Nvidia NIM (nvidia_nim)https://docs.litellm.ai/docs/providers/nvidia_nim
OCI (oci)https://docs.litellm.ai/docs/providers/oci
Ollama (ollama)https://docs.litellm.ai/docs/providers/ollama
Ollama Chat (ollama_chat)https://docs.litellm.ai/docs/providers/ollama
Oobabooga (oobabooga)https://docs.litellm.ai/docs/providers/openai_compatible
OpenAI (openai)https://docs.litellm.ai/docs/providers/openai
OpenAI-like (openai_like)https://docs.litellm.ai/docs/providers/openai_compatible
OpenRouter (openrouter)https://docs.litellm.ai/docs/providers/openrouter
OVHCloud AI Endpoints (ovhcloud)https://docs.litellm.ai/docs/providers/ovhcloud
Perplexity AI (perplexity)https://docs.litellm.ai/docs/providers/perplexity
Petals (petals)https://docs.litellm.ai/docs/providers/petals
Predibase (predibase)https://docs.litellm.ai/docs/providers/predibase
Recraft (recraft)https://docs.litellm.ai/docs/providers/recraft
Replicate (replicate)https://docs.litellm.ai/docs/providers/replicate
Sagemaker Chat (sagemaker_chat)https://docs.litellm.ai/docs/providers/aws_sagemaker
Sambanova (sambanova)https://docs.litellm.ai/docs/providers/sambanova
Snowflake (snowflake)https://docs.litellm.ai/docs/providers/snowflake
Text Completion Codestral (text-completion-codestral)https://docs.litellm.ai/docs/providers/codestral
Text Completion OpenAI (text-completion-openai)https://docs.litellm.ai/docs/providers/text_completion_openai
Together AI (together_ai)https://docs.litellm.ai/docs/providers/togetherai
Topaz (topaz)https://docs.litellm.ai/docs/providers/topaz
Triton (triton)https://docs.litellm.ai/docs/providers/triton-inference-server
V0 (v0)https://docs.litellm.ai/docs/providers/v0
Vercel AI Gateway (vercel_ai_gateway)https://docs.litellm.ai/docs/providers/vercel_ai_gateway
VLLM (vllm)https://docs.litellm.ai/docs/providers/vllm
Volcengine (volcengine)https://docs.litellm.ai/docs/providers/volcano
Voyage AI (voyage)https://docs.litellm.ai/docs/providers/voyage
WandB Inference (wandb)https://docs.litellm.ai/docs/providers/wandb_inference
Watsonx Text (watsonx_text)https://docs.litellm.ai/docs/providers/watsonx
xAI (xai)https://docs.litellm.ai/docs/providers/xai
Xinference (xinference)https://docs.litellm.ai/docs/providers/xinference
Read the Docshttps://docs.litellm.ai/docs/
https://github.com/jangcode/litellm#run-in-developer-mode
https://github.com/jangcode/litellm#services
https://github.com/jangcode/litellm#backend
https://github.com/jangcode/litellm#frontend
https://github.com/jangcode/litellm#enterprise
Talk to foundershttps://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat
LiteLLM Commercial Licensehttps://docs.litellm.ai/docs/proxy/enterprise
https://github.com/jangcode/litellm#contributing
https://github.com/jangcode/litellm#quick-start-for-contributors
CONTRIBUTING.mdhttps://github.com/jangcode/litellm/blob/main/CONTRIBUTING.md
https://github.com/jangcode/litellm#code-quality--linting
Google Python Style Guidehttps://google.github.io/styleguide/pyguide.html
https://github.com/jangcode/litellm#support--talk-with-founders
Schedule Demo 👋https://calendly.com/d/4mp-gd3-k5k/berriai-1-1-onboarding-litellm-hosted-version
Community Discord 💭https://discord.gg/wuPM9dRgDw
Community Slack 💭https://www.litellm.ai/support
https://github.com/jangcode/litellm#why-did-we-build-this
https://github.com/jangcode/litellm#contributors
https://github.com/BerriAI/litellm/graphs/contributors
docs.litellm.ai/docs/https://docs.litellm.ai/docs/
Readme https://github.com/jangcode/litellm#readme-ov-file
View license https://github.com/jangcode/litellm#License-1-ov-file
Contributing https://github.com/jangcode/litellm#contributing-ov-file
Security policy https://github.com/jangcode/litellm#security-ov-file
Please reload this pagehttps://github.com/jangcode/litellm
Activityhttps://github.com/jangcode/litellm/activity
0 forkshttps://github.com/jangcode/litellm/forks
Report repository https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Fjangcode%2Flitellm&report=jangcode+%28user%29
Releaseshttps://github.com/jangcode/litellm/releases
Packages 0https://github.com/users/jangcode/packages?repo_name=litellm
Please reload this pagehttps://github.com/jangcode/litellm
Contributorshttps://github.com/jangcode/litellm/graphs/contributors
Please reload this pagehttps://github.com/jangcode/litellm
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.