René's URL Explorer Experiment


Title: GitHub - isaacus-dev/litellm: Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq] · GitHub

Open Graph Title: GitHub - isaacus-dev/litellm: Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

X Title: GitHub - isaacus-dev/litellm: Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

Description: Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq] - isaacus-dev/litellm

Open Graph Description: Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq] - isaacus-dev/litellm

X Description: Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq] - isaacus-dev/litellm

Mail addresses
ishaan@berri.ai
krrish@berri.ai

Opengraph URL: https://github.com/isaacus-dev/litellm

X: @github

direct link

Domain: github.com

route-pattern/:user_id/:repository
route-controllerfiles
route-actiondisambiguate
fetch-noncev2:29269360-dfcf-3415-e5f6-e06e10e4c368
current-catalog-service-hashf3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-id9138:955FC:BB4EB9:FA2BC6:6A4C57CE
html-safe-nonceb424a670fb08b5ad62cf840e6115d524edf4513ace7225ad0269e9c872150a69
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI5MTM4Ojk1NUZDOkJCNEVCOTpGQTJCQzY6NkE0QzU3Q0UiLCJ2aXNpdG9yX2lkIjoiMzQ3MTY5ODkxMjY5NTA0ODE0MiIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmac44ea230273232b88ef93e8c2f9bd88e674a2365cceb77d4682a7bc30edb72bbb
hovercard-subject-tagrepository:1081656707
github-keyboard-shortcutsrepository,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location//
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/isaacus-dev/litellm
twitter:imagehttps://opengraph.githubassets.com/e7c8d68c00ff603ed0518b39a84fbd17e8b84c99972b2573112ff5273ef539f4/isaacus-dev/litellm
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/e7c8d68c00ff603ed0518b39a84fbd17e8b84c99972b2573112ff5273ef539f4/isaacus-dev/litellm
og:image:altPython SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq] - isaacus-dev/litellm
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None3d11bb817438277de2a940854450e83a7d32b6aeb5014e9e6b00a6423900251c
turbo-cache-controlno-cache
go-importgithub.com/isaacus-dev/litellm git https://github.com/isaacus-dev/litellm.git
octolytics-dimension-user_id189517105
octolytics-dimension-user_loginisaacus-dev
octolytics-dimension-repository_id1081656707
octolytics-dimension-repository_nwoisaacus-dev/litellm
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forktrue
octolytics-dimension-repository_parent_id671269505
octolytics-dimension-repository_parent_nwoBerriAI/litellm
octolytics-dimension-repository_network_root_id671269505
octolytics-dimension-repository_network_root_nwoBerriAI/litellm
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release14099438da5379150f15a2892474c7c7e6c0e55e
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/isaacus-dev/litellm#start-of-content
https://github.com/
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fisaacus-dev%2Flitellm
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub Copilot appDirect agents from issue to mergehttps://github.com/features/ai/github-app
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
View all resourceshttps://github.com/resources
GitHub SponsorsFund open source developershttps://github.com/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/accelerator
GitHub Starshttps://stars.github.com
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fisaacus-dev%2Flitellm
Sign up https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=isaacus-dev%2Flitellm
Reloadhttps://github.com/isaacus-dev/litellm
Reloadhttps://github.com/isaacus-dev/litellm
Reloadhttps://github.com/isaacus-dev/litellm
Please reload this pagehttps://github.com/isaacus-dev/litellm
isaacus-dev https://github.com/isaacus-dev
litellmhttps://github.com/isaacus-dev/litellm
BerriAI/litellmhttps://github.com/BerriAI/litellm
Notifications https://github.com/login?return_to=%2Fisaacus-dev%2Flitellm
Fork 0 https://github.com/login?return_to=%2Fisaacus-dev%2Flitellm
Star 1 https://github.com/login?return_to=%2Fisaacus-dev%2Flitellm
Code https://github.com/isaacus-dev/litellm
Pull requests 6 https://github.com/isaacus-dev/litellm/pulls
Actions https://github.com/isaacus-dev/litellm/actions
Projects https://github.com/isaacus-dev/litellm/projects
Models https://github.com/isaacus-dev/litellm/models
Security and quality 0 https://github.com/isaacus-dev/litellm/security
Insights https://github.com/isaacus-dev/litellm/pulse
Code https://github.com/isaacus-dev/litellm
Pull requests https://github.com/isaacus-dev/litellm/pulls
Actions https://github.com/isaacus-dev/litellm/actions
Projects https://github.com/isaacus-dev/litellm/projects
Models https://github.com/isaacus-dev/litellm/models
Security and quality https://github.com/isaacus-dev/litellm/security
Insights https://github.com/isaacus-dev/litellm/pulse
https://github.com/isaacus-dev/litellm
Brancheshttps://github.com/isaacus-dev/litellm/branches
Tagshttps://github.com/isaacus-dev/litellm/tags
https://github.com/isaacus-dev/litellm/branches
https://github.com/isaacus-dev/litellm/tags
26,719 Commitshttps://github.com/isaacus-dev/litellm/commits/main/
https://github.com/isaacus-dev/litellm/commits/main/
.circlecihttps://github.com/isaacus-dev/litellm/tree/main/.circleci
.circlecihttps://github.com/isaacus-dev/litellm/tree/main/.circleci
.devcontainerhttps://github.com/isaacus-dev/litellm/tree/main/.devcontainer
.devcontainerhttps://github.com/isaacus-dev/litellm/tree/main/.devcontainer
.githubhttps://github.com/isaacus-dev/litellm/tree/main/.github
.githubhttps://github.com/isaacus-dev/litellm/tree/main/.github
ci_cdhttps://github.com/isaacus-dev/litellm/tree/main/ci_cd
ci_cdhttps://github.com/isaacus-dev/litellm/tree/main/ci_cd
cookbookhttps://github.com/isaacus-dev/litellm/tree/main/cookbook
cookbookhttps://github.com/isaacus-dev/litellm/tree/main/cookbook
db_scriptshttps://github.com/isaacus-dev/litellm/tree/main/db_scripts
db_scriptshttps://github.com/isaacus-dev/litellm/tree/main/db_scripts
deployhttps://github.com/isaacus-dev/litellm/tree/main/deploy
deployhttps://github.com/isaacus-dev/litellm/tree/main/deploy
dockerhttps://github.com/isaacus-dev/litellm/tree/main/docker
dockerhttps://github.com/isaacus-dev/litellm/tree/main/docker
docs/my-websitehttps://github.com/isaacus-dev/litellm/tree/main/docs/my-website
docs/my-websitehttps://github.com/isaacus-dev/litellm/tree/main/docs/my-website
enterprisehttps://github.com/isaacus-dev/litellm/tree/main/enterprise
enterprisehttps://github.com/isaacus-dev/litellm/tree/main/enterprise
litellm-jshttps://github.com/isaacus-dev/litellm/tree/main/litellm-js
litellm-jshttps://github.com/isaacus-dev/litellm/tree/main/litellm-js
litellm-proxy-extrashttps://github.com/isaacus-dev/litellm/tree/main/litellm-proxy-extras
litellm-proxy-extrashttps://github.com/isaacus-dev/litellm/tree/main/litellm-proxy-extras
litellmhttps://github.com/isaacus-dev/litellm/tree/main/litellm
litellmhttps://github.com/isaacus-dev/litellm/tree/main/litellm
scriptshttps://github.com/isaacus-dev/litellm/tree/main/scripts
scriptshttps://github.com/isaacus-dev/litellm/tree/main/scripts
testshttps://github.com/isaacus-dev/litellm/tree/main/tests
testshttps://github.com/isaacus-dev/litellm/tree/main/tests
ui/litellm-dashboardhttps://github.com/isaacus-dev/litellm/tree/main/ui/litellm-dashboard
ui/litellm-dashboardhttps://github.com/isaacus-dev/litellm/tree/main/ui/litellm-dashboard
.dockerignorehttps://github.com/isaacus-dev/litellm/blob/main/.dockerignore
.dockerignorehttps://github.com/isaacus-dev/litellm/blob/main/.dockerignore
.env.examplehttps://github.com/isaacus-dev/litellm/blob/main/.env.example
.env.examplehttps://github.com/isaacus-dev/litellm/blob/main/.env.example
.flake8https://github.com/isaacus-dev/litellm/blob/main/.flake8
.flake8https://github.com/isaacus-dev/litellm/blob/main/.flake8
.git-blame-ignore-revshttps://github.com/isaacus-dev/litellm/blob/main/.git-blame-ignore-revs
.git-blame-ignore-revshttps://github.com/isaacus-dev/litellm/blob/main/.git-blame-ignore-revs
.gitattributeshttps://github.com/isaacus-dev/litellm/blob/main/.gitattributes
.gitattributeshttps://github.com/isaacus-dev/litellm/blob/main/.gitattributes
.gitignorehttps://github.com/isaacus-dev/litellm/blob/main/.gitignore
.gitignorehttps://github.com/isaacus-dev/litellm/blob/main/.gitignore
.pre-commit-config.yamlhttps://github.com/isaacus-dev/litellm/blob/main/.pre-commit-config.yaml
.pre-commit-config.yamlhttps://github.com/isaacus-dev/litellm/blob/main/.pre-commit-config.yaml
AGENTS.mdhttps://github.com/isaacus-dev/litellm/blob/main/AGENTS.md
AGENTS.mdhttps://github.com/isaacus-dev/litellm/blob/main/AGENTS.md
CLAUDE.mdhttps://github.com/isaacus-dev/litellm/blob/main/CLAUDE.md
CLAUDE.mdhttps://github.com/isaacus-dev/litellm/blob/main/CLAUDE.md
CONTRIBUTING.mdhttps://github.com/isaacus-dev/litellm/blob/main/CONTRIBUTING.md
CONTRIBUTING.mdhttps://github.com/isaacus-dev/litellm/blob/main/CONTRIBUTING.md
COST_DISCOUNT_IMPLEMENTATION.mdhttps://github.com/isaacus-dev/litellm/blob/main/COST_DISCOUNT_IMPLEMENTATION.md
COST_DISCOUNT_IMPLEMENTATION.mdhttps://github.com/isaacus-dev/litellm/blob/main/COST_DISCOUNT_IMPLEMENTATION.md
Dockerfilehttps://github.com/isaacus-dev/litellm/blob/main/Dockerfile
Dockerfilehttps://github.com/isaacus-dev/litellm/blob/main/Dockerfile
GEMINI.mdhttps://github.com/isaacus-dev/litellm/blob/main/GEMINI.md
GEMINI.mdhttps://github.com/isaacus-dev/litellm/blob/main/GEMINI.md
LICENSEhttps://github.com/isaacus-dev/litellm/blob/main/LICENSE
LICENSEhttps://github.com/isaacus-dev/litellm/blob/main/LICENSE
MCP_SSL_CHANGES_SUMMARY.mdhttps://github.com/isaacus-dev/litellm/blob/main/MCP_SSL_CHANGES_SUMMARY.md
MCP_SSL_CHANGES_SUMMARY.mdhttps://github.com/isaacus-dev/litellm/blob/main/MCP_SSL_CHANGES_SUMMARY.md
Makefilehttps://github.com/isaacus-dev/litellm/blob/main/Makefile
Makefilehttps://github.com/isaacus-dev/litellm/blob/main/Makefile
README.mdhttps://github.com/isaacus-dev/litellm/blob/main/README.md
README.mdhttps://github.com/isaacus-dev/litellm/blob/main/README.md
codecov.yamlhttps://github.com/isaacus-dev/litellm/blob/main/codecov.yaml
codecov.yamlhttps://github.com/isaacus-dev/litellm/blob/main/codecov.yaml
docker-compose.ymlhttps://github.com/isaacus-dev/litellm/blob/main/docker-compose.yml
docker-compose.ymlhttps://github.com/isaacus-dev/litellm/blob/main/docker-compose.yml
git_model_armor.pyhttps://github.com/isaacus-dev/litellm/blob/main/git_model_armor.py
git_model_armor.pyhttps://github.com/isaacus-dev/litellm/blob/main/git_model_armor.py
index.yamlhttps://github.com/isaacus-dev/litellm/blob/main/index.yaml
index.yamlhttps://github.com/isaacus-dev/litellm/blob/main/index.yaml
log.txthttps://github.com/isaacus-dev/litellm/blob/main/log.txt
log.txthttps://github.com/isaacus-dev/litellm/blob/main/log.txt
mcp_servers.jsonhttps://github.com/isaacus-dev/litellm/blob/main/mcp_servers.json
mcp_servers.jsonhttps://github.com/isaacus-dev/litellm/blob/main/mcp_servers.json
model_prices_and_context_window.jsonhttps://github.com/isaacus-dev/litellm/blob/main/model_prices_and_context_window.json
model_prices_and_context_window.jsonhttps://github.com/isaacus-dev/litellm/blob/main/model_prices_and_context_window.json
package-lock.jsonhttps://github.com/isaacus-dev/litellm/blob/main/package-lock.json
package-lock.jsonhttps://github.com/isaacus-dev/litellm/blob/main/package-lock.json
package.jsonhttps://github.com/isaacus-dev/litellm/blob/main/package.json
package.jsonhttps://github.com/isaacus-dev/litellm/blob/main/package.json
poetry.lockhttps://github.com/isaacus-dev/litellm/blob/main/poetry.lock
poetry.lockhttps://github.com/isaacus-dev/litellm/blob/main/poetry.lock
prometheus.ymlhttps://github.com/isaacus-dev/litellm/blob/main/prometheus.yml
prometheus.ymlhttps://github.com/isaacus-dev/litellm/blob/main/prometheus.yml
proxy_server_config.yamlhttps://github.com/isaacus-dev/litellm/blob/main/proxy_server_config.yaml
proxy_server_config.yamlhttps://github.com/isaacus-dev/litellm/blob/main/proxy_server_config.yaml
pyproject.tomlhttps://github.com/isaacus-dev/litellm/blob/main/pyproject.toml
pyproject.tomlhttps://github.com/isaacus-dev/litellm/blob/main/pyproject.toml
pyrightconfig.jsonhttps://github.com/isaacus-dev/litellm/blob/main/pyrightconfig.json
pyrightconfig.jsonhttps://github.com/isaacus-dev/litellm/blob/main/pyrightconfig.json
render.yamlhttps://github.com/isaacus-dev/litellm/blob/main/render.yaml
render.yamlhttps://github.com/isaacus-dev/litellm/blob/main/render.yaml
requirements.txthttps://github.com/isaacus-dev/litellm/blob/main/requirements.txt
requirements.txthttps://github.com/isaacus-dev/litellm/blob/main/requirements.txt
ruff.tomlhttps://github.com/isaacus-dev/litellm/blob/main/ruff.toml
ruff.tomlhttps://github.com/isaacus-dev/litellm/blob/main/ruff.toml
schema.prismahttps://github.com/isaacus-dev/litellm/blob/main/schema.prisma
schema.prismahttps://github.com/isaacus-dev/litellm/blob/main/schema.prisma
security.mdhttps://github.com/isaacus-dev/litellm/blob/main/security.md
security.mdhttps://github.com/isaacus-dev/litellm/blob/main/security.md
test_bulk_update_all_users.pyhttps://github.com/isaacus-dev/litellm/blob/main/test_bulk_update_all_users.py
test_bulk_update_all_users.pyhttps://github.com/isaacus-dev/litellm/blob/main/test_bulk_update_all_users.py
test_image_edit.pnghttps://github.com/isaacus-dev/litellm/blob/main/test_image_edit.png
test_image_edit.pnghttps://github.com/isaacus-dev/litellm/blob/main/test_image_edit.png
test_model_armor.pyhttps://github.com/isaacus-dev/litellm/blob/main/test_model_armor.py
test_model_armor.pyhttps://github.com/isaacus-dev/litellm/blob/main/test_model_armor.py
test_profile_mock_response.py.lprofhttps://github.com/isaacus-dev/litellm/blob/main/test_profile_mock_response.py.lprof
test_profile_mock_response.py.lprofhttps://github.com/isaacus-dev/litellm/blob/main/test_profile_mock_response.py.lprof
READMEhttps://github.com/isaacus-dev/litellm
Contributinghttps://github.com/isaacus-dev/litellm
Licensehttps://github.com/isaacus-dev/litellm
Securityhttps://github.com/isaacus-dev/litellm
https://github.com/isaacus-dev/litellm#---------litellm----
https://render.com/deploy?repo=https://github.com/BerriAI/litellm
https://railway.app/template/HLP0Ub?referralCode=jch2ME
LiteLLM Proxy Server (LLM Gateway)https://docs.litellm.ai/docs/simple_proxy
Hosted Proxy (Preview)https://docs.litellm.ai/docs/hosted
Enterprise Tierhttps://docs.litellm.ai/docs/enterprise
https://github.com/isaacus-dev/litellm#litellm-proxy-server-llm-gateway---hosted-proxy-preview--enterprise-tier
https://pypi.org/project/litellm/
https://www.ycombinator.com/companies/berriai
https://wa.link/huol9n
https://discord.gg/wuPM9dRgDw
https://www.litellm.ai/support
https://github.com/isaacus-dev/litellm#--------------------------------------------------------------------------------
Consistent outputhttps://docs.litellm.ai/docs/completion/output
Routerhttps://docs.litellm.ai/docs/routing
LiteLLM Proxy Server (LLM Gateway)https://docs.litellm.ai/docs/simple_proxy
Jump to LiteLLM Proxy (LLM Gateway) Docshttps://github.com/BerriAI/litellm?tab=readme-ov-file#litellm-proxy-server-llm-gateway---docs
Jump to Supported LLM Providershttps://github.com/BerriAI/litellm?tab=readme-ov-file#supported-providers-docs
More information about the release cycle herehttps://docs.litellm.ai/docs/proxy/release_cycle
feature requesthttps://github.com/BerriAI/litellm/issues/new?assignees=&labels=enhancement&projects=&template=feature_request.yml&title=%5BFeature%5D%3A+
Docshttps://docs.litellm.ai/docs/
https://github.com/isaacus-dev/litellm#usage-docs
herehttps://docs.litellm.ai/docs/migration
https://colab.research.google.com/github/BerriAI/litellm/blob/main/cookbook/liteLLM_Getting_Started.ipynb
https://github.com/isaacus-dev/litellm#response-openai-format
provider docs for more informationhttps://docs.litellm.ai/docs/providers
Docshttps://docs.litellm.ai/docs/completion/stream#async-completion
https://github.com/isaacus-dev/litellm#async-docs
Docshttps://docs.litellm.ai/docs/completion/stream
https://github.com/isaacus-dev/litellm#streaming-docs
https://github.com/isaacus-dev/litellm#response-chunk-openai-format
Docshttps://docs.litellm.ai/docs/observability/callbacks
https://github.com/isaacus-dev/litellm#logging-observability-docs
Docshttps://docs.litellm.ai/docs/simple_proxy
https://github.com/isaacus-dev/litellm#litellm-proxy-server-llm-gateway---docs
Hosted Proxy (Preview)https://docs.litellm.ai/docs/hosted
Hooks for authhttps://docs.litellm.ai/docs/proxy/virtual_keys#custom-auth
Hooks for logginghttps://docs.litellm.ai/docs/proxy/logging#step-1---create-your-custom-litellm-callback-class
Cost trackinghttps://docs.litellm.ai/docs/proxy/virtual_keys#tracking-spend
Rate Limitinghttps://docs.litellm.ai/docs/proxy/users#set-rate-limits
Swagger Docshttps://litellm-api.up.railway.app/
https://github.com/isaacus-dev/litellm#-proxy-endpoints---swagger-docs
https://github.com/isaacus-dev/litellm#quick-start-proxy---cli
https://github.com/isaacus-dev/litellm#step-1-start-litellm-proxy
https://github.com/isaacus-dev/litellm#step-2-make-chatcompletions-request-to-proxy
Use LiteLLM Proxy with Langchain (Python, JS), OpenAI SDK (Python, JS) Anthropic SDK, Mistral SDK, LlamaIndex, Instructor, Curlhttps://docs.litellm.ai/docs/proxy/user_keys
Docshttps://docs.litellm.ai/docs/proxy/virtual_keys
https://github.com/isaacus-dev/litellm#proxy-key-management-docs
https://private-user-images.githubusercontent.com/29436595/302077487-47c97d5e-b9be-4839-b28c-43d7f4f10033.gif?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3ODMzODg0MTAsIm5iZiI6MTc4MzM4ODExMCwicGF0aCI6Ii8yOTQzNjU5NS8zMDIwNzc0ODctNDdjOTdkNWUtYjliZS00ODM5LWIyOGMtNDNkN2Y0ZjEwMDMzLmdpZj9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNjA3MDclMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjYwNzA3VDAxMzUxMFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTg3NjY5NWUwMDE3NGNhNGY1MzdmYzhlNGUxZmJlYWZlZGFjMjkyMmIzZjczZTYxYWQ0MDI1ZDA4MWM3Y2Q1MzgmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JnJlc3BvbnNlLWNvbnRlbnQtdHlwZT1pbWFnZSUyRmdpZiJ9.2Ts4Ga9XtAfXES1oRQAva_M7a-6YZP8J-Xb1yMfbOhg
https://github.com/isaacus-dev/litellm#request
https://github.com/isaacus-dev/litellm#expected-response
Docshttps://docs.litellm.ai/docs/providers
https://github.com/isaacus-dev/litellm#supported-providers-docs
Completionhttps://docs.litellm.ai/docs/#basic-usage
Streaminghttps://docs.litellm.ai/docs/completion/stream#streaming-responses
Async Completionhttps://docs.litellm.ai/docs/completion/stream#async-completion
Async Streaminghttps://docs.litellm.ai/docs/completion/stream#async-streaming
Async Embeddinghttps://docs.litellm.ai/docs/embedding/supported_embedding
Async Image Generationhttps://docs.litellm.ai/docs/image_generation
openaihttps://docs.litellm.ai/docs/providers/openai
Meta - Llama APIhttps://docs.litellm.ai/docs/providers/meta_llama
azurehttps://docs.litellm.ai/docs/providers/azure
AI/ML APIhttps://docs.litellm.ai/docs/providers/aiml
aws - sagemakerhttps://docs.litellm.ai/docs/providers/aws_sagemaker
aws - bedrockhttps://docs.litellm.ai/docs/providers/bedrock
google - vertex_aihttps://docs.litellm.ai/docs/providers/vertex
google - palmhttps://docs.litellm.ai/docs/providers/palm
google AI Studio - geminihttps://docs.litellm.ai/docs/providers/gemini
mistral ai apihttps://docs.litellm.ai/docs/providers/mistral
cloudflare AI Workershttps://docs.litellm.ai/docs/providers/cloudflare_workers
CompactifAIhttps://docs.litellm.ai/docs/providers/compactifai
coherehttps://docs.litellm.ai/docs/providers/cohere
anthropichttps://docs.litellm.ai/docs/providers/anthropic
empowerhttps://docs.litellm.ai/docs/providers/empower
huggingfacehttps://docs.litellm.ai/docs/providers/huggingface
replicatehttps://docs.litellm.ai/docs/providers/replicate
together_aihttps://docs.litellm.ai/docs/providers/togetherai
openrouterhttps://docs.litellm.ai/docs/providers/openrouter
ai21https://docs.litellm.ai/docs/providers/ai21
basetenhttps://docs.litellm.ai/docs/providers/baseten
vllmhttps://docs.litellm.ai/docs/providers/vllm
nlp_cloudhttps://docs.litellm.ai/docs/providers/nlp_cloud
aleph alphahttps://docs.litellm.ai/docs/providers/aleph_alpha
petalshttps://docs.litellm.ai/docs/providers/petals
ollamahttps://docs.litellm.ai/docs/providers/ollama
deepinfrahttps://docs.litellm.ai/docs/providers/deepinfra
perplexity-aihttps://docs.litellm.ai/docs/providers/perplexity
Groq AIhttps://docs.litellm.ai/docs/providers/groq
Deepseekhttps://docs.litellm.ai/docs/providers/deepseek
anyscalehttps://docs.litellm.ai/docs/providers/anyscale
IBM - watsonx.aihttps://docs.litellm.ai/docs/providers/watsonx
voyage aihttps://docs.litellm.ai/docs/providers/voyage
xinference [Xorbits Inference]https://docs.litellm.ai/docs/providers/xinference
FriendliAIhttps://docs.litellm.ai/docs/providers/friendliai
Galadrielhttps://docs.litellm.ai/docs/providers/galadriel
GradientAIhttps://docs.litellm.ai/docs/providers/gradient_ai
Novita AIhttps://novita.ai/models/llm?utm_source=github_litellm&utm_medium=github_readme&utm_campaign=github_link
Featherless AIhttps://docs.litellm.ai/docs/providers/featherless_ai
Nebius AI Studiohttps://docs.litellm.ai/docs/providers/nebius
Herokuhttps://docs.litellm.ai/docs/providers/heroku
OVHCloud AI Endpointshttps://docs.litellm.ai/docs/providers/ovhcloud
CometAPIhttps://docs.litellm.ai/docs/providers/cometapi
Read the Docshttps://docs.litellm.ai/docs/
https://github.com/isaacus-dev/litellm#run-in-developer-mode
https://github.com/isaacus-dev/litellm#services
https://github.com/isaacus-dev/litellm#backend
https://github.com/isaacus-dev/litellm#frontend
https://github.com/isaacus-dev/litellm#enterprise
Talk to foundershttps://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat
LiteLLM Commercial Licensehttps://docs.litellm.ai/docs/proxy/enterprise
https://github.com/isaacus-dev/litellm#contributing
https://github.com/isaacus-dev/litellm#quick-start-for-contributors
CONTRIBUTING.mdhttps://github.com/isaacus-dev/litellm/blob/main/CONTRIBUTING.md
https://github.com/isaacus-dev/litellm#code-quality--linting
Google Python Style Guidehttps://google.github.io/styleguide/pyguide.html
https://github.com/isaacus-dev/litellm#support--talk-with-founders
Schedule Demo 👋https://calendly.com/d/4mp-gd3-k5k/berriai-1-1-onboarding-litellm-hosted-version
Community Discord 💭https://discord.gg/wuPM9dRgDw
Community Slack 💭https://www.litellm.ai/support
https://github.com/isaacus-dev/litellm#why-did-we-build-this
https://github.com/isaacus-dev/litellm#contributors
https://github.com/BerriAI/litellm/graphs/contributors
docs.litellm.ai/docs/https://docs.litellm.ai/docs/
Readme https://github.com/isaacus-dev/litellm#readme-ov-file
View license https://github.com/isaacus-dev/litellm#License-1-ov-file
Contributing https://github.com/isaacus-dev/litellm#contributing-ov-file
Security policy https://github.com/isaacus-dev/litellm#security-ov-file
Please reload this pagehttps://github.com/isaacus-dev/litellm
Activityhttps://github.com/isaacus-dev/litellm/activity
Custom propertieshttps://github.com/isaacus-dev/litellm/custom-properties
0 forkshttps://github.com/isaacus-dev/litellm/forks
Report repository https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Fisaacus-dev%2Flitellm&report=isaacus-dev+%28user%29
Releaseshttps://github.com/isaacus-dev/litellm/releases
Packages 0https://github.com/orgs/isaacus-dev/packages?repo_name=litellm
Please reload this pagehttps://github.com/isaacus-dev/litellm
Please reload this pagehttps://github.com/isaacus-dev/litellm
Contributorshttps://github.com/isaacus-dev/litellm/graphs/contributors
Please reload this pagehttps://github.com/isaacus-dev/litellm
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.