René's URL Explorer Experiment


Title: GitHub - cecli-dev/cecli-litellm: Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM] · GitHub

Open Graph Title: GitHub - cecli-dev/cecli-litellm: Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

X Title: GitHub - cecli-dev/cecli-litellm: Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

Description: Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM] - cecli-dev/cecli-litellm

Open Graph Description: Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthr...

X Description: Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthr...

Mail addresses
ishaan@berri.ai
krrish@berri.ai

Opengraph URL: https://github.com/cecli-dev/cecli-litellm

X: @github

direct link

Domain: github.com

route-pattern/:user_id/:repository
route-controllerfiles
route-actiondisambiguate
fetch-noncev2:7c9fcce9-51e3-c1b9-929a-c77d164529be
current-catalog-service-hashf3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-idB454:10C1B1:550285:78AB28:6A620961
html-safe-nonce12c642ff3287632a5f8e23865e5bd0d32eb02d0f97b43a76eaddddf951e7e34c
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJCNDU0OjEwQzFCMTo1NTAyODU6NzhBQjI4OjZBNjIwOTYxIiwidmlzaXRvcl9pZCI6IjM3MDY2MTkxMTk2ODMxMTEyNjUiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmacb0342c37184c9533e1b6a74b91027e9eedf5376c4ac7426b7c034081a0cf534c
hovercard-subject-tagrepository:1300501599
github-keyboard-shortcutsrepository,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location//
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/cecli-dev/cecli-litellm
twitter:imagehttps://opengraph.githubassets.com/07e11a5a35eab6ac911315157fc6ba3722b48056ed69960cde20f8054c78436b/cecli-dev/cecli-litellm
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/07e11a5a35eab6ac911315157fc6ba3722b48056ed69960cde20f8054c78436b/cecli-dev/cecli-litellm
og:image:altPython SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthr...
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
Nonebe9a4d9589756e22b427637ffbf1123a96e067050e57f5cec403e3080a650ca4
turbo-cache-controlno-cache
go-importgithub.com/cecli-dev/cecli-litellm git https://github.com/cecli-dev/cecli-litellm.git
octolytics-dimension-user_id250452847
octolytics-dimension-user_logincecli-dev
octolytics-dimension-repository_id1300501599
octolytics-dimension-repository_nwocecli-dev/cecli-litellm
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forktrue
octolytics-dimension-repository_parent_id671269505
octolytics-dimension-repository_parent_nwoBerriAI/litellm
octolytics-dimension-repository_network_root_id671269505
octolytics-dimension-repository_network_root_nwoBerriAI/litellm
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release7b5509702f01f876c214a2cbb142690847de0019
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/cecli-dev/cecli-litellm#start-of-content
https://github.com/
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fcecli-dev%2Fcecli-litellm
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub Copilot appDirect agents from issue to mergehttps://github.com/features/ai/github-app
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
Code QualityEnforce quality at mergehttps://github.com/features/code-quality
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
View all resourceshttps://github.com/resources
GitHub SponsorsFund open source developershttps://github.com/open-source/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/open-source/accelerator
GitHub Starshttps://stars.github.com
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fcecli-dev%2Fcecli-litellm
Sign up https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=cecli-dev%2Fcecli-litellm
Reloadhttps://github.com/cecli-dev/cecli-litellm
Reloadhttps://github.com/cecli-dev/cecli-litellm
Reloadhttps://github.com/cecli-dev/cecli-litellm
Please reload this pagehttps://github.com/cecli-dev/cecli-litellm
cecli-dev https://github.com/cecli-dev
cecli-litellmhttps://github.com/cecli-dev/cecli-litellm
BerriAI/litellmhttps://github.com/BerriAI/litellm
Notifications https://github.com/login?return_to=%2Fcecli-dev%2Fcecli-litellm
Fork 0 https://github.com/login?return_to=%2Fcecli-dev%2Fcecli-litellm
Star 0 https://github.com/login?return_to=%2Fcecli-dev%2Fcecli-litellm
Code https://github.com/cecli-dev/cecli-litellm
Pull requests 0 https://github.com/cecli-dev/cecli-litellm/pulls
Actions https://github.com/cecli-dev/cecli-litellm/actions
Projects https://github.com/cecli-dev/cecli-litellm/projects
Security and quality 0 https://github.com/cecli-dev/cecli-litellm/security
Insights https://github.com/cecli-dev/cecli-litellm/pulse
Code https://github.com/cecli-dev/cecli-litellm
Pull requests https://github.com/cecli-dev/cecli-litellm/pulls
Actions https://github.com/cecli-dev/cecli-litellm/actions
Projects https://github.com/cecli-dev/cecli-litellm/projects
Security and quality https://github.com/cecli-dev/cecli-litellm/security
Insights https://github.com/cecli-dev/cecli-litellm/pulse
https://github.com/cecli-dev/cecli-litellm
Brancheshttps://github.com/cecli-dev/cecli-litellm/branches
Tagshttps://github.com/cecli-dev/cecli-litellm/tags
https://github.com/cecli-dev/cecli-litellm/branches
https://github.com/cecli-dev/cecli-litellm/tags
40,772 Commitshttps://github.com/cecli-dev/cecli-litellm/commits/litellm_internal_staging/
https://github.com/cecli-dev/cecli-litellm/commits/litellm_internal_staging/
.cargohttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/.cargo
.cargohttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/.cargo
.circlecihttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/.circleci
.circlecihttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/.circleci
.devcontainerhttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/.devcontainer
.devcontainerhttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/.devcontainer
.githookshttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/.githooks
.githookshttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/.githooks
.githubhttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/.github
.githubhttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/.github
.semgrep/ruleshttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/.semgrep/rules
.semgrep/ruleshttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/.semgrep/rules
backendhttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/backend
backendhttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/backend
ci_cdhttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/ci_cd
ci_cdhttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/ci_cd
cookbookhttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/cookbook
cookbookhttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/cookbook
db_scriptshttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/db_scripts
db_scriptshttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/db_scripts
disthttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/dist
disthttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/dist
dockerhttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/docker
dockerhttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/docker
enterprisehttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/enterprise
enterprisehttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/enterprise
exampleshttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/examples
exampleshttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/examples
gatewayhttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/gateway
gatewayhttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/gateway
helmhttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/helm
helmhttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/helm
litellm-proxy-extrashttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/litellm-proxy-extras
litellm-proxy-extrashttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/litellm-proxy-extras
litellm-rusthttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/litellm-rust
litellm-rusthttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/litellm-rust
litellmhttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/litellm
litellmhttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/litellm
migrationshttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/migrations
migrationshttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/migrations
packaging/homebrewhttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/packaging/homebrew
packaging/homebrewhttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/packaging/homebrew
scriptshttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/scripts
scriptshttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/scripts
terraformhttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/terraform
terraformhttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/terraform
testshttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/tests
testshttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/tests
uihttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/ui
uihttps://github.com/cecli-dev/cecli-litellm/tree/litellm_internal_staging/ui
.dockerignorehttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/.dockerignore
.dockerignorehttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/.dockerignore
.env.examplehttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/.env.example
.env.examplehttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/.env.example
.flake8https://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/.flake8
.flake8https://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/.flake8
.git-blame-ignore-revshttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/.git-blame-ignore-revs
.git-blame-ignore-revshttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/.git-blame-ignore-revs
.gitattributeshttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/.gitattributes
.gitattributeshttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/.gitattributes
.gitguardian.yamlhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/.gitguardian.yaml
.gitguardian.yamlhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/.gitguardian.yaml
.gitignorehttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/.gitignore
.gitignorehttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/.gitignore
.npmrchttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/.npmrc
.npmrchttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/.npmrc
AGENTS.mdhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/AGENTS.md
AGENTS.mdhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/AGENTS.md
ARCHITECTURE.mdhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/ARCHITECTURE.md
ARCHITECTURE.mdhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/ARCHITECTURE.md
CLAUDE.mdhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/CLAUDE.md
CLAUDE.mdhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/CLAUDE.md
CONTRIBUTING.mdhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/CONTRIBUTING.md
CONTRIBUTING.mdhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/CONTRIBUTING.md
Dockerfilehttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/Dockerfile
Dockerfilehttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/Dockerfile
GEMINI.mdhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/GEMINI.md
GEMINI.mdhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/GEMINI.md
LICENSEhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/LICENSE
LICENSEhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/LICENSE
Makefilehttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/Makefile
Makefilehttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/Makefile
README.mdhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/README.md
README.mdhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/README.md
basedpyright-code-budget.jsonhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/basedpyright-code-budget.json
basedpyright-code-budget.jsonhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/basedpyright-code-budget.json
codecov.yamlhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/codecov.yaml
codecov.yamlhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/codecov.yaml
cosign.pubhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/cosign.pub
cosign.pubhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/cosign.pub
docker-compose.hardened.ymlhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/docker-compose.hardened.yml
docker-compose.hardened.ymlhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/docker-compose.hardened.yml
docker-compose.ymlhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/docker-compose.yml
docker-compose.ymlhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/docker-compose.yml
license_cache.jsonhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/license_cache.json
license_cache.jsonhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/license_cache.json
mcp_servers.jsonhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/mcp_servers.json
mcp_servers.jsonhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/mcp_servers.json
model_prices_and_context_window.jsonhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/model_prices_and_context_window.json
model_prices_and_context_window.jsonhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/model_prices_and_context_window.json
osv-scanner.tomlhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/osv-scanner.toml
osv-scanner.tomlhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/osv-scanner.toml
package-lock.jsonhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/package-lock.json
package-lock.jsonhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/package-lock.json
package.jsonhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/package.json
package.jsonhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/package.json
policy_templates.jsonhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/policy_templates.json
policy_templates.jsonhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/policy_templates.json
prometheus.ymlhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/prometheus.yml
prometheus.ymlhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/prometheus.yml
provider_endpoints_support.jsonhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/provider_endpoints_support.json
provider_endpoints_support.jsonhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/provider_endpoints_support.json
proxy_server_config.yamlhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/proxy_server_config.yaml
proxy_server_config.yamlhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/proxy_server_config.yaml
pyproject.tomlhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/pyproject.toml
pyproject.tomlhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/pyproject.toml
pyrightconfig.jsonhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/pyrightconfig.json
pyrightconfig.jsonhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/pyrightconfig.json
qa_sticky_session.shhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/qa_sticky_session.sh
qa_sticky_session.shhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/qa_sticky_session.sh
render.yamlhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/render.yaml
render.yamlhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/render.yaml
ruff-strict-budget.jsonhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/ruff-strict-budget.json
ruff-strict-budget.jsonhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/ruff-strict-budget.json
ruff-strict.tomlhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/ruff-strict.toml
ruff-strict.tomlhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/ruff-strict.toml
ruff.tomlhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/ruff.toml
ruff.tomlhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/ruff.toml
schema.prismahttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/schema.prisma
schema.prismahttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/schema.prisma
security.mdhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/security.md
security.mdhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/security.md
taplo.tomlhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/taplo.toml
taplo.tomlhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/taplo.toml
type-discipline-budget.jsonhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/type-discipline-budget.json
type-discipline-budget.jsonhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/type-discipline-budget.json
uv.lockhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/uv.lock
uv.lockhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/uv.lock
READMEhttps://github.com/cecli-dev/cecli-litellm
Contributinghttps://github.com/cecli-dev/cecli-litellm
Licensehttps://github.com/cecli-dev/cecli-litellm
Securityhttps://github.com/cecli-dev/cecli-litellm
https://github.com/cecli-dev/cecli-litellm#---------litellm----
https://render.com/deploy?repo=https://github.com/BerriAI/litellm
https://railway.com/deploy/RhvhdC?referralCode=7mRv9K&utm_medium=integration&utm_source=template&utm_campaign=generic
https://console.aws.amazon.com/cloudshell/home
https://ssh.cloud.google.com/cloudshell/editor?cloudshell_git_repo=https%3A%2F%2Fgithub.com%2FBerriAI%2Flitellm&cloudshell_workspace=terraform%2Flitellm%2Fgcp%2Fexamples%2Fdefault&cloudshell_tutorial=TUTORIAL.md&cloudshell_image=gcr.io/ds-artifacts-cloudshell/deploystack_custom_image&shellonly=true
LiteLLM Proxy Server (AI Gateway)https://docs.litellm.ai/docs/simple_proxy
Hosted Proxyhttps://docs.litellm.ai/docs/enterprise#hosted-litellm-proxy
Enterprise Tierhttps://litellm.ai/enterprise
Websitehttps://www.litellm.ai/ai-gateway
https://github.com/cecli-dev/cecli-litellm#litellm-proxy-server-ai-gateway---hosted-proxy--enterprise-tier--website
https://pypi.org/project/litellm/
https://github.com/BerriAI/litellm
https://www.ycombinator.com/companies/berriai
https://wa.link/huol9n
https://discord.gg/wuPM9dRgDw
https://www.litellm.ai/support
https://codspeed.io/BerriAI/litellm?utm_source=badge
https://github.com/cecli-dev/cecli-litellm#----------------------------------------------------------------------------------------------------------------
https://private-user-images.githubusercontent.com/29436595/528292435-c5ee0412-6fb5-4fb6-ab5b-bafae4209ca6.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3ODQ4MTAxMjUsIm5iZiI6MTc4NDgwOTgyNSwicGF0aCI6Ii8yOTQzNjU5NS81MjgyOTI0MzUtYzVlZTA0MTItNmZiNS00ZmI2LWFiNWItYmFmYWU0MjA5Y2E2LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNjA3MjMlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjYwNzIzVDEyMzAyNVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTdhNDVkOGRkYzIwNWQ3ZjAxOTlhNGYyMTYzMGYxNmJkMTc3MzQ2OWRkMmZkYWZmNTA3ZmNjN2UxNzNlOGFhODcmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JnJlc3BvbnNlLWNvbnRlbnQtdHlwZT1pbWFnZSUyRnBuZyJ9.gqoyIGTSYZe-X_TwxaJrNQEQdWmpZHnrETOtdDUxgmM
https://github.com/cecli-dev/cecli-litellm#what-is-litellm
Jump to LiteLLM Proxy (LLM Gateway) Docshttps://docs.litellm.ai/docs/simple_proxy
Jump to Supported LLM Providershttps://docs.litellm.ai/docs/providers
https://github.com/cecli-dev/cecli-litellm#why-litellm
benchmarkshttps://docs.litellm.ai/docs/benchmarks
https://github.com/cecli-dev/cecli-litellm#oss-adopters
https://private-user-images.githubusercontent.com/29436595/539538604-f7296d4f-9fbd-460d-9d05-e4df31697c4b.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3ODQ4MTAxMjUsIm5iZiI6MTc4NDgwOTgyNSwicGF0aCI6Ii8yOTQzNjU5NS81Mzk1Mzg2MDQtZjcyOTZkNGYtOWZiZC00NjBkLTlkMDUtZTRkZjMxNjk3YzRiLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNjA3MjMlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjYwNzIzVDEyMzAyNVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWFjMDM4MzEwMDYzYTgwM2I5ODM1YTk4ODQ1NzRmMzMyYTVhZDVmOTdjZDhkZGNjMGMyNjE5ZGRhYmQzN2NmY2EmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JnJlc3BvbnNlLWNvbnRlbnQtdHlwZT1pbWFnZSUyRnBuZyJ9.y84lNcpg2IPHPs12hMoxhlOaGQvg4_2MQ-gOPL9-kjA
https://private-user-images.githubusercontent.com/155045088/570075964-436fca71-988b-40bb-b5fe-8450c80fdbd0.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3ODQ4MTAxMjUsIm5iZiI6MTc4NDgwOTgyNSwicGF0aCI6Ii8xNTUwNDUwODgvNTcwMDc1OTY0LTQzNmZjYTcxLTk4OGItNDBiYi1iNWZlLTg0NTBjODBmZGJkMC5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjYwNzIzJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI2MDcyM1QxMjMwMjVaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT1jMDlkZTE4NmVlNjNlNWNhY2I2YTc3YjM5NThkZWFlZDM5Y2I1MGYzOWZjZjU5YWFiOWM4Nzg4NjY2ZmJiNjVmJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZyZXNwb25zZS1jb250ZW50LXR5cGU9aW1hZ2UlMkZwbmcifQ.UBCPXnzWfeR2paLKwtgx-pj22tzYFb1YXzj8sdU28kY
https://private-user-images.githubusercontent.com/29436595/540141464-caf270a2-5aee-45c4-8222-41a2070c4f19.jpg?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3ODQ4MTAxMjUsIm5iZiI6MTc4NDgwOTgyNSwicGF0aCI6Ii8yOTQzNjU5NS81NDAxNDE0NjQtY2FmMjcwYTItNWFlZS00NWM0LTgyMjItNDFhMjA3MGM0ZjE5LmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNjA3MjMlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjYwNzIzVDEyMzAyNVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTdjMGFiODFkZWVhYmY5ZDNmOTU2Yzg0OWI0ZjEyMWViMjQxNzRlYjhmNzYwYzAwYzJiYWE4YTcxNjRjODcwNmYmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JnJlc3BvbnNlLWNvbnRlbnQtdHlwZT1pbWFnZSUyRmpwZWcifQ.83isROtIK8QbyudWaRg3Z0k7gj460mQwzK54g0J5Qoc
https://private-user-images.githubusercontent.com/128240629/575641187-3db0ae72-0843-4005-a56d-bba1dde2193d.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3ODQ4MTAxMjUsIm5iZiI6MTc4NDgwOTgyNSwicGF0aCI6Ii8xMjgyNDA2MjkvNTc1NjQxMTg3LTNkYjBhZTcyLTA4NDMtNDAwNS1hNTZkLWJiYTFkZGUyMTkzZC5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjYwNzIzJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI2MDcyM1QxMjMwMjVaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT1mNGJkYWQ1NmQzN2Q5MjlkYjhjOTA4NDViYjNjOTUwODA0ZDU3ZDlhMDZkZTFlOTA4NGRiMDA0MTk0YWM1NWZmJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZyZXNwb25zZS1jb250ZW50LXR5cGU9aW1hZ2UlMkZwbmcifQ.OvbpGetXu2iTthtsNsNdT73A2wyhp7C_gLGumRSuY1Y
https://private-user-images.githubusercontent.com/29436595/540141504-a6150c4c-149e-4cae-888b-8b92be6e003f.jpeg?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3ODQ4MTAxMjUsIm5iZiI6MTc4NDgwOTgyNSwicGF0aCI6Ii8yOTQzNjU5NS81NDAxNDE1MDQtYTYxNTBjNGMtMTQ5ZS00Y2FlLTg4OGItOGI5MmJlNmUwMDNmLmpwZWc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjYwNzIzJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI2MDcyM1QxMjMwMjVaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT1lMmMwMTg3NDkyNWUzYTJjZGJjNDQ3MjVlNjE0Y2VkNjYxMzgxYmY0M2YzNTIwYTVhMzkwNjIyNjQ2YmM0NGFhJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZyZXNwb25zZS1jb250ZW50LXR5cGU9aW1hZ2UlMkZqcGVnIn0.AS_S4b8GuMxINKBXQVy93qEEO3miKc2nyFX_ykAsbMA
https://github.com/cecli-dev/cecli-litellm#netflix
https://private-user-images.githubusercontent.com/128240629/540758125-c02f7be0-8c2e-4d27-aea7-7c024bfaebc0.webp?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3ODQ4MTAxMjUsIm5iZiI6MTc4NDgwOTgyNSwicGF0aCI6Ii8xMjgyNDA2MjkvNTQwNzU4MTI1LWMwMmY3YmUwLThjMmUtNGQyNy1hZWE3LTdjMDI0YmZhZWJjMC53ZWJwP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI2MDcyMyUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNjA3MjNUMTIzMDI1WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9YjkzNTVkZWQxY2Y4OTRiYzM1NjlhZTE4NWI0MzQ1OTZkMzMyODI3MGYyYjkxZGYzMWM1OGIxMDlhN2Y0OTllYyZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QmcmVzcG9uc2UtY29udGVudC10eXBlPWltYWdlJTJGd2VicCJ9.bCQYEMBxc10-pSeZwEui6odXMQAQEcRNGC9HQNN_HzQ
https://github.com/cecli-dev/cecli-litellm#features
All Supported Endpointshttps://docs.litellm.ai/docs/supported_endpoints
https://github.com/cecli-dev/cecli-litellm#python-sdk
https://github.com/cecli-dev/cecli-litellm#ai-gateway-proxy-server
Getting Started - E2E Tutorialhttps://docs.litellm.ai/docs/proxy/docker_quick_start
Docs: LLM Providershttps://docs.litellm.ai/docs/providers
Supported Providershttps://docs.litellm.ai/docs/a2a#add-a2a-agents
https://github.com/cecli-dev/cecli-litellm#python-sdk---a2a-protocol
https://github.com/cecli-dev/cecli-litellm#ai-gateway-proxy-server-1
Add your Agent to the AI Gatewayhttps://docs.litellm.ai/docs/a2a#adding-your-agent
Docs: A2A Agent Gatewayhttps://docs.litellm.ai/docs/a2a
https://github.com/cecli-dev/cecli-litellm#python-sdk---mcp-bridge
https://github.com/cecli-dev/cecli-litellm#ai-gateway---mcp-gateway
Add your MCP Server to the AI Gatewayhttps://docs.litellm.ai/docs/mcp#adding-your-mcp
https://github.com/cecli-dev/cecli-litellm#use-with-cursor-ide
Docs: MCP Gatewayhttps://docs.litellm.ai/docs/mcp
Website Supported Modelshttps://models.litellm.ai/
Docshttps://docs.litellm.ai/docs/providers
https://github.com/cecli-dev/cecli-litellm#supported-providers-website-supported-models--docs
Abliteration (abliteration)https://docs.litellm.ai/docs/providers/abliteration
AI/ML API (aiml)https://docs.litellm.ai/docs/providers/aiml
AI21 (ai21)https://docs.litellm.ai/docs/providers/ai21
AI21 Chat (ai21_chat)https://docs.litellm.ai/docs/providers/ai21
Aleph Alphahttps://docs.litellm.ai/docs/providers/aleph_alpha
Amazon Novahttps://docs.litellm.ai/docs/providers/amazon_nova
Anthropic (anthropic)https://docs.litellm.ai/docs/providers/anthropic
Anthropic Text (anthropic_text)https://docs.litellm.ai/docs/providers/anthropic
Anyscalehttps://docs.litellm.ai/docs/providers/anyscale
AssemblyAI (assemblyai)https://docs.litellm.ai/docs/pass_through/assembly_ai
Auto Router (auto_router)https://docs.litellm.ai/docs/proxy/auto_routing
AWS - Bedrock (bedrock)https://docs.litellm.ai/docs/providers/bedrock
AWS - Sagemaker (sagemaker)https://docs.litellm.ai/docs/providers/aws_sagemaker
Azure (azure)https://docs.litellm.ai/docs/providers/azure
Azure AI (azure_ai)https://docs.litellm.ai/docs/providers/azure_ai
Azure Text (azure_text)https://docs.litellm.ai/docs/providers/azure
Baseten (baseten)https://docs.litellm.ai/docs/providers/baseten
Bytez (bytez)https://docs.litellm.ai/docs/providers/bytez
Cerebras (cerebras)https://docs.litellm.ai/docs/providers/cerebras
Clarifai (clarifai)https://docs.litellm.ai/docs/providers/clarifai
Cloudflare AI Workers (cloudflare)https://docs.litellm.ai/docs/providers/cloudflare_workers
Codestral (codestral)https://docs.litellm.ai/docs/providers/codestral
Cohere (cohere)https://docs.litellm.ai/docs/providers/cohere
Cohere Chat (cohere_chat)https://docs.litellm.ai/docs/providers/cohere
CometAPI (cometapi)https://docs.litellm.ai/docs/providers/cometapi
CompactifAI (compactifai)https://docs.litellm.ai/docs/providers/compactifai
Custom (custom)https://docs.litellm.ai/docs/providers/custom_llm_server
Custom OpenAI (custom_openai)https://docs.litellm.ai/docs/providers/openai_compatible
Dashscope (dashscope)https://docs.litellm.ai/docs/providers/dashscope
Databricks (databricks)https://docs.litellm.ai/docs/providers/databricks
DataRobot (datarobot)https://docs.litellm.ai/docs/providers/datarobot
Deepgram (deepgram)https://docs.litellm.ai/docs/providers/deepgram
DeepInfra (deepinfra)https://docs.litellm.ai/docs/providers/deepinfra
Deepseek (deepseek)https://docs.litellm.ai/docs/providers/deepseek
ElevenLabs (elevenlabs)https://docs.litellm.ai/docs/providers/elevenlabs
Empower (empower)https://docs.litellm.ai/docs/providers/empower
Fal AI (fal_ai)https://docs.litellm.ai/docs/providers/fal_ai
Featherless AI (featherless_ai)https://docs.litellm.ai/docs/providers/featherless_ai
Fireworks AI (fireworks_ai)https://docs.litellm.ai/docs/providers/fireworks_ai
FriendliAI (friendliai)https://docs.litellm.ai/docs/providers/friendliai
Galadriel (galadriel)https://docs.litellm.ai/docs/providers/galadriel
GitHub Copilot (github_copilot)https://docs.litellm.ai/docs/providers/github_copilot
GitHub Models (github)https://docs.litellm.ai/docs/providers/github
Google - PaLMhttps://docs.litellm.ai/docs/providers/palm
Google - Vertex AI (vertex_ai)https://docs.litellm.ai/docs/providers/vertex
Google AI Studio - Gemini (gemini)https://docs.litellm.ai/docs/providers/gemini
GradientAI (gradient_ai)https://docs.litellm.ai/docs/providers/gradient_ai
Groq AI (groq)https://docs.litellm.ai/docs/providers/groq
Heroku (heroku)https://docs.litellm.ai/docs/providers/heroku
Hosted VLLM (hosted_vllm)https://docs.litellm.ai/docs/providers/vllm
Huggingface (huggingface)https://docs.litellm.ai/docs/providers/huggingface
Hyperbolic (hyperbolic)https://docs.litellm.ai/docs/providers/hyperbolic
IBM - Watsonx.ai (watsonx)https://docs.litellm.ai/docs/providers/watsonx
Infinity (infinity)https://docs.litellm.ai/docs/providers/infinity
Jina AI (jina_ai)https://docs.litellm.ai/docs/providers/jina_ai
Lambda AI (lambda_ai)https://docs.litellm.ai/docs/providers/lambda_ai
Lemonade (lemonade)https://docs.litellm.ai/docs/providers/lemonade
LiteLLM Proxy (litellm_proxy)https://docs.litellm.ai/docs/providers/litellm_proxy
Llamafile (llamafile)https://docs.litellm.ai/docs/providers/llamafile
LM Studio (lm_studio)https://docs.litellm.ai/docs/providers/lm_studio
Maritalk (maritalk)https://docs.litellm.ai/docs/providers/maritalk
Meta - Llama API (meta_llama)https://docs.litellm.ai/docs/providers/meta_llama
Mistral AI API (mistral)https://docs.litellm.ai/docs/providers/mistral
ModelScope (modelscope)https://docs.litellm.ai/docs/providers/modelscope
Moonshot (moonshot)https://docs.litellm.ai/docs/providers/moonshot
Morph (morph)https://docs.litellm.ai/docs/providers/morph
Nebius AI Studio (nebius)https://docs.litellm.ai/docs/providers/nebius
NLP Cloud (nlp_cloud)https://docs.litellm.ai/docs/providers/nlp_cloud
Novita AI (novita)https://novita.ai/models/llm?utm_source=github_litellm&utm_medium=github_readme&utm_campaign=github_link
Nscale (nscale)https://docs.litellm.ai/docs/providers/nscale
Nvidia NIM (nvidia_nim)https://docs.litellm.ai/docs/providers/nvidia_nim
OCI (oci)https://docs.litellm.ai/docs/providers/oci
Ollama (ollama)https://docs.litellm.ai/docs/providers/ollama
Ollama Chat (ollama_chat)https://docs.litellm.ai/docs/providers/ollama
Oobabooga (oobabooga)https://docs.litellm.ai/docs/providers/openai_compatible
OpenAI (openai)https://docs.litellm.ai/docs/providers/openai
OpenAI-like (openai_like)https://docs.litellm.ai/docs/providers/openai_compatible
OpenRouter (openrouter)https://docs.litellm.ai/docs/providers/openrouter
OVHCloud AI Endpoints (ovhcloud)https://docs.litellm.ai/docs/providers/ovhcloud
Perplexity AI (perplexity)https://docs.litellm.ai/docs/providers/perplexity
Petals (petals)https://docs.litellm.ai/docs/providers/petals
Pinstripes (pinstripes)https://docs.litellm.ai/docs/providers/pinstripes
Predibase (predibase)https://docs.litellm.ai/docs/providers/predibase
Recraft (recraft)https://docs.litellm.ai/docs/providers/recraft
Replicate (replicate)https://docs.litellm.ai/docs/providers/replicate
Sagemaker Chat (sagemaker_chat)https://docs.litellm.ai/docs/providers/aws_sagemaker
Sambanova (sambanova)https://docs.litellm.ai/docs/providers/sambanova
Snowflake (snowflake)https://docs.litellm.ai/docs/providers/snowflake
Text Completion Codestral (text-completion-codestral)https://docs.litellm.ai/docs/providers/codestral
Text Completion OpenAI (text-completion-openai)https://docs.litellm.ai/docs/providers/text_completion_openai
Together AI (together_ai)https://docs.litellm.ai/docs/providers/togetherai
Topaz (topaz)https://docs.litellm.ai/docs/providers/topaz
Triton (triton)https://docs.litellm.ai/docs/providers/triton-inference-server
V0 (v0)https://docs.litellm.ai/docs/providers/v0
Vercel AI Gateway (vercel_ai_gateway)https://docs.litellm.ai/docs/providers/vercel_ai_gateway
VLLM (vllm)https://docs.litellm.ai/docs/providers/vllm
Volcengine (volcengine)https://docs.litellm.ai/docs/providers/volcano
Voyage AI (voyage)https://docs.litellm.ai/docs/providers/voyage
WandB Inference (wandb)https://docs.litellm.ai/docs/providers/wandb_inference
Watsonx Text (watsonx_text)https://docs.litellm.ai/docs/providers/watsonx
xAI (xai)https://docs.litellm.ai/docs/providers/xai
Xinference (xinference)https://docs.litellm.ai/docs/providers/xinference
Read the Docshttps://docs.litellm.ai/docs/
https://github.com/cecli-dev/cecli-litellm#get-started
LiteLLM AI Gatewayhttps://docs.litellm.ai/docs/simple_proxy
LiteLLM Python SDKhttps://docs.litellm.ai/docs/
Routerhttps://docs.litellm.ai/docs/routing
More information about the release cycle herehttps://docs.litellm.ai/docs/proxy/release_cycle
feature requesthttps://github.com/BerriAI/litellm/issues/new?assignees=&labels=enhancement&projects=&template=feature_request.yml&title=%5BFeature%5D%3A+
https://github.com/cecli-dev/cecli-litellm#deploy-on-aws-or-gcp-with-terraform
public Terraform Registryhttps://registry.terraform.io/namespaces/BerriAI
https://github.com/cecli-dev/cecli-litellm#aws--ecs-fargate--aurora--elasticache--alb
https://console.aws.amazon.com/cloudshell/home
Module page →https://registry.terraform.io/modules/BerriAI/litellm/aws/latest
registry pagehttps://registry.terraform.io/modules/BerriAI/litellm/aws/latest?tab=inputs
https://github.com/cecli-dev/cecli-litellm#gcp--cloud-run--cloud-sql--memorystore--https-lb
https://ssh.cloud.google.com/cloudshell/editor?cloudshell_git_repo=https%3A%2F%2Fgithub.com%2FBerriAI%2Flitellm&cloudshell_workspace=terraform%2Flitellm%2Fgcp%2Fexamples%2Fdefault&cloudshell_tutorial=TUTORIAL.md&cloudshell_image=gcr.io/ds-artifacts-cloudshell/deploystack_custom_image&shellonly=true
DeployStack tutorialhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/terraform/litellm/gcp/examples/default/TUTORIAL.md
Module page →https://registry.terraform.io/modules/BerriAI/litellm/google/latest
registry pagehttps://registry.terraform.io/modules/BerriAI/litellm/google/latest?tab=inputs
https://github.com/cecli-dev/cecli-litellm#both-stacks-include
Helm charthttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/helm/litellm
terraform/litellm/aws/https://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/terraform/litellm/aws
terraform/litellm/gcp/https://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/terraform/litellm/gcp
https://github.com/cecli-dev/cecli-litellm#run-in-developer-mode
https://github.com/cecli-dev/cecli-litellm#services
https://github.com/cecli-dev/cecli-litellm#backend
https://github.com/cecli-dev/cecli-litellm#frontend
https://github.com/cecli-dev/cecli-litellm#verify-docker-image-signatures
cosignhttps://docs.sigstore.dev/cosign/overview/
commit 0112e53https://github.com/BerriAI/litellm/commit/0112e53046018d726492c814b3644b7d376029d0
https://github.com/cecli-dev/cecli-litellm#enterprise
Get an Enterprise Licensehttps://litellm.ai/enterprise
Talk to foundershttps://enterprise.litellm.ai/demo
LiteLLM Commercial Licensehttps://docs.litellm.ai/docs/proxy/enterprise
https://github.com/cecli-dev/cecli-litellm#contributing
https://github.com/cecli-dev/cecli-litellm#quick-start-for-contributors
CONTRIBUTING.mdhttps://github.com/cecli-dev/cecli-litellm/blob/litellm_internal_staging/CONTRIBUTING.md
BerriAI/litellm-docshttps://github.com/BerriAI/litellm-docs
docs.litellm.aihttps://docs.litellm.ai
https://github.com/cecli-dev/cecli-litellm#code-quality--linting
Google Python Style Guidehttps://google.github.io/styleguide/pyguide.html
https://github.com/cecli-dev/cecli-litellm#support--talk-with-founders
Schedule Demo 👋https://calendly.com/d/4mp-gd3-k5k/berriai-1-1-onboarding-litellm-hosted-version
Community Discord 💭https://discord.gg/wuPM9dRgDw
Community Slack 💭https://www.litellm.ai/support
https://github.com/cecli-dev/cecli-litellm#contributors
https://github.com/BerriAI/litellm/graphs/contributors
docs.litellm.ai/docs/https://docs.litellm.ai/docs/
Readme https://github.com/cecli-dev/cecli-litellm#readme-ov-file
View license https://github.com/cecli-dev/cecli-litellm#License-1-ov-file
Contributing https://github.com/cecli-dev/cecli-litellm#contributing-ov-file
Security policy https://github.com/cecli-dev/cecli-litellm#security-ov-file
Please reload this pagehttps://github.com/cecli-dev/cecli-litellm
Activityhttps://github.com/cecli-dev/cecli-litellm/activity
Custom propertieshttps://github.com/cecli-dev/cecli-litellm/custom-properties
0 forkshttps://github.com/cecli-dev/cecli-litellm/forks
Report repository https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Fcecli-dev%2Fcecli-litellm&report=cecli-dev+%28user%29
Releaseshttps://github.com/cecli-dev/cecli-litellm/releases
Packages 0https://github.com/orgs/cecli-dev/packages?repo_name=cecli-litellm
Please reload this pagehttps://github.com/cecli-dev/cecli-litellm
Contributorshttps://github.com/cecli-dev/cecli-litellm/graphs/contributors
Please reload this pagehttps://github.com/cecli-dev/cecli-litellm
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.