René's URL Explorer Experiment


Title: GitHub - xusenlinzy/api-for-open-llm: Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, ChatGLM, ChatGLM2, ChatGLM3 etc. 开源大模型的统一后端接口 · GitHub

Open Graph Title: GitHub - xusenlinzy/api-for-open-llm: Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, ChatGLM, ChatGLM2, ChatGLM3 etc. 开源大模型的统一后端接口

X Title: GitHub - xusenlinzy/api-for-open-llm: Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, ChatGLM, ChatGLM2, ChatGLM3 etc. 开源大模型的统一后端接口

Description: Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, ChatGLM, ChatGLM2, ChatGLM3 etc. 开源大模型的统一后端接口 - xusenlinzy/api-for-open-llm

Open Graph Description: Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, ChatGLM, ChatGLM2, ChatGLM3 etc....

X Description: Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, ChatGLM, ChatGLM2, ChatGLM3 etc....

Opengraph URL: https://github.com/xusenlinzy/api-for-open-llm

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react-reconciler,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@d5750093facf
route-pattern/:user_id/:repository
route-controllerfiles
route-actiondisambiguate
fetch-noncev2:6c5b8a34-59b2-0e25-6e59-ac03cb980454
current-catalog-service-hashf3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-idBB38:E4848:9E9EF1:D9D762:6AED9FF0
html-safe-nonce5e9b7705add774fdac5fdd14a1352689eed2ad5293dbc49416165ac934f5e002
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJCQjM4OkU0ODQ4OjlFOUVGMTpEOUQ3NjI6NkFFRDlGRjAiLCJ2aXNpdG9yX2lkIjoiNjU1NjkwNzIyNDMyMjM4Mzg1NiIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmac9306b055c296e3e5da24bb419f4b88c3efd43efb891c4b248c261f536a25b367
hovercard-subject-tagrepository:644259800
github-keyboard-shortcutsrepository,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location//
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/xusenlinzy/api-for-open-llm
twitter:imagehttps://opengraph.githubassets.com/278f52dcf7a91f23102db797a263c84e63ece4cf9b34cb2a47246add9e37d236/xusenlinzy/api-for-open-llm
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/278f52dcf7a91f23102db797a263c84e63ece4cf9b34cb2a47246add9e37d236/xusenlinzy/api-for-open-llm
og:image:altOpenai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, ChatGLM, ChatGLM2, ChatGLM3 etc....
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None9f51e3b6c7a190e426e641ae15acbc58dd1ac2003e96b58879bbc298e213dbf3
turbo-cache-controlno-cache
go-importgithub.com/xusenlinzy/api-for-open-llm git https://github.com/xusenlinzy/api-for-open-llm.git
octolytics-dimension-user_id111472355
octolytics-dimension-user_loginxusenlinzy
octolytics-dimension-repository_id644259800
octolytics-dimension-repository_nwoxusenlinzy/api-for-open-llm
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id644259800
octolytics-dimension-repository_network_root_nwoxusenlinzy/api-for-open-llm
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release7060660810b587033ea861b8aa67beb72c8e6542
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/xusenlinzy/api-for-open-llm#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fxusenlinzy%2Fapi-for-open-llm
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fxusenlinzy%2Fapi-for-open-llm
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=xusenlinzy%2Fapi-for-open-llm
Reloadhttps://github.com/xusenlinzy/api-for-open-llm
Reloadhttps://github.com/xusenlinzy/api-for-open-llm
Reloadhttps://github.com/xusenlinzy/api-for-open-llm
xusenlinzyhttps://github.com/xusenlinzy
api-for-open-llmhttps://github.com/xusenlinzy/api-for-open-llm
Codehttps://github.com/xusenlinzy/api-for-open-llm
Issues21 (21)https://github.com/xusenlinzy/api-for-open-llm/issues
Pull requests2 (2)https://github.com/xusenlinzy/api-for-open-llm/pulls
Actionshttps://github.com/xusenlinzy/api-for-open-llm/actions
Projectshttps://github.com/xusenlinzy/api-for-open-llm/projects
Security and qualityhttps://github.com/xusenlinzy/api-for-open-llm/security
Insightshttps://github.com/xusenlinzy/api-for-open-llm/pulse
https://github.com/xusenlinzy/api-for-open-llm
api-for-open-llmhttps://github.com/xusenlinzy/api-for-open-llm
Notificationshttps://github.com/login?return_to=%2Fxusenlinzy%2Fapi-for-open-llm
Fork267 (267)https://github.com/login?return_to=%2Fxusenlinzy%2Fapi-for-open-llm
Star2.5k (2.5k)https://github.com/login?return_to=%2Fxusenlinzy%2Fapi-for-open-llm
baichuanhttps://github.com/topics/baichuan
chatglmhttps://github.com/topics/chatglm
code-llamahttps://github.com/topics/code-llama
dockerhttps://github.com/topics/docker
internlmhttps://github.com/topics/internlm
langchainhttps://github.com/topics/langchain
llamahttps://github.com/topics/llama
llama2https://github.com/topics/llama2
llmshttps://github.com/topics/llms
nlphttps://github.com/topics/nlp
openaihttps://github.com/topics/openai
qwenhttps://github.com/topics/qwen
sqlcoderhttps://github.com/topics/sqlcoder
xversehttps://github.com/topics/xverse
Readmehttps://github.com/xusenlinzy/api-for-open-llm#readme-ov-file
Apache-2.0 licensehttps://github.com/xusenlinzy/api-for-open-llm#Apache-2.0-1-ov-file
Activityhttps://github.com/xusenlinzy/api-for-open-llm/activity
267 forkshttps://github.com/xusenlinzy/api-for-open-llm/forks
Report repositoryhttps://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Fxusenlinzy%2Fapi-for-open-llm&report=xusenlinzy+%28user%29
Brancheshttps://github.com/xusenlinzy/api-for-open-llm/branches
Tagshttps://github.com/xusenlinzy/api-for-open-llm/tags
https://github.com/xusenlinzy/api-for-open-llm/branches
https://github.com/xusenlinzy/api-for-open-llm/tags
464 Commitshttps://github.com/xusenlinzy/api-for-open-llm/commits/master/
https://github.com/xusenlinzy/api-for-open-llm/commits/master/
.github/ISSUE_TEMPLATEhttps://github.com/xusenlinzy/api-for-open-llm/tree/master/.github/ISSUE_TEMPLATE
.github/ISSUE_TEMPLATEhttps://github.com/xusenlinzy/api-for-open-llm/tree/master/.github/ISSUE_TEMPLATE
apihttps://github.com/xusenlinzy/api-for-open-llm/tree/master/api
apihttps://github.com/xusenlinzy/api-for-open-llm/tree/master/api
assetshttps://github.com/xusenlinzy/api-for-open-llm/tree/master/assets
assetshttps://github.com/xusenlinzy/api-for-open-llm/tree/master/assets
dockerhttps://github.com/xusenlinzy/api-for-open-llm/tree/master/docker
dockerhttps://github.com/xusenlinzy/api-for-open-llm/tree/master/docker
docshttps://github.com/xusenlinzy/api-for-open-llm/tree/master/docs
docshttps://github.com/xusenlinzy/api-for-open-llm/tree/master/docs
exampleshttps://github.com/xusenlinzy/api-for-open-llm/tree/master/examples
exampleshttps://github.com/xusenlinzy/api-for-open-llm/tree/master/examples
libs/langchain_llmhttps://github.com/xusenlinzy/api-for-open-llm/tree/master/libs/langchain_llm
libs/langchain_llmhttps://github.com/xusenlinzy/api-for-open-llm/tree/master/libs/langchain_llm
streamlit-demohttps://github.com/xusenlinzy/api-for-open-llm/tree/master/streamlit-demo
streamlit-demohttps://github.com/xusenlinzy/api-for-open-llm/tree/master/streamlit-demo
testshttps://github.com/xusenlinzy/api-for-open-llm/tree/master/tests
testshttps://github.com/xusenlinzy/api-for-open-llm/tree/master/tests
.env.examplehttps://github.com/xusenlinzy/api-for-open-llm/blob/master/.env.example
.env.examplehttps://github.com/xusenlinzy/api-for-open-llm/blob/master/.env.example
.env.vllm.examplehttps://github.com/xusenlinzy/api-for-open-llm/blob/master/.env.vllm.example
.env.vllm.examplehttps://github.com/xusenlinzy/api-for-open-llm/blob/master/.env.vllm.example
LICENSEhttps://github.com/xusenlinzy/api-for-open-llm/blob/master/LICENSE
LICENSEhttps://github.com/xusenlinzy/api-for-open-llm/blob/master/LICENSE
README.mdhttps://github.com/xusenlinzy/api-for-open-llm/blob/master/README.md
README.mdhttps://github.com/xusenlinzy/api-for-open-llm/blob/master/README.md
docker-compose.vllm.ymlhttps://github.com/xusenlinzy/api-for-open-llm/blob/master/docker-compose.vllm.yml
docker-compose.vllm.ymlhttps://github.com/xusenlinzy/api-for-open-llm/blob/master/docker-compose.vllm.yml
docker-compose.ymlhttps://github.com/xusenlinzy/api-for-open-llm/blob/master/docker-compose.yml
docker-compose.ymlhttps://github.com/xusenlinzy/api-for-open-llm/blob/master/docker-compose.yml
requirements.txthttps://github.com/xusenlinzy/api-for-open-llm/blob/master/requirements.txt
requirements.txthttps://github.com/xusenlinzy/api-for-open-llm/blob/master/requirements.txt
READMEhttps://github.com/xusenlinzy/api-for-open-llm
Apache-2.0 licensehttps://github.com/xusenlinzy/api-for-open-llm
https://github.com/xusenlinzy/api-for-open-llm#api-for-open-llms
https://github.com/xusenlinzy/api-for-open-llm
https://github.com/xusenlinzy/api-for-open-llm/blob/master
https://github.com/xusenlinzy/api-for-open-llm/blob/master
https://github.com/xusenlinzy/api-for-open-llm
https://github.com/xusenlinzy/api-for-open-llm
https://github.com/xusenlinzy/api-for-open-llm
https://github.com/xusenlinzy/api-for-open-llm
https://github.com/xusenlinzy/api-for-open-llm/blob/master/assets/images/llm.png
https://arxiv.org/pdf/2303.18223.pdfhttps://arxiv.org/pdf/2303.18223.pdf
https://github.com/xusenlinzy/api-for-open-llm#-新闻
glm4vhttps://github.com/xusenlinzy/api-for-open-llm/blob/master/tests/glm4v.py
sql问答demohttps://github.com/xusenlinzy/api-for-open-llm/tree/master/streamlit-demo/streamlit_gallery/components/sql_chat
使用方式https://github.com/xusenlinzy/api-for-open-llm/blob/master/docs/RAG.md
此处https://github.com/xusenlinzy/api-for-open-llm/blob/master/docs/NEWS.md
langchain https://github.com/hwchase17/langchain
vLLMhttps://github.com/vllm-project/vllm
https://github.com/xusenlinzy/api-for-open-llm#内容导引
💁🏻‍♂支持模型https://github.com/xusenlinzy/api-for-open-llm#-%E6%94%AF%E6%8C%81%E6%A8%A1%E5%9E%8B
🚄启动方式https://github.com/xusenlinzy/api-for-open-llm/blob/master/docs/SCRIPT.md
⚡vLLM启动方式https://github.com/xusenlinzy/api-for-open-llm/blob/master/docs/VLLM_SCRIPT.md
💻调用方式https://github.com/xusenlinzy/api-for-open-llm#-%E4%BD%BF%E7%94%A8%E6%96%B9%E5%BC%8F
❓常见问题https://github.com/xusenlinzy/api-for-open-llm/blob/master/docs/FAQ.md
https://github.com/xusenlinzy/api-for-open-llm#-支持模型
Baichuanhttps://huggingface.co/baichuan-inc
ChatGLMhttps://huggingface.co/THUDM
DeepSeekhttps://huggingface.co/deepseek-ai
InternLMhttps://huggingface.co/internlm
LLaMAhttps://github.com/facebookresearch/llama
LLaMA-2https://huggingface.co/meta-llama
LLaMA-3https://huggingface.co/meta-llama
Qwenhttps://huggingface.co/Qwen
Qwen1.5https://huggingface.co/Qwen
Qwen2https://huggingface.co/Qwen
Yi (1/1.5)https://huggingface.co/01-ai
vLLM启动方式https://github.com/xusenlinzy/api-for-open-llm/blob/master/docs/VLLM_SCRIPT.md
transformers启动方式https://github.com/xusenlinzy/api-for-open-llm/blob/master/docs/SCRIPT.md
bge-large-zhhttps://huggingface.co/BAAI/bge-large-zh
moka-ai/m3e-largehttps://huggingface.co/moka-ai/m3e-large
text2vec-large-chinesehttps://huggingface.co/GanymedeNil/text2vec-large-chinese
bce-embedding-base_v1https://huggingface.co/maidalun1020/bce-embedding-base_v1
https://github.com/xusenlinzy/api-for-open-llm#-使用方式
https://github.com/xusenlinzy/api-for-open-llm#环境变量
http://192.168.0.xx:80/v1http://192.168.0.xx:80/v1
聊天界面https://github.com/xusenlinzy/api-for-open-llm/blob/master/applications
https://github.com/xusenlinzy/api-for-open-llm#聊天界面
https://github.com/xusenlinzy/api-for-open-llm/blob/master/assets/images/demo.png
openai v1.1.0https://github.com/openai/openai-python
https://github.com/xusenlinzy/api-for-open-llm#openai-v110
https://github.com/xusenlinzy/api-for-open-llm#可接入的项目
ChatGPT-Next-Web: One-Click to deploy well-designed ChatGPT web UI on Vercelhttps://github.com/Yidadaa/ChatGPT-Next-Web
https://github.com/xusenlinzy/api-for-open-llm/blob/master/assets/images/web.png
dify: An easy-to-use LLMOps platform designed to empower more people to create sustainable, AI-native applicationshttps://github.com/langgenius/dify
https://github.com/xusenlinzy/api-for-open-llm/blob/master/assets/images/dify.png
https://github.com/xusenlinzy/api-for-open-llm#-license
LICENSEhttps://github.com/xusenlinzy/api-for-open-llm/blob/master/LICENSE
https://github.com/xusenlinzy/api-for-open-llm#-references
ChatGLM: An Open Bilingual Dialogue Language Modelhttps://github.com/THUDM/ChatGLM-6B
BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelhttps://arxiv.org/abs/2211.05100
LLaMA: Open and Efficient Foundation Language Modelshttps://arxiv.org/abs/2302.13971v1
Efficient and Effective Text Encoding for Chinese LLaMA and Alpacahttps://github.com/ymcui/Chinese-LLaMA-Alpaca
Phoenix: Democratizing ChatGPT across Languageshttps://github.com/FreedomIntelligence/LLMZoo
MOSS: An open-sourced plugin-augmented conversational language modelhttps://github.com/OpenLMLab/MOSS
FastChat: An open platform for training, serving, and evaluating large language model based chatbotshttps://github.com/lm-sys/FastChat
LangChain: Building applications with LLMs through composabilityhttps://github.com/hwchase17/langchain
ChuanhuChatgpthttps://github.com/GaiZhenbiao/ChuanhuChatGPT
https://github.com/xusenlinzy/api-for-open-llm#star-history
https://star-history.com/#xusenlinzy/api-for-open-llm&Date
baichuanhttps://github.com/topics/baichuan
chatglmhttps://github.com/topics/chatglm
code-llamahttps://github.com/topics/code-llama
dockerhttps://github.com/topics/docker
internlmhttps://github.com/topics/internlm
langchainhttps://github.com/topics/langchain
llamahttps://github.com/topics/llama
llama2https://github.com/topics/llama2
llmshttps://github.com/topics/llms
nlphttps://github.com/topics/nlp
openaihttps://github.com/topics/openai
qwenhttps://github.com/topics/qwen
sqlcoderhttps://github.com/topics/sqlcoder
xversehttps://github.com/topics/xverse
Readmehttps://github.com/xusenlinzy/api-for-open-llm#readme-ov-file
Apache-2.0 licensehttps://github.com/xusenlinzy/api-for-open-llm#Apache-2.0-1-ov-file
Activityhttps://github.com/xusenlinzy/api-for-open-llm/activity
267 forkshttps://github.com/xusenlinzy/api-for-open-llm/forks
Report repositoryhttps://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Fxusenlinzy%2Fapi-for-open-llm&report=xusenlinzy+%28user%29
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.