René's URL Explorer Experiment


Title: GitHub - KingSpring/ColossalAI: Making large AI models cheaper, faster and more accessible · GitHub

Open Graph Title: GitHub - KingSpring/ColossalAI: Making large AI models cheaper, faster and more accessible

X Title: GitHub - KingSpring/ColossalAI: Making large AI models cheaper, faster and more accessible

Description: Making large AI models cheaper, faster and more accessible - KingSpring/ColossalAI

Open Graph Description: Making large AI models cheaper, faster and more accessible - KingSpring/ColossalAI

X Description: Making large AI models cheaper, faster and more accessible - KingSpring/ColossalAI

Mail addresses
contact@hpcaitech.com

Opengraph URL: https://github.com/KingSpring/ColossalAI

X: @github

direct link

Domain: github.com

route-pattern/:user_id/:repository
route-controllerfiles
route-actiondisambiguate
fetch-noncev2:2e6288ee-fea9-2d7a-d93f-834b7308e258
current-catalog-service-hashf3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-id9C84:3EE1E4:5CBFCB:77F6B6:6A5FF936
html-safe-nonce273eba9744fd91bfd22a2ce928025b9a9319a655865c007bfa6c029930b8f717
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI5Qzg0OjNFRTFFNDo1Q0JGQ0I6NzdGNkI2OjZBNUZGOTM2IiwidmlzaXRvcl9pZCI6IjU1MDU2MTg3MTYyNDI0NzUzMTgiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmacf4148725a5e670d3e181f435e601a75479f8d7694ed8cdaa355425c5ed411423
hovercard-subject-tagrepository:620666664
github-keyboard-shortcutsrepository,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location//
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/KingSpring/ColossalAI
twitter:imagehttps://opengraph.githubassets.com/17ffd7dcaee699d859266951bc28bb11bd7e88450bc532059514405e88a970c4/KingSpring/ColossalAI
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/17ffd7dcaee699d859266951bc28bb11bd7e88450bc532059514405e88a970c4/KingSpring/ColossalAI
og:image:altMaking large AI models cheaper, faster and more accessible - KingSpring/ColossalAI
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None79522f2cee5c5409f33a714312a1a68d41ad77a807626020d980fb1eb81def07
turbo-cache-controlno-cache
go-importgithub.com/KingSpring/ColossalAI git https://github.com/KingSpring/ColossalAI.git
octolytics-dimension-user_id20452924
octolytics-dimension-user_loginKingSpring
octolytics-dimension-repository_id620666664
octolytics-dimension-repository_nwoKingSpring/ColossalAI
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forktrue
octolytics-dimension-repository_parent_id422274596
octolytics-dimension-repository_parent_nwohpcaitech/ColossalAI
octolytics-dimension-repository_network_root_id422274596
octolytics-dimension-repository_network_root_nwohpcaitech/ColossalAI
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release3df4fbea9b6b5ead5c6724a99dc5f5b62caa864b
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/KingSpring/ColossalAI#start-of-content
https://github.com/
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FKingSpring%2FColossalAI
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub Copilot appDirect agents from issue to mergehttps://github.com/features/ai/github-app
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
Code QualityEnforce quality at mergehttps://github.com/features/code-quality
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
View all resourceshttps://github.com/resources
GitHub SponsorsFund open source developershttps://github.com/open-source/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/open-source/accelerator
GitHub Starshttps://stars.github.com
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FKingSpring%2FColossalAI
Sign up https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=KingSpring%2FColossalAI
Reloadhttps://github.com/KingSpring/ColossalAI
Reloadhttps://github.com/KingSpring/ColossalAI
Reloadhttps://github.com/KingSpring/ColossalAI
KingSpring https://github.com/KingSpring
ColossalAIhttps://github.com/KingSpring/ColossalAI
hpcaitech/ColossalAIhttps://github.com/hpcaitech/ColossalAI
Notifications https://github.com/login?return_to=%2FKingSpring%2FColossalAI
Fork 0 https://github.com/login?return_to=%2FKingSpring%2FColossalAI
Star 1 https://github.com/login?return_to=%2FKingSpring%2FColossalAI
Code https://github.com/KingSpring/ColossalAI
Pull requests 0 https://github.com/KingSpring/ColossalAI/pulls
Actions https://github.com/KingSpring/ColossalAI/actions
Projects https://github.com/KingSpring/ColossalAI/projects
Security and quality 0 https://github.com/KingSpring/ColossalAI/security
Insights https://github.com/KingSpring/ColossalAI/pulse
Code https://github.com/KingSpring/ColossalAI
Pull requests https://github.com/KingSpring/ColossalAI/pulls
Actions https://github.com/KingSpring/ColossalAI/actions
Projects https://github.com/KingSpring/ColossalAI/projects
Security and quality https://github.com/KingSpring/ColossalAI/security
Insights https://github.com/KingSpring/ColossalAI/pulse
https://github.com/KingSpring/ColossalAI
Brancheshttps://github.com/KingSpring/ColossalAI/branches
Tagshttps://github.com/KingSpring/ColossalAI/tags
https://github.com/KingSpring/ColossalAI/branches
https://github.com/KingSpring/ColossalAI/tags
2,184 Commitshttps://github.com/KingSpring/ColossalAI/commits/main/
https://github.com/KingSpring/ColossalAI/commits/main/
.githubhttps://github.com/KingSpring/ColossalAI/tree/main/.github
.githubhttps://github.com/KingSpring/ColossalAI/tree/main/.github
applicationshttps://github.com/KingSpring/ColossalAI/tree/main/applications
applicationshttps://github.com/KingSpring/ColossalAI/tree/main/applications
colossalaihttps://github.com/KingSpring/ColossalAI/tree/main/colossalai
colossalaihttps://github.com/KingSpring/ColossalAI/tree/main/colossalai
dockerhttps://github.com/KingSpring/ColossalAI/tree/main/docker
dockerhttps://github.com/KingSpring/ColossalAI/tree/main/docker
docshttps://github.com/KingSpring/ColossalAI/tree/main/docs
docshttps://github.com/KingSpring/ColossalAI/tree/main/docs
exampleshttps://github.com/KingSpring/ColossalAI/tree/main/examples
exampleshttps://github.com/KingSpring/ColossalAI/tree/main/examples
inference @ 56b35f3https://github.com/hpcaitech/EnergonAI/tree/56b35f3c06eaac11b1bee633d1e836563f74bcea
inference @ 56b35f3https://github.com/hpcaitech/EnergonAI/tree/56b35f3c06eaac11b1bee633d1e836563f74bcea
op_builderhttps://github.com/KingSpring/ColossalAI/tree/main/op_builder
op_builderhttps://github.com/KingSpring/ColossalAI/tree/main/op_builder
requirementshttps://github.com/KingSpring/ColossalAI/tree/main/requirements
requirementshttps://github.com/KingSpring/ColossalAI/tree/main/requirements
testshttps://github.com/KingSpring/ColossalAI/tree/main/tests
testshttps://github.com/KingSpring/ColossalAI/tree/main/tests
.clang-formathttps://github.com/KingSpring/ColossalAI/blob/main/.clang-format
.clang-formathttps://github.com/KingSpring/ColossalAI/blob/main/.clang-format
.compatibilityhttps://github.com/KingSpring/ColossalAI/blob/main/.compatibility
.compatibilityhttps://github.com/KingSpring/ColossalAI/blob/main/.compatibility
.cuda_ext.jsonhttps://github.com/KingSpring/ColossalAI/blob/main/.cuda_ext.json
.cuda_ext.jsonhttps://github.com/KingSpring/ColossalAI/blob/main/.cuda_ext.json
.flake8https://github.com/KingSpring/ColossalAI/blob/main/.flake8
.flake8https://github.com/KingSpring/ColossalAI/blob/main/.flake8
.gitignorehttps://github.com/KingSpring/ColossalAI/blob/main/.gitignore
.gitignorehttps://github.com/KingSpring/ColossalAI/blob/main/.gitignore
.gitmoduleshttps://github.com/KingSpring/ColossalAI/blob/main/.gitmodules
.gitmoduleshttps://github.com/KingSpring/ColossalAI/blob/main/.gitmodules
.isort.cfghttps://github.com/KingSpring/ColossalAI/blob/main/.isort.cfg
.isort.cfghttps://github.com/KingSpring/ColossalAI/blob/main/.isort.cfg
.pre-commit-config.yamlhttps://github.com/KingSpring/ColossalAI/blob/main/.pre-commit-config.yaml
.pre-commit-config.yamlhttps://github.com/KingSpring/ColossalAI/blob/main/.pre-commit-config.yaml
.style.yapfhttps://github.com/KingSpring/ColossalAI/blob/main/.style.yapf
.style.yapfhttps://github.com/KingSpring/ColossalAI/blob/main/.style.yapf
CHANGE_LOG.mdhttps://github.com/KingSpring/ColossalAI/blob/main/CHANGE_LOG.md
CHANGE_LOG.mdhttps://github.com/KingSpring/ColossalAI/blob/main/CHANGE_LOG.md
CONTRIBUTING.mdhttps://github.com/KingSpring/ColossalAI/blob/main/CONTRIBUTING.md
CONTRIBUTING.mdhttps://github.com/KingSpring/ColossalAI/blob/main/CONTRIBUTING.md
LICENSEhttps://github.com/KingSpring/ColossalAI/blob/main/LICENSE
LICENSEhttps://github.com/KingSpring/ColossalAI/blob/main/LICENSE
MANIFEST.inhttps://github.com/KingSpring/ColossalAI/blob/main/MANIFEST.in
MANIFEST.inhttps://github.com/KingSpring/ColossalAI/blob/main/MANIFEST.in
README.mdhttps://github.com/KingSpring/ColossalAI/blob/main/README.md
README.mdhttps://github.com/KingSpring/ColossalAI/blob/main/README.md
pytest.inihttps://github.com/KingSpring/ColossalAI/blob/main/pytest.ini
pytest.inihttps://github.com/KingSpring/ColossalAI/blob/main/pytest.ini
setup.pyhttps://github.com/KingSpring/ColossalAI/blob/main/setup.py
setup.pyhttps://github.com/KingSpring/ColossalAI/blob/main/setup.py
version.txthttps://github.com/KingSpring/ColossalAI/blob/main/version.txt
version.txthttps://github.com/KingSpring/ColossalAI/blob/main/version.txt
READMEhttps://github.com/KingSpring/ColossalAI
Contributinghttps://github.com/KingSpring/ColossalAI
Licensehttps://github.com/KingSpring/ColossalAI
https://github.com/KingSpring/ColossalAI#colossal-ai
https://www.colossalai.org/
Paper https://arxiv.org/abs/2110.14883
Documentation https://www.colossalai.org/
Examples https://github.com/hpcaitech/ColossalAI/tree/main/examples
Forum https://github.com/hpcaitech/ColossalAI/discussions
Blog https://medium.com/@hpcaitech
https://github.com/KingSpring/ColossalAI#--paper------documentation------examples------forum------blog-
https://github.com/hpcaitech/ColossalAI/stargazers
https://github.com/hpcaitech/ColossalAI/actions/workflows/build_on_schedule.yml
https://colossalai.readthedocs.io/en/latest/?badge=latest
https://www.codefactor.io/repository/github/hpcaitech/colossalai
https://huggingface.co/hpcai-tech
https://join.slack.com/t/colossalaiworkspace/shared_invite/zt-z7b26eeb-CBp7jouvu~r0~lcFzX832w
https://raw.githubusercontent.com/hpcaitech/public_assets/main/colossalai/img/WeChat.png
Englishhttps://github.com/KingSpring/ColossalAI/blob/main/README.md
中文https://github.com/KingSpring/ColossalAI/blob/main/docs/README-zh-Hans.md
https://github.com/KingSpring/ColossalAI#latest-news
ColossalChat: An Open-Source Solution for Cloning ChatGPT With a Complete RLHF Pipelinehttps://medium.com/@yangyou_berkeley/colossalchat-an-open-source-solution-for-cloning-chatgpt-with-a-complete-rlhf-pipeline-5edf08fb538b
AWS and Google Fund Colossal-AI with Startup Cloud Programshttps://www.hpc-ai.tech/blog/aws-and-google-fund-colossal-ai-with-startup-cloud-programs
Open Source Solution Replicates ChatGPT Training Process! Ready to go with only 1.6GB GPU Memoryhttps://www.hpc-ai.tech/blog/colossal-ai-chatgpt
Hardware Savings Up to 46 Times for AIGC and Automatic Parallelismhttps://medium.com/pytorch/latest-colossal-ai-boasts-novel-automatic-parallelism-and-offers-savings-up-to-46x-for-stable-1453b48f3f02
Diffusion Pretraining and Hardware Fine-Tuning Can Be Almost 7X Cheaperhttps://www.hpc-ai.tech/blog/diffusion-pretraining-and-hardware-fine-tuning-can-be-almost-7x-cheaper
Use a Laptop to Analyze 90% of Proteins, With a Single-GPU Inference Sequence Exceeding 10,000https://www.hpc-ai.tech/blog/use-a-laptop-to-analyze-90-of-proteins-with-a-single-gpu-inference-sequence-exceeding
HPC-AI Tech Completes $6 Million Seed and Angel Round Fundraisinghttps://www.hpc-ai.tech/blog/hpc-ai-tech-completes-6-million-seed-and-angel-round-fundraising-led-by-bluerun-ventures-in-the
https://github.com/KingSpring/ColossalAI#table-of-contents
Why Colossal-AIhttps://github.com/KingSpring/ColossalAI#Why-Colossal-AI
Featureshttps://github.com/KingSpring/ColossalAI#Features
Parallel Training Demohttps://github.com/KingSpring/ColossalAI#Parallel-Training-Demo
GPT-3https://github.com/KingSpring/ColossalAI#GPT-3
GPT-2https://github.com/KingSpring/ColossalAI#GPT-2
BERThttps://github.com/KingSpring/ColossalAI#BERT
PaLMhttps://github.com/KingSpring/ColossalAI#PaLM
OPThttps://github.com/KingSpring/ColossalAI#OPT
ViThttps://github.com/KingSpring/ColossalAI#ViT
Recommendation System Modelshttps://github.com/KingSpring/ColossalAI#Recommendation-System-Models
Single GPU Training Demohttps://github.com/KingSpring/ColossalAI#Single-GPU-Training-Demo
GPT-2https://github.com/KingSpring/ColossalAI#GPT-2-Single
PaLMhttps://github.com/KingSpring/ColossalAI#PaLM-Single
Inference (Energon-AI) Demohttps://github.com/KingSpring/ColossalAI#Inference-Energon-AI-Demo
GPT-3https://github.com/KingSpring/ColossalAI#GPT-3-Inference
OPT-175B Online Serving for Text Generationhttps://github.com/KingSpring/ColossalAI#OPT-Serving
176B BLOOMhttps://github.com/KingSpring/ColossalAI#BLOOM-Inference
Colossal-AI for Real World Applicationshttps://github.com/KingSpring/ColossalAI#Colossal-AI-in-the-Real-World
ColossalChat: An Open-Source Solution for Cloning ChatGPT With a Complete RLHF Pipelinehttps://github.com/KingSpring/ColossalAI#ColossalChat
AIGC: Acceleration of Stable Diffusionhttps://github.com/KingSpring/ColossalAI#AIGC
Biomedicine: Acceleration of AlphaFold Protein Structurehttps://github.com/KingSpring/ColossalAI#Biomedicine
Installationhttps://github.com/KingSpring/ColossalAI#Installation
PyPIhttps://github.com/KingSpring/ColossalAI#PyPI
Install From Sourcehttps://github.com/KingSpring/ColossalAI#Install-From-Source
Use Dockerhttps://github.com/KingSpring/ColossalAI#Use-Docker
Communityhttps://github.com/KingSpring/ColossalAI#Community
Contributinghttps://github.com/KingSpring/ColossalAI#Contributing
Cite Ushttps://github.com/KingSpring/ColossalAI#Cite-Us
https://github.com/KingSpring/ColossalAI#why-colossal-ai
https://youtu.be/KnXSfjqkKN0
back to tophttps://github.com/KingSpring/ColossalAI#top
https://github.com/KingSpring/ColossalAI#features
2Dhttps://arxiv.org/abs/2104.05343
2.5Dhttps://arxiv.org/abs/2105.14500
3Dhttps://arxiv.org/abs/2105.14450
Sequence Parallelismhttps://arxiv.org/abs/2105.13120
Zero Redundancy Optimizer (ZeRO)https://arxiv.org/abs/1910.02054
Auto-Parallelismhttps://arxiv.org/abs/2302.02599
PatrickStarhttps://arxiv.org/abs/2108.05818
Energon-AIhttps://github.com/hpcaitech/EnergonAI
back to tophttps://github.com/KingSpring/ColossalAI#top
https://github.com/KingSpring/ColossalAI#parallel-training-demo
https://github.com/KingSpring/ColossalAI#gpt-3
https://raw.githubusercontent.com/hpcaitech/public_assets/main/colossalai/img/GPT3-v5.png
https://github.com/KingSpring/ColossalAI#gpt-2
https://raw.githubusercontent.com/hpcaitech/public_assets/main/colossalai/img/GPT2.png
https://raw.githubusercontent.com/hpcaitech/public_assets/main/colossalai/img/(updated)GPT-2.png
https://github.com/KingSpring/ColossalAI#bert
https://raw.githubusercontent.com/hpcaitech/public_assets/main/colossalai/img/BERT.png
https://github.com/KingSpring/ColossalAI#palm
PaLM-colossalaihttps://github.com/hpcaitech/PaLM-colossalai
PaLMhttps://ai.googleblog.com/2022/04/pathways-language-model-palm-scaling-to.html
https://github.com/KingSpring/ColossalAI#opt
https://raw.githubusercontent.com/hpcaitech/public_assets/main/colossalai/img/OPT_update.png
Open Pretrained Transformer (OPT)https://github.com/facebookresearch/metaseq
[Example]https://github.com/hpcaitech/ColossalAI/tree/main/examples/language/opt
[Online Serving]https://colossalai.org/docs/advanced_tutorials/opt_service
documentationhttps://www.colossalai.org/
exampleshttps://github.com/hpcaitech/ColossalAI/tree/main/examples
https://github.com/KingSpring/ColossalAI#vit
https://raw.githubusercontent.com/hpcaitech/public_assets/main/colossalai/img/ViT.png
https://github.com/KingSpring/ColossalAI#recommendation-system-models
Cached Embeddinghttps://github.com/hpcaitech/CachedEmbedding
back to tophttps://github.com/KingSpring/ColossalAI#top
https://github.com/KingSpring/ColossalAI#single-gpu-training-demo
https://github.com/KingSpring/ColossalAI#gpt-2-1
https://raw.githubusercontent.com/hpcaitech/public_assets/main/colossalai/img/GPT2-GPU1.png
https://raw.githubusercontent.com/hpcaitech/public_assets/main/colossalai/img/GPT2-NVME.png
https://github.com/KingSpring/ColossalAI#palm-1
https://raw.githubusercontent.com/hpcaitech/public_assets/main/colossalai/img/PaLM-GPU1.png
back to tophttps://github.com/KingSpring/ColossalAI#top
https://github.com/KingSpring/ColossalAI#inference-energon-ai-demo
https://raw.githubusercontent.com/hpcaitech/public_assets/main/colossalai/img/inference_GPT-3.jpg
Energon-AIhttps://github.com/hpcaitech/EnergonAI
https://raw.githubusercontent.com/hpcaitech/public_assets/main/colossalai/img/BLOOM%20serving.png
OPT Servinghttps://colossalai.org/docs/advanced_tutorials/opt_service
https://raw.githubusercontent.com/hpcaitech/public_assets/main/colossalai/img/BLOOM%20Inference.PNG
BLOOMhttps://github.com/hpcaitech/EnergonAI/tree/main/examples/bloom
back to tophttps://github.com/KingSpring/ColossalAI#top
https://github.com/KingSpring/ColossalAI#colossal-ai-in-the-real-world
https://github.com/KingSpring/ColossalAI#colossalchat
https://chat.colossalai.org/
ColossalChathttps://github.com/hpcaitech/ColossalAI/tree/main/applications/Chat
ChatGPThttps://openai.com/blog/chatgpt/
[code]https://github.com/hpcaitech/ColossalAI/tree/main/applications/Chat
[blog]https://medium.com/@yangyou_berkeley/colossalchat-an-open-source-solution-for-cloning-chatgpt-with-a-complete-rlhf-pipeline-5edf08fb538b
[demo]https://chat.colossalai.org
https://raw.githubusercontent.com/hpcaitech/public_assets/main/applications/chatgpt/ChatGPT%20scaling.png
https://raw.githubusercontent.com/hpcaitech/public_assets/main/applications/chatgpt/ChatGPT-1GPU.jpg
https://raw.githubusercontent.com/hpcaitech/public_assets/main/applications/chatgpt/LoRA%20data.jpg
back to tophttps://github.com/KingSpring/ColossalAI#top
https://github.com/KingSpring/ColossalAI#aigc
Stable Diffusion v1https://github.com/CompVis/stable-diffusion
Stable Diffusion v2https://github.com/Stability-AI/stablediffusion
https://raw.githubusercontent.com/hpcaitech/public_assets/main/colossalai/img/Stable%20Diffusion%20v2.png
Traininghttps://github.com/hpcaitech/ColossalAI/tree/main/examples/images/diffusion
https://raw.githubusercontent.com/hpcaitech/public_assets/main/colossalai/img/DreamBooth.png
DreamBooth Fine-tuninghttps://github.com/hpcaitech/ColossalAI/tree/main/examples/images/dreambooth
https://raw.githubusercontent.com/hpcaitech/public_assets/main/colossalai/img/Stable%20Diffusion%20Inference.jpg
Inferencehttps://github.com/hpcaitech/ColossalAI/tree/main/examples/images/diffusion
back to tophttps://github.com/KingSpring/ColossalAI#top
https://github.com/KingSpring/ColossalAI#biomedicine
AlphaFold Protein Structurehttps://alphafold.ebi.ac.uk/
https://raw.githubusercontent.com/hpcaitech/public_assets/main/colossalai/img/FastFold.jpg
FastFoldhttps://github.com/hpcaitech/FastFold
https://raw.githubusercontent.com/hpcaitech/public_assets/main/colossalai/img/data%20preprocessing%20with%20Intel.jpg
FastFold with Intelhttps://github.com/hpcaitech/FastFold
https://raw.githubusercontent.com/hpcaitech/public_assets/main/colossalai/img/xTrimoMultimer_Table.jpg
xTrimoMultimerhttps://github.com/biomap-research/xTrimoMultimer
back to tophttps://github.com/KingSpring/ColossalAI#top
https://github.com/KingSpring/ColossalAI#installation
issuehttps://github.com/hpcaitech/ColossalAI/issues/new/choose
https://github.com/KingSpring/ColossalAI#install-from-pypi
https://github.com/KingSpring/ColossalAI#download-from-source
back to tophttps://github.com/KingSpring/ColossalAI#top
https://github.com/KingSpring/ColossalAI#use-docker
https://github.com/KingSpring/ColossalAI#pull-from-dockerhub
DockerHub pagehttps://hub.docker.com/r/hpcaitech/colossalai
https://github.com/KingSpring/ColossalAI#build-on-your-own
herehttps://stackoverflow.com/questions/59691207/docker-build-with-nvidia-runtime
project pagehttps://www.colossalai.org
back to tophttps://github.com/KingSpring/ColossalAI#top
https://github.com/KingSpring/ColossalAI#community
Forumhttps://github.com/hpcaitech/ColossalAI/discussions
Slackhttps://join.slack.com/t/colossalaiworkspace/shared_invite/zt-z7b26eeb-CBp7jouvu~r0~lcFzX832w
WeChat(微信)https://raw.githubusercontent.com/hpcaitech/public_assets/main/colossalai/img/WeChat.png
https://github.com/KingSpring/ColossalAI#contributing
BLOOMhttps://bigscience.huggingface.co/
Stable Diffusionhttps://en.wikipedia.org/wiki/Stable_Diffusion
Leaving a Star ⭐https://github.com/hpcaitech/ColossalAI/stargazers
issuehttps://github.com/hpcaitech/ColossalAI/issues/new/choose
Contributinghttps://github.com/hpcaitech/ColossalAI/blob/main/CONTRIBUTING.md
https://github.com/hpcaitech/ColossalAI/graphs/contributors
back to tophttps://github.com/KingSpring/ColossalAI#top
https://github.com/KingSpring/ColossalAI#cicd
GitHub Actionshttps://github.com/features/actions
documentationhttps://github.com/KingSpring/ColossalAI/blob/main/.github/workflows/README.md
https://github.com/KingSpring/ColossalAI#cite-us
Reference Listhttps://github.com/KingSpring/ColossalAI/blob/main/docs/REFERENCE.md
SChttps://sc22.supercomputing.org/
AAAIhttps://aaai.org/Conferences/AAAI-23/
PPoPPhttps://ppopp23.sigplan.org/
CVPRhttps://cvpr2023.thecvf.com/
ISChttps://www.isc-hpc.com/
back to tophttps://github.com/KingSpring/ColossalAI#top
www.colossalai.orghttps://www.colossalai.org
Readme https://github.com/KingSpring/ColossalAI#readme-ov-file
Apache-2.0 license https://github.com/KingSpring/ColossalAI#Apache-2.0-1-ov-file
Please reload this pagehttps://github.com/KingSpring/ColossalAI
Activityhttps://github.com/KingSpring/ColossalAI/activity
0 forkshttps://github.com/KingSpring/ColossalAI/forks
Report repository https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2FKingSpring%2FColossalAI&report=KingSpring+%28user%29
Releaseshttps://github.com/KingSpring/ColossalAI/releases
Packages 0https://github.com/users/KingSpring/packages?repo_name=ColossalAI
Please reload this pagehttps://github.com/KingSpring/ColossalAI
Contributorshttps://github.com/KingSpring/ColossalAI/graphs/contributors
Please reload this pagehttps://github.com/KingSpring/ColossalAI
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.