| react-profiling | 0 |
| react-import-map | react,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322 |
| route-pattern | /:user_id/:repository |
| route-controller | files |
| route-action | disambiguate |
| fetch-nonce | v2:65e2f3f7-21e0-0b24-cd08-4fa0735a27cc |
| current-catalog-service-hash | f3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb |
| request-id | B10A:D500:265B099:32A36A4:6B037450 |
| html-safe-nonce | 613d21d1aa21da9848e8109ed1c4a8230f32ef5003158fee227a882a379962fa |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJCMTBBOkQ1MDA6MjY1QjA5OTozMkEzNkE0OjZCMDM3NDUwIiwidmlzaXRvcl9pZCI6IjIyODgyMDE1NzQ1NzQ2ODMyMTYiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ== |
| visitor-hmac | 1c701d41abdbc4a69f5256a06252d083efcf66775f90c7ff955b4cbcf20fd8c9 |
| hovercard-subject-tag | repository:901269528 |
| github-keyboard-shortcuts | repository,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | // |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/flamecodezz/llm-action |
| twitter:image | https://opengraph.githubassets.com/3d321a217289144fbf8d2f94c28228a684555fa1e13c78249317889806f672e3/flamecodezz/llm-action |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/3d321a217289144fbf8d2f94c28228a684555fa1e13c78249317889806f672e3/flamecodezz/llm-action |
| og:image:alt | 本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地). Contribute to flamecodezz/llm-action development by creating an account on GitHub. |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| hostname | github.com |
| expected-hostname | github.com |
| None | 87e774ee7c6b3bee0490394e4d3e57ec9dbc956f74b87ea685dc8996c1676456 |
| turbo-cache-control | no-cache |
| go-import | github.com/flamecodezz/llm-action git https://github.com/flamecodezz/llm-action.git |
| octolytics-dimension-user_id | 48575118 |
| octolytics-dimension-user_login | flamecodezz |
| octolytics-dimension-repository_id | 901269528 |
| octolytics-dimension-repository_nwo | flamecodezz/llm-action |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | true |
| octolytics-dimension-repository_parent_id | 644235905 |
| octolytics-dimension-repository_parent_nwo | liguodongiot/llm-action |
| octolytics-dimension-repository_network_root_id | 644235905 |
| octolytics-dimension-repository_network_root_nwo | liguodongiot/llm-action |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 423dbb54c5e7bfecc838eb387c1435eb3d0e760d |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
| Skip to content | https://github.com/flamecodezz/llm-action#start-of-content |
| https://github.com/ |
| Sign in | https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fflamecodezz%2Fllm-action |
| GitHubRepository hosting, code review, and collaboration | https://github.com/platform |
| CopilotAI coding agent for tasks, projects, and automated work | https://github.com/features/copilot |
| ActionsCI/CD and automation | https://github.com/features/actions |
| Code QualityQuality analysis, fixes, and enforcement | https://github.com/features/code-quality |
| CodespacesCloud development environments | https://github.com/features/codespaces |
| Code SecurityVulnerability detection and remediation | https://github.com/security/advanced-security/code-security |
| Secret ProtectionSecret scanning and leak prevention | https://github.com/security/advanced-security/secret-protection |
| All Features | https://github.com/features |
| Documentation | https://docs.github.com/en |
| Training | https://learn.github.com/skills |
| Certifications | https://learn.github.com/credentials |
| Build with Copilot | https://github.com/features/ai |
| Customize Copilot | https://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview |
| Integrations | https://github.com/marketplace |
| Trending repos | https://github.com/trending |
| GitHub Sponsors | https://github.com/open-source/sponsors |
| Developer articles | https://github.com/resources/articles |
| ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place. | https://github.blog/changelog/ |
| Enterprises | https://github.com/enterprise |
| Team | https://github.com/team |
| Startups | https://github.com/enterprise/startups |
| Nonprofits | https://github.com/solutions/industry/nonprofits |
| Healthcare | https://github.com/solutions/industry/healthcare |
| Financial services | https://github.com/solutions/industry/financial-services |
| Manufacturing | https://github.com/solutions/industry/manufacturing |
| Government | https://github.com/solutions/industry/government |
| See all industries | https://github.com/solutions/industry |
| Why GitHub | https://github.com/why-github |
| Customer Stories | https://github.com/customer-stories |
| Business insights | https://github.com/solutions/executive-insights |
| Trust Center | https://github.com/trust-center |
| GitHub Advanced SecurityEnterprise-grade code security | https://github.com/security/advanced-security |
| Copilot for businessEnterprise-grade AI features | https://github.com/features/copilot/copilot-business |
| Premium SupportEnterprise-grade 24/7 support | https://github.com/enterprise/premium-support |
| Documentation | https://docs.github.com/en |
| Resource center | https://github.com/resources |
| Blog | https://github.blog/ |
| Events & webinars | https://github.com/resources/events |
| Community Forum | https://github.com/orgs/community/discussions |
| Customer Stories | https://github.com/customer-stories |
| Integrations | https://github.com/marketplace |
| Customer support | https://help.github.com/ |
| Training | https://learn.github.com/skills |
| GitHub Status | https://www.githubstatus.com/ |
| About | https://github.com/about |
| Partners | https://github.com/partners |
| Changelog | https://github.blog/changelog/ |
| GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub. | https://githubuniverse.com/ |
| Pricing | https://github.com/pricing |
| Sign in | https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fflamecodezz%2Fllm-action |
| Sign up | https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=flamecodezz%2Fllm-action |
| Reload | https://github.com/flamecodezz/llm-action |
| Reload | https://github.com/flamecodezz/llm-action |
| Reload | https://github.com/flamecodezz/llm-action |
| flamecodezz | https://github.com/flamecodezz |
| llm-action | https://github.com/flamecodezz/llm-action |
| Code | https://github.com/flamecodezz/llm-action |
| Pull requests | https://github.com/flamecodezz/llm-action/pulls |
| Actions | https://github.com/flamecodezz/llm-action/actions |
| Projects | https://github.com/flamecodezz/llm-action/projects |
| Security and quality | https://github.com/flamecodezz/llm-action/security |
| Insights | https://github.com/flamecodezz/llm-action/pulse |
| https://github.com/flamecodezz/llm-action |
| llm-action | https://github.com/flamecodezz/llm-action |
| liguodongiot/llm-action | https://github.com/liguodongiot/llm-action |
| Notifications | https://github.com/login?return_to=%2Fflamecodezz%2Fllm-action |
| Fork0 (0) | https://github.com/login?return_to=%2Fflamecodezz%2Fllm-action |
| Star1 (1) | https://github.com/login?return_to=%2Fflamecodezz%2Fllm-action |
| www.zhihu.com/column/c_1456193767213043713 | https://www.zhihu.com/column/c_1456193767213043713 |
| Readme | https://github.com/flamecodezz/llm-action#readme-ov-file |
| License | https://github.com/flamecodezz/llm-action#License-1-ov-file |
| Activity | https://github.com/flamecodezz/llm-action/activity |
| 0 forks | https://github.com/flamecodezz/llm-action/forks |
| Report repository | https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Fflamecodezz%2Fllm-action&report=flamecodezz+%28user%29 |
| Branches | https://github.com/flamecodezz/llm-action/branches |
| Tags | https://github.com/flamecodezz/llm-action/tags |
| https://github.com/flamecodezz/llm-action/branches |
| https://github.com/flamecodezz/llm-action/tags |
| 899 Commits | https://github.com/flamecodezz/llm-action/commits/main/ |
| https://github.com/flamecodezz/llm-action/commits/main/ |
| ai-compiler | https://github.com/flamecodezz/llm-action/tree/main/ai-compiler |
| ai-compiler | https://github.com/flamecodezz/llm-action/tree/main/ai-compiler |
| ai-framework | https://github.com/flamecodezz/llm-action/tree/main/ai-framework |
| ai-framework | https://github.com/flamecodezz/llm-action/tree/main/ai-framework |
| ai-infra | https://github.com/flamecodezz/llm-action/tree/main/ai-infra |
| ai-infra | https://github.com/flamecodezz/llm-action/tree/main/ai-infra |
| blog | https://github.com/flamecodezz/llm-action/tree/main/blog |
| blog | https://github.com/flamecodezz/llm-action/tree/main/blog |
| docs | https://github.com/flamecodezz/llm-action/tree/main/docs |
| docs | https://github.com/flamecodezz/llm-action/tree/main/docs |
| faq | https://github.com/flamecodezz/llm-action/tree/main/faq |
| faq | https://github.com/flamecodezz/llm-action/tree/main/faq |
| llm-algo | https://github.com/flamecodezz/llm-action/tree/main/llm-algo |
| llm-algo | https://github.com/flamecodezz/llm-action/tree/main/llm-algo |
| llm-alignment | https://github.com/flamecodezz/llm-action/tree/main/llm-alignment |
| llm-alignment | https://github.com/flamecodezz/llm-action/tree/main/llm-alignment |
| llm-application | https://github.com/flamecodezz/llm-action/tree/main/llm-application |
| llm-application | https://github.com/flamecodezz/llm-action/tree/main/llm-application |
| llm-benchmark | https://github.com/flamecodezz/llm-action/tree/main/llm-benchmark |
| llm-benchmark | https://github.com/flamecodezz/llm-action/tree/main/llm-benchmark |
| llm-compression | https://github.com/flamecodezz/llm-action/tree/main/llm-compression |
| llm-compression | https://github.com/flamecodezz/llm-action/tree/main/llm-compression |
| llm-data-engineering | https://github.com/flamecodezz/llm-action/tree/main/llm-data-engineering |
| llm-data-engineering | https://github.com/flamecodezz/llm-action/tree/main/llm-data-engineering |
| llm-inference | https://github.com/flamecodezz/llm-action/tree/main/llm-inference |
| llm-inference | https://github.com/flamecodezz/llm-action/tree/main/llm-inference |
| llm-interview | https://github.com/flamecodezz/llm-action/tree/main/llm-interview |
| llm-interview | https://github.com/flamecodezz/llm-action/tree/main/llm-interview |
| llm-localization | https://github.com/flamecodezz/llm-action/tree/main/llm-localization |
| llm-localization | https://github.com/flamecodezz/llm-action/tree/main/llm-localization |
| llm-maas | https://github.com/flamecodezz/llm-action/tree/main/llm-maas |
| llm-maas | https://github.com/flamecodezz/llm-action/tree/main/llm-maas |
| llm-optimizer | https://github.com/flamecodezz/llm-action/tree/main/llm-optimizer |
| llm-optimizer | https://github.com/flamecodezz/llm-action/tree/main/llm-optimizer |
| llm-performance | https://github.com/flamecodezz/llm-action/tree/main/llm-performance |
| llm-performance | https://github.com/flamecodezz/llm-action/tree/main/llm-performance |
| llm-pipeline | https://github.com/flamecodezz/llm-action/tree/main/llm-pipeline |
| llm-pipeline | https://github.com/flamecodezz/llm-action/tree/main/llm-pipeline |
| llm-train | https://github.com/flamecodezz/llm-action/tree/main/llm-train |
| llm-train | https://github.com/flamecodezz/llm-action/tree/main/llm-train |
| llmops | https://github.com/flamecodezz/llm-action/tree/main/llmops |
| llmops | https://github.com/flamecodezz/llm-action/tree/main/llmops |
| paper | https://github.com/flamecodezz/llm-action/tree/main/paper |
| paper | https://github.com/flamecodezz/llm-action/tree/main/paper |
| pic | https://github.com/flamecodezz/llm-action/tree/main/pic |
| pic | https://github.com/flamecodezz/llm-action/tree/main/pic |
| .DS_Store | https://github.com/flamecodezz/llm-action/blob/main/.DS_Store |
| .DS_Store | https://github.com/flamecodezz/llm-action/blob/main/.DS_Store |
| .gitignore | https://github.com/flamecodezz/llm-action/blob/main/.gitignore |
| .gitignore | https://github.com/flamecodezz/llm-action/blob/main/.gitignore |
| LICENSE | https://github.com/flamecodezz/llm-action/blob/main/LICENSE |
| LICENSE | https://github.com/flamecodezz/llm-action/blob/main/LICENSE |
| README.md | https://github.com/flamecodezz/llm-action/blob/main/README.md |
| README.md | https://github.com/flamecodezz/llm-action/blob/main/README.md |
| git-pull-push.sh | https://github.com/flamecodezz/llm-action/blob/main/git-pull-push.sh |
| git-pull-push.sh | https://github.com/flamecodezz/llm-action/blob/main/git-pull-push.sh |
| mkdir-dir-file.sh | https://github.com/flamecodezz/llm-action/blob/main/mkdir-dir-file.sh |
| mkdir-dir-file.sh | https://github.com/flamecodezz/llm-action/blob/main/mkdir-dir-file.sh |
| README | https://github.com/flamecodezz/llm-action |
| License | https://github.com/flamecodezz/llm-action |
| https://github.com/liguodongiot/llm-action/blob/main/pic/llm-action-v3.png |
|
| https://github.com/liguodongiot/llm-action/stargazers |
| | https://github.com/liguodongiot/llm-action/blob/main/pic/wx.jpg |
| | https://www.zhihu.com/people/liguodong-iot |
| | https://juejin.cn/user/3642056016410728 |
| | https://liguodong.blog.csdn.net/ |
| unify-easy-llm | https://github.com/liguodongiot/unify-easy-llm |
| https://github.com/flamecodezz/llm-action#目录 |
| LLM训练 | https://github.com/flamecodezz/llm-action#llm%E8%AE%AD%E7%BB%83 |
| LLM训练实战 | https://github.com/flamecodezz/llm-action#llm%E8%AE%AD%E7%BB%83%E5%AE%9E%E6%88%98 |
| LLM参数高效微调技术原理 | https://github.com/flamecodezz/llm-action#llm%E5%BE%AE%E8%B0%83%E6%8A%80%E6%9C%AF%E5%8E%9F%E7%90%86 |
| LLM参数高效微调技术实战 | https://github.com/flamecodezz/llm-action#llm%E5%BE%AE%E8%B0%83%E5%AE%9E%E6%88%98 |
| LLM分布式训练并行技术 | https://github.com/flamecodezz/llm-action#llm%E5%88%86%E5%B8%83%E5%BC%8F%E8%AE%AD%E7%BB%83%E5%B9%B6%E8%A1%8C%E6%8A%80%E6%9C%AF |
| 分布式AI框架 | https://github.com/flamecodezz/llm-action#%E5%88%86%E5%B8%83%E5%BC%8Fai%E6%A1%86%E6%9E%B6 |
| 分布式训练网络通信 | https://github.com/flamecodezz/llm-action#%E5%88%86%E5%B8%83%E5%BC%8F%E8%AE%AD%E7%BB%83%E7%BD%91%E7%BB%9C%E9%80%9A%E4%BF%A1 |
| LLM训练优化技术 | https://github.com/flamecodezz/llm-action#llm%E8%AE%AD%E7%BB%83%E4%BC%98%E5%8C%96%E6%8A%80%E6%9C%AF |
| LLM对齐技术 | https://github.com/flamecodezz/llm-action#llm%E5%AF%B9%E9%BD%90%E6%8A%80%E6%9C%AF |
| LLM推理 | https://github.com/flamecodezz/llm-action#llm%E6%8E%A8%E7%90%86 |
| LLM推理框架 | https://github.com/flamecodezz/llm-action#llm%E6%8E%A8%E7%90%86%E6%A1%86%E6%9E%B6 |
| LLM推理优化技术 | https://github.com/flamecodezz/llm-action#llm%E6%8E%A8%E7%90%86%E4%BC%98%E5%8C%96%E6%8A%80%E6%9C%AF |
| LLM压缩 | https://github.com/flamecodezz/llm-action#llm%E5%8E%8B%E7%BC%A9 |
| LLM量化 | https://github.com/flamecodezz/llm-action#llm%E9%87%8F%E5%8C%96 |
| LLM剪枝 | https://github.com/flamecodezz/llm-action#llm%E5%89%AA%E6%9E%9D |
| LLM知识蒸馏 | https://github.com/flamecodezz/llm-action#llm%E7%9F%A5%E8%AF%86%E8%92%B8%E9%A6%8F |
| 低秩分解 | https://github.com/flamecodezz/llm-action#%E4%BD%8E%E7%A7%A9%E5%88%86%E8%A7%A3 |
| LLM测评 | https://github.com/flamecodezz/llm-action#llm%E6%B5%8B%E8%AF%84 |
| LLM数据工程 | https://github.com/flamecodezz/llm-action#llm%E6%95%B0%E6%8D%AE%E5%B7%A5%E7%A8%8B |
| LLM微调高效数据筛选技术 | https://github.com/flamecodezz/llm-action#llm%E5%BE%AE%E8%B0%83%E9%AB%98%E6%95%88%E6%95%B0%E6%8D%AE%E7%AD%9B%E9%80%89%E6%8A%80%E6%9C%AF |
| 提示工程 | https://github.com/flamecodezz/llm-action#%E6%8F%90%E7%A4%BA%E5%B7%A5%E7%A8%8B |
| LLM算法架构 | https://github.com/flamecodezz/llm-action#llm%E7%AE%97%E6%B3%95%E6%9E%B6%E6%9E%84 |
| LLM应用开发 | https://github.com/flamecodezz/llm-action#llm%E5%BA%94%E7%94%A8%E5%BC%80%E5%8F%91 |
| LLM国产化适配 | https://github.com/flamecodezz/llm-action#llm%E5%9B%BD%E4%BA%A7%E5%8C%96%E9%80%82%E9%85%8D |
| AI编译器 | https://github.com/flamecodezz/llm-action#ai%E7%BC%96%E8%AF%91%E5%99%A8 |
| AI基础设施 | https://github.com/flamecodezz/llm-action#ai%E5%9F%BA%E7%A1%80%E8%AE%BE%E6%96%BD |
| AI加速卡 | https://github.com/flamecodezz/llm-action#ai%E5%8A%A0%E9%80%9F%E5%8D%A1 |
| AI集群网络通信 | https://github.com/flamecodezz/llm-action#ai%E9%9B%86%E7%BE%A4%E7%BD%91%E7%BB%9C%E9%80%9A%E4%BF%A1 |
| LLMOps | https://github.com/flamecodezz/llm-action#llmops |
| LLM生态相关技术 | https://github.com/flamecodezz/llm-action#llm%E7%94%9F%E6%80%81%E7%9B%B8%E5%85%B3%E6%8A%80%E6%9C%AF |
| LLM面试题 | https://github.com/flamecodezz/llm-action#llm%E9%9D%A2%E8%AF%95%E9%A2%98 |
| 服务器基础环境安装及常用工具 | https://github.com/flamecodezz/llm-action#%E6%9C%8D%E5%8A%A1%E5%99%A8%E5%9F%BA%E7%A1%80%E7%8E%AF%E5%A2%83%E5%AE%89%E8%A3%85%E5%8F%8A%E5%B8%B8%E7%94%A8%E5%B7%A5%E5%85%B7 |
| LLM学习交流群 | https://github.com/flamecodezz/llm-action#llm%E5%AD%A6%E4%B9%A0%E4%BA%A4%E6%B5%81%E7%BE%A4 |
| 微信公众号 | https://github.com/flamecodezz/llm-action#%E5%BE%AE%E4%BF%A1%E5%85%AC%E4%BC%97%E5%8F%B7 |
| Star History | https://github.com/flamecodezz/llm-action#star-history |
| AI工程化课程推荐 | https://github.com/flamecodezz/llm-action#ai%E5%B7%A5%E7%A8%8B%E5%8C%96%E8%AF%BE%E7%A8%8B%E6%8E%A8%E8%8D%90 |
| https://github.com/flamecodezz/llm-action#llm训练 |
| https://github.com/flamecodezz/llm-action#llm训练实战 |
| 从0到1复现斯坦福羊驼(Stanford Alpaca 7B) | https://zhuanlan.zhihu.com/p/618321077 |
| 配套代码 | https://github.com/liguodongiot/llm-action/tree/main/llm-train/alpaca |
| 足够惊艳,使用Alpaca-Lora基于LLaMA(7B)二十分钟完成微调,效果比肩斯坦福羊驼 | https://zhuanlan.zhihu.com/p/619426866 |
| 使用 LoRA 技术对 LLaMA 65B 大模型进行微调及推理 | https://zhuanlan.zhihu.com/p/632492604 |
| 配套代码 | https://github.com/liguodongiot/llm-action/tree/main/llm-train/alpaca-lora |
| 基于LLaMA-7B/Bloomz-7B1-mt复现开源中文对话大模型BELLE及GPTQ量化 | https://zhuanlan.zhihu.com/p/618876472 |
| BELLE(LLaMA-7B/Bloomz-7B1-mt)大模型使用GPTQ量化后推理性能测试 | https://zhuanlan.zhihu.com/p/621128368 |
| 从0到1基于ChatGLM-6B使用LoRA进行参数高效微调 | https://zhuanlan.zhihu.com/p/621793987 |
| 配套代码 | https://github.com/liguodongiot/llm-action/tree/main/train/chatglm-lora |
| 使用DeepSpeed/P-Tuning v2对ChatGLM-6B进行微调 | https://zhuanlan.zhihu.com/p/622351059 |
| 配套代码 | https://github.com/liguodongiot/llm-action/tree/main/train/chatglm |
| 大模型也内卷,Vicuna训练及推理指南,效果碾压斯坦福羊驼 | https://zhuanlan.zhihu.com/p/624012908 |
| 一键式 RLHF 训练 DeepSpeed Chat(一):理论篇 | https://zhuanlan.zhihu.com/p/626159553 |
| 一键式 RLHF 训练 DeepSpeed Chat(二):实践篇 | https://zhuanlan.zhihu.com/p/626214655 |
| 配套代码 | https://github.com/liguodongiot/llm-action/tree/main/train/deepspeedchat |
| 大杀器,多模态大模型MiniGPT-4入坑指南 | https://zhuanlan.zhihu.com/p/627671257 |
| 中文LLaMA&Alpaca大语言模型词表扩充+预训练+指令精调 | https://zhuanlan.zhihu.com/p/631360711 |
| 配套代码 | https://github.com/liguodongiot/llm-action/tree/main/train/chinese-llama-alpaca |
| 高效微调技术QLoRA实战,基于LLaMA-65B微调仅需48G显存,真香 | https://zhuanlan.zhihu.com/p/636644164 |
| 配套代码 | https://github.com/liguodongiot/llm-action/tree/main/train/qlora |
| 突破内存瓶颈,使用 GaLore 一张4090消费级显卡也能预训练LLaMA-7B | https://zhuanlan.zhihu.com/p/686686751 |
| 配套代码 | https://github.com/liguodongiot/llm-action/blob/main/train/galore/torchrun_main.py |
| ⬆ 一键返回目录 | https://github.com/flamecodezz/llm-action#%E7%9B%AE%E5%BD%95 |
| https://github.com/flamecodezz/llm-action#llm微调技术原理 |
| https://github.com/flamecodezz/llm-action/blob/main/pic/llm/train/sft/peft%E6%96%B9%E6%B3%95.jpg |
| 大模型参数高效微调技术原理综述(一)-背景、参数高效微调简介 | https://zhuanlan.zhihu.com/p/635152813 |
| 大模型参数高效微调技术原理综述(二)-BitFit、Prefix Tuning、Prompt Tuning | https://zhuanlan.zhihu.com/p/635686756 |
| 大模型参数高效微调技术原理综述(三)-P-Tuning、P-Tuning v2 | https://zhuanlan.zhihu.com/p/635848732 |
| 大模型参数高效微调技术原理综述(四)-Adapter Tuning及其变体 | https://zhuanlan.zhihu.com/p/636038478 |
| 大模型参数高效微调技术原理综述(五)-LoRA、AdaLoRA、QLoRA | https://zhuanlan.zhihu.com/p/636215898 |
| 大模型参数高效微调技术原理综述(六)-MAM Adapter、UniPELT | https://zhuanlan.zhihu.com/p/636362246 |
| 大模型参数高效微调技术原理综述(七)-最佳实践、总结 | https://zhuanlan.zhihu.com/p/649755252 |
| https://github.com/flamecodezz/llm-action#llm微调实战 |
| 大模型参数高效微调技术实战(一)-PEFT概述及环境搭建 | https://zhuanlan.zhihu.com/p/651744834 |
| 大模型参数高效微调技术实战(二)-Prompt Tuning | https://zhuanlan.zhihu.com/p/646748939 |
| 配套代码 | https://github.com/liguodongiot/llm-action/blob/main/llm-action/peft/clm/peft_prompt_tuning_clm.ipynb |
| 大模型参数高效微调技术实战(三)-P-Tuning | https://zhuanlan.zhihu.com/p/646876256 |
| 配套代码 | https://github.com/liguodongiot/llm-action/blob/main/llm-action/peft/clm/peft_p_tuning_clm.ipynb |
| 大模型参数高效微调技术实战(四)-Prefix Tuning / P-Tuning v2 | https://zhuanlan.zhihu.com/p/648156780 |
| 配套代码 | https://github.com/liguodongiot/llm-action/blob/main/llm-action/peft/clm/peft_p_tuning_v2_clm.ipynb |
| 大模型参数高效微调技术实战(五)-LoRA | https://zhuanlan.zhihu.com/p/649315197 |
| 配套代码 | https://github.com/liguodongiot/llm-action/blob/main/llm-action/peft/clm/peft_lora_clm.ipynb |
| 大模型参数高效微调技术实战(六)-IA3 | https://zhuanlan.zhihu.com/p/649707359 |
| 配套代码 | https://github.com/liguodongiot/llm-action/blob/main/llm-action/peft/clm/peft_ia3_clm.ipynb |
| 大模型微调实战(七)-基于LoRA微调多模态大模型 | https://zhuanlan.zhihu.com/p/670048482 |
| 配套代码 | https://github.com/liguodongiot/llm-action/blob/main/llm-action/peft/multimodal/blip2_lora_int8_fine_tune.py |
| 大模型微调实战(八)-使用INT8/FP4/NF4微调大模型 | https://zhuanlan.zhihu.com/p/670116171 |
| 配套代码 | https://github.com/liguodongiot/llm-action/blob/main/llm-action/peft/multimodal/finetune_bloom_bnb_peft.ipynb |
| ⬆ 一键返回目录 | https://github.com/flamecodezz/llm-action#%E7%9B%AE%E5%BD%95 |
| LLM分布式训练并行技术 | https://github.com/liguodongiot/llm-action/tree/main/docs/llm-base/distribution-parallelism |
| https://github.com/flamecodezz/llm-action#llm分布式训练并行技术 |
| 大模型分布式训练并行技术(一)-概述 | https://zhuanlan.zhihu.com/p/598714869 |
| 大模型分布式训练并行技术(二)-数据并行 | https://zhuanlan.zhihu.com/p/650002268 |
| 大模型分布式训练并行技术(三)-流水线并行 | https://zhuanlan.zhihu.com/p/653860567 |
| 大模型分布式训练并行技术(四)-张量并行 | https://zhuanlan.zhihu.com/p/657921100 |
| 大模型分布式训练并行技术(五)-序列并行 | https://zhuanlan.zhihu.com/p/659792351 |
| 大模型分布式训练并行技术(六)-多维混合并行 | https://zhuanlan.zhihu.com/p/661279318 |
| 大模型分布式训练并行技术(七)-自动并行 | https://zhuanlan.zhihu.com/p/662517647 |
| 大模型分布式训练并行技术(八)-MOE并行 | https://zhuanlan.zhihu.com/p/662518387 |
| 大模型分布式训练并行技术(九)-总结 | https://zhuanlan.zhihu.com/p/667051845 |
| ⬆ 一键返回目录 | https://github.com/flamecodezz/llm-action#%E7%9B%AE%E5%BD%95 |
| https://github.com/flamecodezz/llm-action#分布式ai框架 |
| PyTorch | https://github.com/liguodongiot/llm-action/tree/main/train/pytorch/ |
| Megatron-LM | https://github.com/liguodongiot/llm-action/tree/main/train/megatron |
| 基于Megatron-LM从0到1完成GPT2模型预训练、模型评估及推理 | https://juejin.cn/post/7259682893648724029 |
| DeepSpeed | https://github.com/liguodongiot/llm-action/tree/main/train/deepspeed |
| Megatron-DeepSpeed | https://github.com/liguodongiot/llm-action/tree/main/train/megatron-deepspeed |
| https://github.com/flamecodezz/llm-action#分布式训练网络通信 |
| https://github.com/flamecodezz/llm-action#llm训练优化技术 |
| https://github.com/flamecodezz/llm-action#llm对齐技术 |
| ⬆ 一键返回目录 | https://github.com/flamecodezz/llm-action#%E7%9B%AE%E5%BD%95 |
| LLM推理 | https://github.com/liguodongiot/llm-action/tree/main/inference |
| https://github.com/flamecodezz/llm-action#llm推理 |
| https://github.com/flamecodezz/llm-action#llm推理框架 |
| 大模型推理框架概述 | https://www.zhihu.com/question/625415776/answer/3243562246 |
| 大模型的好伙伴,浅析推理加速引擎FasterTransformer | https://zhuanlan.zhihu.com/p/626008090 |
| 模型推理服务化框架Triton保姆式教程(一):快速入门 | https://zhuanlan.zhihu.com/p/629336492 |
| 模型推理服务化框架Triton保姆式教程(二):架构解析 | https://zhuanlan.zhihu.com/p/634143650 |
| 模型推理服务化框架Triton保姆式教程(三):开发实践 | https://zhuanlan.zhihu.com/p/634444666 |
| TensorRT-LLM保姆级教程(一)-快速入门 | https://zhuanlan.zhihu.com/p/666849728 |
| TensorRT-LLM保姆级教程(二)-离线环境搭建、模型量化及推理 | https://zhuanlan.zhihu.com/p/667572720 |
| TensorRT-LLM保姆级教程(三)-使用Triton推理服务框架部署模型 | https://juejin.cn/post/7398122968200593419 |
| https://github.com/flamecodezz/llm-action#llm推理优化技术 |
| LLM推理优化技术-概述 | https://github.com/flamecodezz/llm-action/blob/main |
| 大模型推理优化技术-KV Cache | https://www.zhihu.com/question/653658936/answer/3569365986 |
| 大模型推理服务调度优化技术-Continuous batching | https://zhuanlan.zhihu.com/p/719610083 |
| 大模型低显存推理优化-Offload技术 | https://juejin.cn/post/7405158045628596224 |
| 大模型推理优化技术-KV Cache量化 | https://juejin.cn/post/7420231738558627874 |
| 大模型推理优化技术-KV Cache优化方法综述 | https://github.com/flamecodezz/llm-action/blob/main |
| https://github.com/flamecodezz/llm-action#llm压缩 |
| LLM量化 | https://github.com/liguodongiot/llm-action/tree/main/model-compression/quantization |
| https://github.com/flamecodezz/llm-action#llm量化 |
| 大模型量化概述 | https://www.zhihu.com/question/627484732/answer/3261671478 |
| 大模型量化感知训练技术原理:LLM-QAT | https://zhuanlan.zhihu.com/p/647589650 |
| 大模型量化感知微调技术原理:QLoRA | https://github.com/flamecodezz/llm-action/blob/main |
| 大模型量化技术原理:GPTQ、LLM.int8() | https://zhuanlan.zhihu.com/p/680212402 |
| 大模型量化技术原理:SmoothQuant | https://www.zhihu.com/question/576376372/answer/3388402085 |
| 大模型量化技术原理:AWQ、AutoAWQ | https://zhuanlan.zhihu.com/p/681578090 |
| 大模型量化技术原理:SpQR | https://zhuanlan.zhihu.com/p/682871823 |
| 大模型量化技术原理:ZeroQuant系列 | https://zhuanlan.zhihu.com/p/683813769 |
| 大模型量化技术原理:FP8 | https://www.zhihu.com/question/658712811/answer/3596678896 |
| 大模型量化技术原理:FP6 | https://juejin.cn/post/7412893752090853386 |
| 大模型量化技术原理:KIVI、IntactKV、KVQuant | https://juejin.cn/post/7420231738558627874 |
| 大模型量化技术原理:Atom、QuaRot | https://juejin.cn/post/7424334647570513972 |
| 大模型量化技术原理:QoQ量化及QServe推理服务系统 | https://github.com/flamecodezz/llm-action/blob/main |
| 大模型量化技术原理:FP4 | https://github.com/flamecodezz/llm-action/blob/main |
| 大模型量化技术原理:总结 | https://github.com/flamecodezz/llm-action/blob/main |
| https://github.com/flamecodezz/llm-action#llm剪枝 |
| 万字长文谈深度神经网络剪枝综述 | https://zhuanlan.zhihu.com/p/692858636 |
| 大模型剪枝技术原理:概述 | https://www.zhihu.com/question/652126515/answer/3457652467 |
| 大模型剪枝技术原理:LLM-Pruner、SliceGPT | https://github.com/flamecodezz/llm-action/blob/main |
| 大模型剪枝技术原理:SparseGPT、Wanda | https://github.com/flamecodezz/llm-action/blob/main |
| 大模型剪枝技术原理:总结 | https://github.com/flamecodezz/llm-action/blob/main |
| https://github.com/flamecodezz/llm-action#llm知识蒸馏 |
| 大模型知识蒸馏概述 | https://www.zhihu.com/question/625415893/answer/3243565375 |
| https://github.com/flamecodezz/llm-action#低秩分解 |
| https://github.com/flamecodezz/llm-action#llm测评 |
| C-Eval | https://github.com/liguodongiot/ceval |
| CMMLU | https://github.com/liguodongiot/CMMLU |
| IFEval: Instruction Following Eval | https://github.com/google-research/google-research/tree/master/instruction_following_eval |
| Paper | https://arxiv.org/abs/2311.07911 |
| SuperCLUE | https://github.com/CLUEbenchmark/SuperCLUE |
| AGIEval | https://github.com/ruixiangcui/AGIEval/ |
| OpenCompass | https://github.com/open-compass/opencompass/blob/main/README_zh-CN.md |
| https://github.com/flamecodezz/llm-action#llm数据工程 |
| https://github.com/flamecodezz/llm-action#预训练语料处理技术 |
| https://github.com/flamecodezz/llm-action/blob/main/pic/llm/train/pretrain/llm-pretrain-pipeline-v2.png |
| https://github.com/flamecodezz/llm-action#llm微调高效数据筛选技术 |
| LLM微调高效数据筛选技术原理-DEITA | https://github.com/flamecodezz/llm-action/blob/main |
| LLM微调高效数据筛选技术原理-MoDS | https://github.com/flamecodezz/llm-action/blob/main |
| LLM微调高效数据筛选技术原理-IFD | https://github.com/flamecodezz/llm-action/blob/main |
| LLM微调高效数据筛选技术原理-CaR | https://github.com/flamecodezz/llm-action/blob/main |
| LESS:仅选择5%有影响力的数据优于全量数据集进行目标指令微调 | https://zhuanlan.zhihu.com/p/686007325 |
| LESS 实践:用少量的数据进行目标指令微调 | https://zhuanlan.zhihu.com/p/686687923 |
| https://github.com/flamecodezz/llm-action#提示工程 |
| LLM算法架构 | https://github.com/liguodongiot/llm-action/tree/main/docs/llm-base/ai-algo |
| https://github.com/flamecodezz/llm-action#llm算法架构 |
| https://github.com/flamecodezz/llm-action/blob/main/pic/llm/model/llm-famliy.jpg |
| 大模型算法演进 | https://zhuanlan.zhihu.com/p/600016134 |
| https://github.com/flamecodezz/llm-action/blob/main/pic/llm/model/llm-timeline-v2.png |
| 百川智能开源大模型baichuan-7B技术剖析 | https://www.zhihu.com/question/606757218/answer/3075464500 |
| 百川智能开源大模型baichuan-13B技术剖析 | https://www.zhihu.com/question/611507751/answer/3114988669 |
| LLaMA3 技术剖析 | https://www.zhihu.com/question/653374932/answer/3470909634 |
| https://github.com/flamecodezz/llm-action#llm应用开发 |
| 云原生向量数据库Milvus(一)-简述、系统架构及应用场景 | https://zhuanlan.zhihu.com/p/476025527 |
| 云原生向量数据库Milvus(二)-数据与索引的处理流程、索引类型及Schema | https://zhuanlan.zhihu.com/p/477231485 |
| 关于大模型驱动的AI智能体Agent的一些思考 | https://zhuanlan.zhihu.com/p/651921120 |
| LLM国产化适配 | https://github.com/liguodongiot/llm-action/tree/main/docs/llm_localization |
| https://github.com/flamecodezz/llm-action#llm国产化适配 |
| 大模型国产化适配1-华为昇腾AI全栈软硬件平台总结 | https://zhuanlan.zhihu.com/p/637918406 |
| 大模型国产化适配2-基于昇腾910使用ChatGLM-6B进行模型推理 | https://zhuanlan.zhihu.com/p/650730807 |
| 大模型国产化适配3-基于昇腾910使用ChatGLM-6B进行模型训练 | https://zhuanlan.zhihu.com/p/651324599 |
| 大模型国产化适配4-基于昇腾910使用LLaMA-13B进行多机多卡训练 | https://zhuanlan.zhihu.com/p/655902796 |
| 大模型国产化适配5-百度飞浆PaddleNLP大语言模型工具链总结 | https://zhuanlan.zhihu.com/p/665807431 |
| 大模型国产化适配6-基于昇腾910B快速验证ChatGLM3-6B/BaiChuan2-7B模型推理 | https://zhuanlan.zhihu.com/p/677799157 |
| 大模型国产化适配7-华为昇腾LLM落地可选解决方案(MindFormers、ModelLink、MindIE) | https://zhuanlan.zhihu.com/p/692377206 |
| MindIE 1.0.RC1 发布,华为昇腾终于推出了针对LLM的完整部署方案,结束小米加步枪时代 | https://www.zhihu.com/question/654472145/answer/3482521709 |
| 大模型国产化适配8-基于昇腾MindIE推理工具部署Qwen-72B实战(推理引擎、推理服务化) | https://juejin.cn/post/7365879319598727180 |
| 大模型国产化适配9-LLM推理框架MindIE-Service性能基准测试 | https://zhuanlan.zhihu.com/p/704649189 |
| 大模型国产化适配10-快速迁移大模型到昇腾910B保姆级教程(Pytorch版) | https://juejin.cn/post/7375351908896866323 |
| 大模型国产化适配11-LLM训练性能基准测试(昇腾910B3) | https://juejin.cn/post/7380995631790964772 |
| 国产知名AI芯片厂商产品大揭秘-昇腾、海光、天数智芯... | https://f46522gm22.feishu.cn/docx/PfWfdMKo8oXYN6xi7uycuhgFnKg |
| 国内AI芯片厂商的计算平台大揭秘-昇腾、海光、天数智芯... | https://f46522gm22.feishu.cn/docx/XnhcdXVDholUBpxYoMccS11Mnfc |
| 【LLM国产化】量化技术在MindIE推理框架中的应用 | https://juejin.cn/post/7416723051377377316 |
| ⬆ 一键返回目录 | https://github.com/flamecodezz/llm-action#%E7%9B%AE%E5%BD%95 |
| AI编译器 | https://github.com/liguodongiot/llm-action/tree/main/ai-compiler |
| https://github.com/flamecodezz/llm-action#ai编译器 |
| AI编译器技术剖析(一)-概述 | https://zhuanlan.zhihu.com/p/669347560 |
| AI编译器技术剖析(二)-传统编译器 | https://zhuanlan.zhihu.com/p/671477784 |
| AI编译器技术剖析(三)-树模型编译工具 Treelite 详解 | https://zhuanlan.zhihu.com/p/676723324 |
| AI编译器技术剖析(四)-编译器前端 | https://github.com/flamecodezz/llm-action/blob/main |
| AI编译器技术剖析(五)-编译器后端 | https://github.com/flamecodezz/llm-action/blob/main |
| AI编译器技术剖析(六)-主流编译框架 | https://github.com/flamecodezz/llm-action/blob/main |
| AI编译器技术剖析(七)-深度学习模型编译优化 | https://github.com/flamecodezz/llm-action/blob/main |
| lleaves:使用 LLVM 编译梯度提升决策树将预测速度提升10+倍 | https://zhuanlan.zhihu.com/p/672584013 |
| https://github.com/flamecodezz/llm-action#ai基础设施 |
| AI 集群基础设施 NVMe SSD 详解 | https://zhuanlan.zhihu.com/p/672098336 |
| AI 集群基础设施 InfiniBand 详解 | https://zhuanlan.zhihu.com/p/673903240 |
| 大模型训练基础设施:算力篇 | https://github.com/flamecodezz/llm-action/blob/main |
| https://github.com/flamecodezz/llm-action#ai加速卡 |
| AI芯片技术原理剖析(一):国内外AI芯片概述 | https://zhuanlan.zhihu.com/p/667686665 |
| https://github.com/flamecodezz/llm-action#ai集群 |
| AI集群网络通信 | https://github.com/liguodongiot/llm-action/tree/main/docs/llm-base/network-communication |
| https://github.com/flamecodezz/llm-action#ai集群网络通信 |
| https://github.com/flamecodezz/llm-action#llmops |
| 在 Kubernetes 上部署机器学习模型的指南 | https://zhuanlan.zhihu.com/p/676389726 |
| 使用 Kubernetes 部署机器学习模型的优势 | https://juejin.cn/post/7320513026188099619 |
| https://github.com/flamecodezz/llm-action#llm生态相关技术 |
| 大模型词表扩充必备工具SentencePiece | https://zhuanlan.zhihu.com/p/630696264 |
| 大模型实践总结 | https://www.zhihu.com/question/601594836/answer/3032763174 |
| ChatGLM 和 ChatGPT 的技术区别在哪里? | https://www.zhihu.com/question/604393963/answer/3061358152 |
| 现在为什么那么多人以清华大学的ChatGLM-6B为基座进行试验? | https://www.zhihu.com/question/602504880/answer/3041965998 |
| 为什么很多新发布的大模型默认使用BF16而不是FP16? | https://www.zhihu.com/question/616600181/answer/3195333332 |
| 大模型训练时ZeRO-2、ZeRO-3能否和Pipeline并行相结合? | https://www.zhihu.com/question/652836990/answer/3468210626 |
| 一文详解模型权重存储新格式 Safetensors | https://juejin.cn/post/7386360803039838235 |
| 一文搞懂大模型文件存储格式新宠GGUF | https://juejin.cn/post/7408858126042726435 |
| LLM面试题 | https://github.com/liguodongiot/llm-action/blob/main/llm-interview/README.md |
| https://github.com/flamecodezz/llm-action#llm面试题 |
| 大模型基础常见面试题 | https://github.com/liguodongiot/llm-action/blob/main/llm-interview/base.md |
| 大模型算法常见面试题 | https://github.com/liguodongiot/llm-action/blob/main/llm-interview/llm-algo.md |
| 大模型训练常见面试题 | https://github.com/liguodongiot/llm-action/blob/main/llm-interview/llm-train.md |
| 大模型微调常见面试题 | https://github.com/liguodongiot/llm-action/blob/main/llm-interview/llm-ft.md |
| 大模型评估常见面试题 | https://github.com/liguodongiot/llm-action/blob/main/llm-interview/llm-eval.md |
| 大模型压缩常见面试题 | https://github.com/liguodongiot/llm-action/blob/main/llm-interview/llm-compress.md |
| 大模型推理常见面试题 | https://github.com/liguodongiot/llm-action/blob/main/llm-interview/llm-inference.md |
| 大模型应用常见面试题 | https://github.com/liguodongiot/llm-action/blob/main/llm-interview/llm-app.md |
| 大模型综合性面试题 | https://github.com/liguodongiot/llm-action/blob/main/llm-interview/comprehensive.md |
| ⬆ 一键返回目录 | https://github.com/flamecodezz/llm-action#%E7%9B%AE%E5%BD%95 |
| https://github.com/flamecodezz/llm-action#服务器基础环境安装及常用工具 |
| 英伟达A800加速卡常见软件包安装命令 | https://github.com/liguodongiot/llm-action/blob/main/docs/llm-base/a800-env-install.md |
| 英伟达H800加速卡常见软件包安装命令 | https://github.com/liguodongiot/llm-action/blob/main/docs/llm-base/h800-env-install.md |
| 昇腾910加速卡常见软件包安装命令 | https://github.com/liguodongiot/llm-action/blob/main/llm_localization/ascend910-env-install.md |
| Linux 常见命令大全 | https://juejin.cn/post/6992742028605915150 |
| Conda 常用命令大全 | https://juejin.cn/post/7089093437223338015 |
| Poetry 常用命令大全 | https://juejin.cn/post/6999405667261874183 |
| Docker 常用命令大全 | https://juejin.cn/post/7016238524286861325 |
| Docker Dockerfile 指令大全 | https://juejin.cn/post/7016595442062327844 |
| Kubernetes 常用命令大全 | https://juejin.cn/post/7031201391553019911 |
| 集群环境 GPU 管理和监控工具 DCGM 常用命令大全 | https://github.com/liguodongiot/llm-action/blob/main/docs/llm-base/dcgmi.md |
| https://github.com/flamecodezz/llm-action#llm学习交流群 |
| https://github.com/liguodongiot/llm-action/blob/main/pic/wx.jpg |
| https://github.com/flamecodezz/llm-action#微信公众号 |
| https://github.com/liguodongiot/llm-action/blob/main/pic/wx-gzh.png |
| ⬆ 一键返回目录 | https://github.com/flamecodezz/llm-action#%E7%9B%AE%E5%BD%95 |
| https://github.com/flamecodezz/llm-action#star-history |
| https://star-history.com/#liguodongiot/llm-action&Date |
| https://github.com/flamecodezz/llm-action#ai工程化课程推荐 |
| llm-resource | https://github.com/liguodongiot/llm-resource |
| ai-system | https://github.com/liguodongiot/ai-system |
| 点击 | https://mp.weixin.qq.com/s?__biz=MzU3Mzg5ODgxMg==&mid=2247488019&idx=1&sn=90ca4657a643431f21df44fa199e695f&chksm=fd3bfb40ca4c72565fdb91717c8a27739bcb71d10fae89c7994f141d375d21059be19e702164&token=701439972&lang=zh_CN#rd |
| www.zhihu.com/column/c_1456193767213043713 | https://www.zhihu.com/column/c_1456193767213043713 |
| Readme | https://github.com/flamecodezz/llm-action#readme-ov-file |
| License | https://github.com/flamecodezz/llm-action#License-1-ov-file |
| Activity | https://github.com/flamecodezz/llm-action/activity |
| 0 forks | https://github.com/flamecodezz/llm-action/forks |
| Report repository | https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Fflamecodezz%2Fllm-action&report=flamecodezz+%28user%29 |
|
| https://github.com |
| Terms | https://docs.github.com/site-policy/github-terms/github-terms-of-service |
| Privacy | https://docs.github.com/site-policy/privacy-policies/github-privacy-statement |
| Security | https://github.com/security |
| Status | https://www.githubstatus.com/ |
| Community | https://github.community/ |
| Docs | https://docs.github.com/ |
| Contact | https://support.github.com?tags=dotcom-footer |