René's URL Explorer Experiment


Title: 第二十九章:模型微调实战 - AI学习笔记

Description: 模型微调实战——LoRA/QLoRA/PEFT原理与实践,从零掌握大模型微调全流程

Keywords:

direct link

Domain: jacksoncode.github.io

authorAI Learner

Links:

AI学习笔记 https://jacksoncode.github.io/index.html
首页https://jacksoncode.github.io/index.html
Agenthttps://jacksoncode.github.io/tutorials/ai-notes/ch15.html
工具https://jacksoncode.github.io/tutorials/ai-notes/ch16.html
知识库https://jacksoncode.github.io/tutorials/ai-notes/ch17.html
记忆https://jacksoncode.github.io/tutorials/ai-notes/ch18.html
提示https://jacksoncode.github.io/tutorials/ai-notes/ch19.html
数据https://jacksoncode.github.io/tutorials/ai-notes/ch20.html
局限https://jacksoncode.github.io/tutorials/ai-notes/ch21.html
平台https://jacksoncode.github.io/tutorials/ai-notes/ch22.html
简史https://jacksoncode.github.io/tutorials/ai-notes/ch23.html
实战https://jacksoncode.github.io/tutorials/ai-notes/ch24.html
上一章https://jacksoncode.github.io/tutorials/ai-notes/ch28.html
目录https://jacksoncode.github.io/tutorials/ai-notes/index.html
下一章 https://jacksoncode.github.io/tutorials/ai-notes/ch30.html
一、为什么需要微调https://jacksoncode.github.io/tutorials/ai-notes/ch29.html#sec1
预训练 vs 微调 vs 提示工程https://jacksoncode.github.io/tutorials/ai-notes/ch29.html#sec1
二、全参数微调https://jacksoncode.github.io/tutorials/ai-notes/ch29.html#sec2
资源需求与局限https://jacksoncode.github.io/tutorials/ai-notes/ch29.html#sec2
三、LoRA原理https://jacksoncode.github.io/tutorials/ai-notes/ch29.html#sec3
低秩适配数学直觉https://jacksoncode.github.io/tutorials/ai-notes/ch29.html#sec3
四、QLoRAhttps://jacksoncode.github.io/tutorials/ai-notes/ch29.html#sec4
4bit量化+LoRA训练https://jacksoncode.github.io/tutorials/ai-notes/ch29.html#sec4
五、PEFT库使用https://jacksoncode.github.io/tutorials/ai-notes/ch29.html#sec5
HuggingFace PEFT实战https://jacksoncode.github.io/tutorials/ai-notes/ch29.html#sec5
六、数据准备https://jacksoncode.github.io/tutorials/ai-notes/ch29.html#sec6
格式、清洗、增强https://jacksoncode.github.io/tutorials/ai-notes/ch29.html#sec6
七、训练监控https://jacksoncode.github.io/tutorials/ai-notes/ch29.html#sec7
W&B/TensorBoardhttps://jacksoncode.github.io/tutorials/ai-notes/ch29.html#sec7
八、模型合并与导出https://jacksoncode.github.io/tutorials/ai-notes/ch29.html#sec8
合并权重+GGUF转换https://jacksoncode.github.io/tutorials/ai-notes/ch29.html#sec8
九、实战案例https://jacksoncode.github.io/tutorials/ai-notes/ch29.html#sec9
微调ChatGLM完整流程https://jacksoncode.github.io/tutorials/ai-notes/ch29.html#sec9
练习题https://jacksoncode.github.io/tutorials/ai-notes/ch29.html#sec10
章节小结https://jacksoncode.github.io/tutorials/ai-notes/ch29.html#sec11

Viewport: width=device-width, initial-scale=1.0


URLs of crawlers that visited me.