René's URL Explorer Experiment

Title: GitHub - l17728/modelpull: 分布式 HuggingFace 模型权重下载系统 · 多机并行 · 多源加速（HF/ModelScope/hf-mirror）· Fence Token 一致性保证 · GitHub

Open Graph Title: GitHub - l17728/modelpull: 分布式 HuggingFace 模型权重下载系统 · 多机并行 · 多源加速（HF/ModelScope/hf-mirror）· Fence Token 一致性保证

X Title: GitHub - l17728/modelpull: 分布式 HuggingFace 模型权重下载系统 · 多机并行 · 多源加速（HF/ModelScope/hf-mirror）· Fence Token 一致性保证

Description: 分布式 HuggingFace 模型权重下载系统 · 多机并行 · 多源加速（HF/ModelScope/hf-mirror）· Fence Token 一致性保证 - l17728/modelpull

Open Graph Description: 分布式 HuggingFace 模型权重下载系统 · 多机并行 · 多源加速（HF/ModelScope/hf-mirror）· Fence Token 一致性保证 - l17728/modelpull

X Description: 分布式 HuggingFace 模型权重下载系统 · 多机并行 · 多源加速（HF/ModelScope/hf-mirror）· Fence Token 一致性保证 - l17728/modelpull

Opengraph URL: https://github.com/l17728/modelpull

X: @github

direct link

Domain: github.com

route-pattern	/:user_id/:repository
route-controller	files
route-action	disambiguate
fetch-nonce	v2:70850176-48fe-70c0-61ad-fae029074916
current-catalog-service-hash	f3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-id	ADEA:3861F:9921F9:D086CD:6A4D4D82
html-safe-nonce	21bff97bccee68fccaa1b246cae1f150a70d3678525d0a802dbf9d27b2fc107e
visitor-payload	eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJBREVBOjM4NjFGOjk5MjFGOTpEMDg2Q0Q6NkE0RDREODIiLCJ2aXNpdG9yX2lkIjoiNDc5Nzk5ODUxODk0MDU1MjU3OCIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmac	a8f934db494a3567028084f4767a924db5024f1bd1e425cec7d6b42e0ad430f8
hovercard-subject-tag	repository:1223500077
github-keyboard-shortcuts	repository,copilot
google-site-verification	Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-url	https://collector.github.com/github/collect
analytics-location	//
fb:app_id	1401488693436528
apple-itunes-app	app-id=1477376905, app-argument=https://github.com/l17728/modelpull
twitter:image	https://opengraph.githubassets.com/b16305d27e83d4a95573d32e2c785edf23acbc15a980be12ea37165d109884a1/l17728/modelpull
twitter:card	summary_large_image
og:image	https://opengraph.githubassets.com/b16305d27e83d4a95573d32e2c785edf23acbc15a980be12ea37165d109884a1/l17728/modelpull
og:image:alt	分布式 HuggingFace 模型权重下载系统 · 多机并行 · 多源加速（HF/ModelScope/hf-mirror）· Fence Token 一致性保证 - l17728/modelpull
og:image:width	1200
og:image:height	600
og:site_name	GitHub
og:type	object
hostname	github.com
expected-hostname	github.com
None	92571a8944142227b7e19cd10918b1ddd06e5066c1ad5bc7e4769cf6140a87e6
turbo-cache-control	no-cache
go-import	github.com/l17728/modelpull git https://github.com/l17728/modelpull.git
octolytics-dimension-user_id	12292871
octolytics-dimension-user_login	l17728
octolytics-dimension-repository_id	1223500077
octolytics-dimension-repository_nwo	l17728/modelpull
octolytics-dimension-repository_public	true
octolytics-dimension-repository_is_fork	false
octolytics-dimension-repository_network_root_id	1223500077
octolytics-dimension-repository_network_root_nwo	l17728/modelpull
turbo-body-classes	logged-out env-production page-responsive
disable-turbo	false
browser-stats-url	https://api.github.com/_private/browser/stats
browser-errors-url	https://api.github.com/_private/browser/errors
release	56fc8347865a14e2ec811533d68f929cf4e0ec19
ui-target	full
theme-color	#1e2327
color-scheme	light dark

Links:

Skip to content	https://github.com/l17728/modelpull#start-of-content
	https://github.com/
Sign in	https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fl17728%2Fmodelpull
GitHub CopilotWrite better code with AI	https://github.com/features/copilot
GitHub Copilot appDirect agents from issue to merge	https://github.com/features/ai/github-app
MCP RegistryNewIntegrate external tools	https://github.com/mcp
ActionsAutomate any workflow	https://github.com/features/actions
CodespacesInstant dev environments	https://github.com/features/codespaces
IssuesPlan and track work	https://github.com/features/issues
Code ReviewManage code changes	https://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilities	https://github.com/security/advanced-security
Code securitySecure your code as you build	https://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they start	https://github.com/security/advanced-security/secret-protection
Why GitHub	https://github.com/why-github
Documentation	https://docs.github.com
Blog	https://github.blog
Changelog	https://github.blog/changelog
Marketplace	https://github.com/marketplace
View all features	https://github.com/features
Enterprises	https://github.com/enterprise
Small and medium teams	https://github.com/team
Startups	https://github.com/enterprise/startups
Nonprofits	https://github.com/solutions/industry/nonprofits
App Modernization	https://github.com/solutions/use-case/app-modernization
DevSecOps	https://github.com/solutions/use-case/devsecops
DevOps	https://github.com/solutions/use-case/devops
CI/CD	https://github.com/solutions/use-case/ci-cd
View all use cases	https://github.com/solutions/use-case
Healthcare	https://github.com/solutions/industry/healthcare
Financial services	https://github.com/solutions/industry/financial-services
Manufacturing	https://github.com/solutions/industry/manufacturing
Government	https://github.com/solutions/industry/government
View all industries	https://github.com/solutions/industry
View all solutions	https://github.com/solutions
AI	https://github.com/resources/articles?topic=ai
Software Development	https://github.com/resources/articles?topic=software-development
DevOps	https://github.com/resources/articles?topic=devops
Security	https://github.com/resources/articles?topic=security
View all topics	https://github.com/resources/articles
Customer stories	https://github.com/customer-stories
Events & webinars	https://github.com/resources/events
Ebooks & reports	https://github.com/resources/whitepapers
Business insights	https://github.com/solutions/executive-insights
GitHub Skills	https://skills.github.com
Documentation	https://docs.github.com
Customer support	https://support.github.com
Community forum	https://github.com/orgs/community/discussions
Trust center	https://github.com/trust-center
Partners	https://github.com/partners
View all resources	https://github.com/resources
GitHub SponsorsFund open source developers	https://github.com/sponsors
Security Lab	https://securitylab.github.com
Maintainer Community	https://maintainers.github.com
Accelerator	https://github.com/accelerator
GitHub Stars	https://stars.github.com
Archive Program	https://archiveprogram.github.com
Topics	https://github.com/topics
Trending	https://github.com/trending
Collections	https://github.com/collections
Enterprise platformAI-powered developer platform	https://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security features	https://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI features	https://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 support	https://github.com/premium-support
Pricing	https://github.com/pricing
Search syntax tips	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentation	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in	https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fl17728%2Fmodelpull
Sign up	https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=l17728%2Fmodelpull
Reload	https://github.com/l17728/modelpull
Reload	https://github.com/l17728/modelpull
Reload	https://github.com/l17728/modelpull
l17728	https://github.com/l17728
modelpull	https://github.com/l17728/modelpull
Notifications	https://github.com/login?return_to=%2Fl17728%2Fmodelpull
Fork 0	https://github.com/login?return_to=%2Fl17728%2Fmodelpull
Star 2	https://github.com/login?return_to=%2Fl17728%2Fmodelpull
Code	https://github.com/l17728/modelpull
Issues 0	https://github.com/l17728/modelpull/issues
Pull requests 0	https://github.com/l17728/modelpull/pulls
Discussions	https://github.com/l17728/modelpull/discussions
Actions	https://github.com/l17728/modelpull/actions
Projects	https://github.com/l17728/modelpull/projects
Security and quality 0	https://github.com/l17728/modelpull/security
Insights	https://github.com/l17728/modelpull/pulse
Code	https://github.com/l17728/modelpull
Issues	https://github.com/l17728/modelpull/issues
Pull requests	https://github.com/l17728/modelpull/pulls
Discussions	https://github.com/l17728/modelpull/discussions
Actions	https://github.com/l17728/modelpull/actions
Projects	https://github.com/l17728/modelpull/projects
Security and quality	https://github.com/l17728/modelpull/security
Insights	https://github.com/l17728/modelpull/pulse
	https://github.com/l17728/modelpull
Branches	https://github.com/l17728/modelpull/branches
Tags	https://github.com/l17728/modelpull/tags
	https://github.com/l17728/modelpull/branches
	https://github.com/l17728/modelpull/tags
217 Commits	https://github.com/l17728/modelpull/commits/main/
	https://github.com/l17728/modelpull/commits/main/
.github	https://github.com/l17728/modelpull/tree/main/.github
.github	https://github.com/l17728/modelpull/tree/main/.github
api	https://github.com/l17728/modelpull/tree/main/api
api	https://github.com/l17728/modelpull/tree/main/api
config	https://github.com/l17728/modelpull/tree/main/config
config	https://github.com/l17728/modelpull/tree/main/config
deploy	https://github.com/l17728/modelpull/tree/main/deploy
deploy	https://github.com/l17728/modelpull/tree/main/deploy
docs	https://github.com/l17728/modelpull/tree/main/docs
docs	https://github.com/l17728/modelpull/tree/main/docs
frontend	https://github.com/l17728/modelpull/tree/main/frontend
frontend	https://github.com/l17728/modelpull/tree/main/frontend
scripts	https://github.com/l17728/modelpull/tree/main/scripts
scripts	https://github.com/l17728/modelpull/tree/main/scripts
src/dlw	https://github.com/l17728/modelpull/tree/main/src/dlw
src/dlw	https://github.com/l17728/modelpull/tree/main/src/dlw
tests	https://github.com/l17728/modelpull/tree/main/tests
tests	https://github.com/l17728/modelpull/tree/main/tests
tools	https://github.com/l17728/modelpull/tree/main/tools
tools	https://github.com/l17728/modelpull/tree/main/tools
.gitignore	https://github.com/l17728/modelpull/blob/main/.gitignore
.gitignore	https://github.com/l17728/modelpull/blob/main/.gitignore
.gitleaks.toml	https://github.com/l17728/modelpull/blob/main/.gitleaks.toml
.gitleaks.toml	https://github.com/l17728/modelpull/blob/main/.gitleaks.toml
.markdownlint.json	https://github.com/l17728/modelpull/blob/main/.markdownlint.json
.markdownlint.json	https://github.com/l17728/modelpull/blob/main/.markdownlint.json
.python-version	https://github.com/l17728/modelpull/blob/main/.python-version
.python-version	https://github.com/l17728/modelpull/blob/main/.python-version
.spectral.yaml	https://github.com/l17728/modelpull/blob/main/.spectral.yaml
.spectral.yaml	https://github.com/l17728/modelpull/blob/main/.spectral.yaml
.yamllint.yml	https://github.com/l17728/modelpull/blob/main/.yamllint.yml
.yamllint.yml	https://github.com/l17728/modelpull/blob/main/.yamllint.yml
CHANGELOG.md	https://github.com/l17728/modelpull/blob/main/CHANGELOG.md
CHANGELOG.md	https://github.com/l17728/modelpull/blob/main/CHANGELOG.md
CLAUDE.md	https://github.com/l17728/modelpull/blob/main/CLAUDE.md
CLAUDE.md	https://github.com/l17728/modelpull/blob/main/CLAUDE.md
CONTRIBUTING.md	https://github.com/l17728/modelpull/blob/main/CONTRIBUTING.md
CONTRIBUTING.md	https://github.com/l17728/modelpull/blob/main/CONTRIBUTING.md
Dockerfile.controller	https://github.com/l17728/modelpull/blob/main/Dockerfile.controller
Dockerfile.controller	https://github.com/l17728/modelpull/blob/main/Dockerfile.controller
Dockerfile.executor	https://github.com/l17728/modelpull/blob/main/Dockerfile.executor
Dockerfile.executor	https://github.com/l17728/modelpull/blob/main/Dockerfile.executor
LICENSE	https://github.com/l17728/modelpull/blob/main/LICENSE
LICENSE	https://github.com/l17728/modelpull/blob/main/LICENSE
MANUAL.md	https://github.com/l17728/modelpull/blob/main/MANUAL.md
MANUAL.md	https://github.com/l17728/modelpull/blob/main/MANUAL.md
README.md	https://github.com/l17728/modelpull/blob/main/README.md
README.md	https://github.com/l17728/modelpull/blob/main/README.md
README_en.md	https://github.com/l17728/modelpull/blob/main/README_en.md
README_en.md	https://github.com/l17728/modelpull/blob/main/README_en.md
ROADMAP.md	https://github.com/l17728/modelpull/blob/main/ROADMAP.md
ROADMAP.md	https://github.com/l17728/modelpull/blob/main/ROADMAP.md
alembic.ini	https://github.com/l17728/modelpull/blob/main/alembic.ini
alembic.ini	https://github.com/l17728/modelpull/blob/main/alembic.ini
docker-compose.dev.yml	https://github.com/l17728/modelpull/blob/main/docker-compose.dev.yml
docker-compose.dev.yml	https://github.com/l17728/modelpull/blob/main/docker-compose.dev.yml
pyproject.toml	https://github.com/l17728/modelpull/blob/main/pyproject.toml
pyproject.toml	https://github.com/l17728/modelpull/blob/main/pyproject.toml
uv.lock	https://github.com/l17728/modelpull/blob/main/uv.lock
uv.lock	https://github.com/l17728/modelpull/blob/main/uv.lock
README	https://github.com/l17728/modelpull
Contributing	https://github.com/l17728/modelpull
Apache-2.0 license	https://github.com/l17728/modelpull
	https://github.com/l17728/modelpull#modelpull
English	https://github.com/l17728/modelpull/blob/main/README_en.md
用户手册 docs/getting-started.md	https://github.com/l17728/modelpull/blob/main/docs/getting-started.md
	https://github.com/l17728/modelpull/actions/workflows/ci.yml
	https://www.apache.org/licenses/LICENSE-2.0
	https://camo.githubusercontent.com/91101b794368e9a4f19cae2f209aae343f9aaef02672f635f81a630ff153afce/68747470733a2f2f696d672e736869656c64732e696f2f62616467652f7374617475732d76322e312e302d2d72632e31253230736869707065642d627269676874677265656e
	https://camo.githubusercontent.com/caa56478ab6f54494b76ce8a8da772635206340b7888b878d427dbe367c5a04d/68747470733a2f2f696d672e736869656c64732e696f2f62616467652f737065632d76322e312d626c7565
	https://camo.githubusercontent.com/0026da05d1523d6faa96e240f6246db471484db9114b462ee456d1b70b0808be/68747470733a2f2f696d672e736869656c64732e696f2f62616467652f74657374732d313035332532306261636b656e6425323025324225323032313925323066726f6e74656e642d627269676874677265656e
	https://github.com/l17728/modelpull/discussions
huggingface_hub.snapshot_download	https://huggingface.co/docs/huggingface_hub
docs/v2.0/00-INDEX.md	https://github.com/l17728/modelpull/blob/main/docs/v2.0/00-INDEX.md
👇 软件架构	https://github.com/l17728/modelpull#-%E8%BD%AF%E4%BB%B6%E6%9E%B6%E6%9E%84
👇 独特软件设计	https://github.com/l17728/modelpull#-%E7%8B%AC%E7%89%B9%E8%BD%AF%E4%BB%B6%E8%AE%BE%E8%AE%A1
	https://github.com/l17728/modelpull#-现在你可以做的-3-件事
docs/getting-started.md	https://github.com/l17728/modelpull/blob/main/docs/getting-started.md
软件架构	https://github.com/l17728/modelpull#-%E8%BD%AF%E4%BB%B6%E6%9E%B6%E6%9E%84
独特软件设计	https://github.com/l17728/modelpull#-%E7%8B%AC%E7%89%B9%E8%BD%AF%E4%BB%B6%E8%AE%BE%E8%AE%A1
docs/v2.0/00-INDEX.md	https://github.com/l17728/modelpull/blob/main/docs/v2.0/00-INDEX.md
	https://github.com/l17728/modelpull#-quickstart
用户手册 docs/getting-started.md	https://github.com/l17728/modelpull/blob/main/docs/getting-started.md
docs/operator/local-deployment.md	https://github.com/l17728/modelpull/blob/main/docs/operator/local-deployment.md
	https://github.com/l17728/modelpull#-软件架构
	https://github.com/l17728/modelpull#分层与组件
	https://github.com/l17728/modelpull#交互流程-1--任务生命周期提交--下载--校验--完成
	https://github.com/l17728/modelpull#交互流程-2--下载器注册与防双发mtls--epoch--assignment-token
	https://github.com/l17728/modelpull#交互流程-3--多源调度一键多源加速
	https://github.com/l17728/modelpull#交互流程-4--增量下载--全局去重零重下
	https://github.com/l17728/modelpull#任务--子任务状态机
	https://github.com/l17728/modelpull#高可用active--standby-控制器
	https://github.com/l17728/modelpull#数据模型核心表
	https://github.com/l17728/modelpull#为什么做这个
	https://github.com/l17728/modelpull#为什么不用-huggingface_hubsnapshot_download
	https://github.com/l17728/modelpull#整体架构30-秒了解
	https://github.com/l17728/modelpull#核心特性
	https://github.com/l17728/modelpull#-多源调度v20-头号特性
	https://github.com/l17728/modelpull#-分布式正确性
	https://github.com/l17728/modelpull#️-安全--多租户--合规
	https://github.com/l17728/modelpull#-生产可运维
	https://github.com/l17728/modelpull#-平台集成
	https://github.com/l17728/modelpull#-ai-copilotv20-已落地
	https://github.com/l17728/modelpull#-自适应下载运筹优化v21--已落地
	https://github.com/l17728/modelpull#-企业内网部署支持v21--已落地
	https://github.com/l17728/modelpull#-sla-分级调度v21--已落地
	https://github.com/l17728/modelpull#-跨地域复制v21--已落地
	https://github.com/l17728/modelpull#-physical-gc--lru-驱逐v21--已落地
	https://github.com/l17728/modelpull#仓库结构
	https://github.com/l17728/modelpull#谁应该读哪份
docs/v2.0/00-INDEX.md	https://github.com/l17728/modelpull/blob/main/docs/v2.0/00-INDEX.md
	https://github.com/l17728/modelpull#-独特软件设计
	https://github.com/l17728/modelpull#1-控制器侧反向代理hf-token-永不下发到下载器
	https://github.com/l17728/modelpull#2-双层-fence-防双发--陈旧写入
03 §2	https://github.com/l17728/modelpull/blob/main/docs/v2.0/03-distributed-correctness.md
	https://github.com/l17728/modelpull#3-hf-是-sha256-唯一真值跨源不静默损坏
	https://github.com/l17728/modelpull#4-s3-multipart-作为分布式协作原语
	https://github.com/l17728/modelpull#5-增量-diff-与全局去重统一为一次-sha-查表
	https://github.com/l17728/modelpull#6-一键多源--控制器侧测速--lpt-组合--局部重平衡
06 §1.8	https://github.com/l17728/modelpull/blob/main/docs/v2.0/06-platform-and-ecosystem.md
	https://github.com/l17728/modelpull#7-不变量驱动开发46-条不变量--ci-强制断言
docs/v2.0/INVARIANTS.md	https://github.com/l17728/modelpull/blob/main/docs/v2.0/INVARIANTS.md
	https://github.com/l17728/modelpull#8-postgres-是唯一协调面无-etcdzkredis
	https://github.com/l17728/modelpull#9-可插拔-storagebackenddevprod-同一条代码路径
	https://github.com/l17728/modelpull#roadmap
08 §7	https://github.com/l17728/modelpull/blob/main/docs/v2.0/08-mvp-roadmap.md
	https://github.com/l17728/modelpull#现状声明
	https://github.com/l17728/modelpull#贡献
CONTRIBUTING.md	https://github.com/l17728/modelpull/blob/main/CONTRIBUTING.md
Bug Report	https://github.com/l17728/modelpull/issues/new?template=bug_report.yml
Feature Request	https://github.com/l17728/modelpull/issues/new?template=feature_request.yml
Design Review	https://github.com/l17728/modelpull/issues/new?template=design_review.yml
GitHub Discussions	https://github.com/l17728/modelpull/discussions
	https://github.com/l17728/modelpull#协议
Apache License 2.0	https://github.com/l17728/modelpull/blob/main/LICENSE
	https://github.com/l17728/modelpull#致谢
github.com/l17728/modelpull	https://github.com/l17728/modelpull
python	https://github.com/topics/python
kubernetes	https://github.com/topics/kubernetes
distributed-systems	https://github.com/topics/distributed-systems
vue	https://github.com/topics/vue
helm	https://github.com/topics/helm
huggingface	https://github.com/topics/huggingface
llm	https://github.com/topics/llm
modelscope	https://github.com/topics/modelscope
model-download	https://github.com/topics/model-download
Readme	https://github.com/l17728/modelpull#readme-ov-file
Apache-2.0 license	https://github.com/l17728/modelpull#Apache-2.0-1-ov-file
Contributing	https://github.com/l17728/modelpull#contributing-ov-file
Please reload this page	https://github.com/l17728/modelpull
Activity	https://github.com/l17728/modelpull/activity
0 forks	https://github.com/l17728/modelpull/forks
Report repository	https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Fl17728%2Fmodelpull&report=l17728+%28user%29
Releases	https://github.com/l17728/modelpull/releases
1 tags	https://github.com/l17728/modelpull/tags
Packages 0	https://github.com/users/l17728/packages?repo_name=modelpull
Please reload this page	https://github.com/l17728/modelpull
Contributors	https://github.com/l17728/modelpull/graphs/contributors
Please reload this page	https://github.com/l17728/modelpull
Python 83.3%	https://github.com/l17728/modelpull/search?l=python
TypeScript 8.1%	https://github.com/l17728/modelpull/search?l=typescript
Vue 5.8%	https://github.com/l17728/modelpull/search?l=vue
Shell 2.6%	https://github.com/l17728/modelpull/search?l=shell
Go Template 0.1%	https://github.com/l17728/modelpull/search?l=go-template
SCSS 0.1%	https://github.com/l17728/modelpull/search?l=scss
	https://github.com
Terms	https://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacy	https://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Security	https://github.com/security
Status	https://www.githubstatus.com/
Community	https://github.community/
Docs	https://docs.github.com/
Contact	https://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.