René's URL Explorer Experiment

Title: GitHub - DistributedDeepLearning/fairscale at tutorial-change · GitHub

Open Graph Title: GitHub - DistributedDeepLearning/fairscale at tutorial-change

X Title: GitHub - DistributedDeepLearning/fairscale at tutorial-change

Description: PyTorch extensions for high performance and large scale training. - GitHub - DistributedDeepLearning/fairscale at tutorial-change

Open Graph Description: PyTorch extensions for high performance and large scale training. - DistributedDeepLearning/fairscale

X Description: PyTorch extensions for high performance and large scale training. - DistributedDeepLearning/fairscale

Opengraph URL: https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change

X: @github

direct link

Domain: github.com

route-pattern	/:user_id/:repository/tree/name(/path)
route-controller	files
route-action	disambiguate
fetch-nonce	v2:10fd0a83-23d0-f304-cd8a-e285e26a8b10
current-catalog-service-hash	f3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-id	BDE8:9775E:5A5207F:7F566F4:6A500944
html-safe-nonce	c02993c28d4777be70acf87c93a924bb7ebbe52ad657b477b63a6d438b4c1bec
visitor-payload	eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJCREU4Ojk3NzVFOjVBNTIwN0Y6N0Y1NjZGNDo2QTUwMDk0NCIsInZpc2l0b3JfaWQiOiI3MDcyMjQxMTA4NzA1NjEwMDUyIiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0=
visitor-hmac	dbb8ccdfc1bf28de50063624566b3b10bfe0a71fddd8ce007f6597f1eebaba6f
hovercard-subject-tag	repository:510081987
github-keyboard-shortcuts	repository,source-code,file-tree,copilot
google-site-verification	Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-url	https://collector.github.com/github/collect
analytics-location	///files/disambiguate
fb:app_id	1401488693436528
apple-itunes-app	app-id=1477376905, app-argument=https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change
twitter:image	https://opengraph.githubassets.com/be3f135d5b3bed7ab61af7dea698e30a8435a8d0bcdcf09628d811ecfd9f5bc2/DistributedDeepLearning/fairscale
twitter:card	summary_large_image
og:image	https://opengraph.githubassets.com/be3f135d5b3bed7ab61af7dea698e30a8435a8d0bcdcf09628d811ecfd9f5bc2/DistributedDeepLearning/fairscale
og:image:alt	PyTorch extensions for high performance and large scale training. - DistributedDeepLearning/fairscale
og:image:width	1200
og:image:height	600
og:site_name	GitHub
og:type	object
hostname	github.com
expected-hostname	github.com
None	56eec25a3430492dd6ec2a480eb33256a0da5192d5714b0db4f5ab5f33203d94
turbo-cache-control	no-cache
go-import	github.com/DistributedDeepLearning/fairscale git https://github.com/DistributedDeepLearning/fairscale.git
octolytics-dimension-user_id	108561606
octolytics-dimension-user_login	DistributedDeepLearning
octolytics-dimension-repository_id	510081987
octolytics-dimension-repository_nwo	DistributedDeepLearning/fairscale
octolytics-dimension-repository_public	true
octolytics-dimension-repository_is_fork	true
octolytics-dimension-repository_parent_id	277899703
octolytics-dimension-repository_parent_nwo	facebookresearch/fairscale
octolytics-dimension-repository_network_root_id	277899703
octolytics-dimension-repository_network_root_nwo	facebookresearch/fairscale
turbo-body-classes	logged-out env-production page-responsive
disable-turbo	false
browser-stats-url	https://api.github.com/_private/browser/stats
browser-errors-url	https://api.github.com/_private/browser/errors
release	93a615b89b7dcbdb6b678f4772931ecc28ada82a
ui-target	full
theme-color	#1e2327
color-scheme	light dark

Links:

Skip to content	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change#start-of-content
	https://github.com/
Sign in	https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FDistributedDeepLearning%2Ffairscale%2Ftree%2Ftutorial-change
GitHub CopilotWrite better code with AI	https://github.com/features/copilot
GitHub Copilot appDirect agents from issue to merge	https://github.com/features/ai/github-app
MCP RegistryNewIntegrate external tools	https://github.com/mcp
ActionsAutomate any workflow	https://github.com/features/actions
CodespacesInstant dev environments	https://github.com/features/codespaces
IssuesPlan and track work	https://github.com/features/issues
Code ReviewManage code changes	https://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilities	https://github.com/security/advanced-security
Code securitySecure your code as you build	https://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they start	https://github.com/security/advanced-security/secret-protection
Why GitHub	https://github.com/why-github
Documentation	https://docs.github.com
Blog	https://github.blog
Changelog	https://github.blog/changelog
Marketplace	https://github.com/marketplace
View all features	https://github.com/features
Enterprises	https://github.com/enterprise
Small and medium teams	https://github.com/team
Startups	https://github.com/enterprise/startups
Nonprofits	https://github.com/solutions/industry/nonprofits
App Modernization	https://github.com/solutions/use-case/app-modernization
DevSecOps	https://github.com/solutions/use-case/devsecops
DevOps	https://github.com/solutions/use-case/devops
CI/CD	https://github.com/solutions/use-case/ci-cd
View all use cases	https://github.com/solutions/use-case
Healthcare	https://github.com/solutions/industry/healthcare
Financial services	https://github.com/solutions/industry/financial-services
Manufacturing	https://github.com/solutions/industry/manufacturing
Government	https://github.com/solutions/industry/government
View all industries	https://github.com/solutions/industry
View all solutions	https://github.com/solutions
AI	https://github.com/resources/articles?topic=ai
Software Development	https://github.com/resources/articles?topic=software-development
DevOps	https://github.com/resources/articles?topic=devops
Security	https://github.com/resources/articles?topic=security
View all topics	https://github.com/resources/articles
Customer stories	https://github.com/customer-stories
Events & webinars	https://github.com/resources/events
Ebooks & reports	https://github.com/resources/whitepapers
Business insights	https://github.com/solutions/executive-insights
GitHub Skills	https://skills.github.com
Documentation	https://docs.github.com
Customer support	https://support.github.com
Community forum	https://github.com/orgs/community/discussions
Trust center	https://github.com/trust-center
Partners	https://github.com/partners
View all resources	https://github.com/resources
GitHub SponsorsFund open source developers	https://github.com/open-source/sponsors
Security Lab	https://securitylab.github.com
Maintainer Community	https://maintainers.github.com
Accelerator	https://github.com/open-source/accelerator
GitHub Stars	https://stars.github.com
Archive Program	https://archiveprogram.github.com
Topics	https://github.com/topics
Trending	https://github.com/trending
Collections	https://github.com/collections
Enterprise platformAI-powered developer platform	https://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security features	https://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI features	https://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 support	https://github.com/enterprise/premium-support
Pricing	https://github.com/pricing
Search syntax tips	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentation	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in	https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FDistributedDeepLearning%2Ffairscale%2Ftree%2Ftutorial-change
Sign up	https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Ffiles%2Fdisambiguate&source=header-repo&source_repo=DistributedDeepLearning%2Ffairscale
Reload	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change
Reload	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change
Reload	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change
Please reload this page	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change
DistributedDeepLearning	https://github.com/DistributedDeepLearning
fairscale	https://github.com/DistributedDeepLearning/fairscale
facebookresearch/fairscale	https://github.com/facebookresearch/fairscale
Notifications	https://github.com/login?return_to=%2FDistributedDeepLearning%2Ffairscale
Fork 0	https://github.com/login?return_to=%2FDistributedDeepLearning%2Ffairscale
Star 0	https://github.com/login?return_to=%2FDistributedDeepLearning%2Ffairscale
Code	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change
Pull requests 0	https://github.com/DistributedDeepLearning/fairscale/pulls
Actions	https://github.com/DistributedDeepLearning/fairscale/actions
Projects	https://github.com/DistributedDeepLearning/fairscale/projects
Security and quality 0	https://github.com/DistributedDeepLearning/fairscale/security
Insights	https://github.com/DistributedDeepLearning/fairscale/pulse
Code	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change
Pull requests	https://github.com/DistributedDeepLearning/fairscale/pulls
Actions	https://github.com/DistributedDeepLearning/fairscale/actions
Projects	https://github.com/DistributedDeepLearning/fairscale/projects
Security and quality	https://github.com/DistributedDeepLearning/fairscale/security
Insights	https://github.com/DistributedDeepLearning/fairscale/pulse
	https://github.com/DistributedDeepLearning/fairscale
Branches	https://github.com/DistributedDeepLearning/fairscale/branches
Tags	https://github.com/DistributedDeepLearning/fairscale/tags
	https://github.com/DistributedDeepLearning/fairscale/branches
	https://github.com/DistributedDeepLearning/fairscale/tags
378 Commits	https://github.com/DistributedDeepLearning/fairscale/commits/tutorial-change/
	https://github.com/DistributedDeepLearning/fairscale/commits/tutorial-change/
.circleci	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change/.circleci
.circleci	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change/.circleci
.github	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change/.github
.github	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change/.github
benchmarks	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change/benchmarks
benchmarks	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change/benchmarks
conda.recipe	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change/conda.recipe
conda.recipe	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change/conda.recipe
docs	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change/docs
docs	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change/docs
examples	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change/examples
examples	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change/examples
fairscale	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change/fairscale
fairscale	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change/fairscale
stubs/torch	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change/stubs/torch
stubs/torch	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change/stubs/torch
tests	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change/tests
tests	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change/tests
.codecov.yml	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/.codecov.yml
.codecov.yml	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/.codecov.yml
.coveragerc	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/.coveragerc
.coveragerc	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/.coveragerc
.editorconfig	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/.editorconfig
.editorconfig	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/.editorconfig
.gitignore	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/.gitignore
.gitignore	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/.gitignore
.pre-commit-config.yaml	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/.pre-commit-config.yaml
.pre-commit-config.yaml	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/.pre-commit-config.yaml
CHANGELOG.md	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/CHANGELOG.md
CHANGELOG.md	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/CHANGELOG.md
CODE_OF_CONDUCT.md	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/CODE_OF_CONDUCT.md
CODE_OF_CONDUCT.md	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/CODE_OF_CONDUCT.md
CONTRIBUTING.md	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/CONTRIBUTING.md
CONTRIBUTING.md	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/CONTRIBUTING.md
LICENSE	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/LICENSE
LICENSE	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/LICENSE
MANIFEST.in	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/MANIFEST.in
MANIFEST.in	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/MANIFEST.in
NOTICE	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/NOTICE
NOTICE	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/NOTICE
README.md	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/README.md
README.md	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/README.md
RELEASE.md	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/RELEASE.md
RELEASE.md	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/RELEASE.md
pyproject.toml	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/pyproject.toml
pyproject.toml	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/pyproject.toml
requirements-benchmarks.txt	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/requirements-benchmarks.txt
requirements-benchmarks.txt	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/requirements-benchmarks.txt
requirements-dev.txt	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/requirements-dev.txt
requirements-dev.txt	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/requirements-dev.txt
requirements-test.txt	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/requirements-test.txt
requirements-test.txt	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/requirements-test.txt
requirements.txt	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/requirements.txt
requirements.txt	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/requirements.txt
setup.cfg	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/setup.cfg
setup.cfg	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/setup.cfg
setup.py	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/setup.py
setup.py	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/setup.py
README	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change
Code of conduct	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change
Contributing	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change
License	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change
	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/docs/source/_static/img/fairscale-logo.png
	https://camo.githubusercontent.com/2b2b694391a5dbb38f9832aa3ff8571255cc0c7a0cf632358876a3dc8afb7b04/68747470733a2f2f696d672e736869656c64732e696f2f707970692f762f666169727363616c65
	https://fairscale.readthedocs.io/en/latest/?badge=latest
	https://app.circleci.com/pipelines/github/facebookresearch/fairscale/
	https://camo.githubusercontent.com/eb73d51c9d9c29910d74bd6c3969adc2126cca68219448d256f3a5cc5fcb0b73/68747470733a2f2f696d672e736869656c64732e696f2f707970692f6c2f666169727363616c65
	https://github.com/facebookresearch/fairscale/blob/master/CONTRIBUTING.md
	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change#--
	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change#description
	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change#requirements
	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change#installation
	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change#getting-started
https://fairscale.readthedocs.io/	https://fairscale.readthedocs.io/
	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change#examples
	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change#pipe
	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change#optimizer-state-sharding-zero
here	https://github.com/facebookresearch/fairscale/blob/master/benchmarks/oss.py
	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change#adascale-sgd
	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change#testing
issue	https://github.com/facebookresearch/fairscale/issues
	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change#contributors
CONTRIBUTING	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/CONTRIBUTING.md
	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change#license
BSD-3-Clause License	https://github.com/DistributedDeepLearning/fairscale/blob/tutorial-change/LICENSE
torchgpipe	https://github.com/kakaobrain/torchgpipe
Apache License	http://www.apache.org/licenses/LICENSE-2.0
Megatron-LM	https://github.com/NVIDIA/Megatron-LM
Apache License	http://www.apache.org/licenses/LICENSE-2.0
AdaptDL	https://github.com/petuum/adaptdl
Apache License	http://www.apache.org/licenses/LICENSE-2.0
PyTorch-Reparam-Module	https://github.com/SsnL/PyTorch-Reparam-Module
MIT License	https://github.com/SsnL/PyTorch-Reparam-Module/blob/master/LICENSE
	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change#references
Paper	https://arxiv.org/pdf/2004.09910.pdf
Code	https://github.com/kakaobrain/torchgpipe
Paper	https://arxiv.org/pdf/1910.02054.pdf
Code	https://github.com/microsoft/DeepSpeed
Paper	https://arxiv.org/pdf/1909.08053.pdf
Code	https://github.com/NVIDIA/Megatron-LM
Paper	https://proceedings.icml.cc/static/paper_files/icml/2020/4682-Paper.pdf
[Paper]	https://arxiv.org/abs/2006.16668
[Paper]	https://arxiv.org/abs/1705.09786
Readme	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change#readme-ov-file
View license	https://github.com/DistributedDeepLearning/fairscale/blob/main/LICENSE
Code of conduct	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change#coc-ov-file
Contributing	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change#contributing-ov-file
Please reload this page	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change
Activity	https://github.com/DistributedDeepLearning/fairscale/activity
Custom properties	https://github.com/DistributedDeepLearning/fairscale/custom-properties
0 forks	https://github.com/DistributedDeepLearning/fairscale/forks
Report repository	https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2FDistributedDeepLearning%2Ffairscale&report=DistributedDeepLearning+%28user%29
Releases	https://github.com/DistributedDeepLearning/fairscale/releases
30 tags	https://github.com/DistributedDeepLearning/fairscale/tags
Packages 0	https://github.com/orgs/DistributedDeepLearning/packages?repo_name=fairscale
Please reload this page	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change
Contributors	https://github.com/DistributedDeepLearning/fairscale/graphs/contributors
Please reload this page	https://github.com/DistributedDeepLearning/fairscale/tree/tutorial-change
	https://github.com
Terms	https://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacy	https://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Security	https://github.com/security
Status	https://www.githubstatus.com/
Community	https://github.community/
Docs	https://docs.github.com/
Contact	https://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.