René's URL Explorer Experiment

Title: History for docs/_tutorials - DistributedDeepLearning/DeepSpeed · GitHub

Open Graph Title: History for docs/_tutorials - DistributedDeepLearning/DeepSpeed

X Title: History for docs/_tutorials - DistributedDeepLearning/DeepSpeed

Description: DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective. - History for docs/_tutorials - DistributedDeepLearning/DeepSpeed

Open Graph Description: DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective. - History for docs/_tutorials - DistributedDeepLearning/DeepSpeed

X Description: DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective. - History for docs/_tutorials - DistributedDeepLearning/DeepSpeed

Opengraph URL: https://github.com/DistributedDeepLearning/DeepSpeed

X: @github

direct link

Domain: github.com

route-pattern	/:user_id/:repository/commits(/*name)
route-controller	commits
route-action	show
fetch-nonce	v2:71af2514-79ee-5880-c6ea-133e08551d08
current-catalog-service-hash	f3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-id	9C26:381ACD:4352E6C:5DC690D:6A50C748
html-safe-nonce	f0475e52474f94923b8d708d2354aa9c70b56c44883cb0e69a75aadaa63a147e
visitor-payload	eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI5QzI2OjM4MUFDRDo0MzUyRTZDOjVEQzY5MEQ6NkE1MEM3NDgiLCJ2aXNpdG9yX2lkIjoiMTY1MDczMDU1ODQxNjc5OTU2MSIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmac	8c98779db9710586ab0b84559d3f84e15ebaad3eaf450e0bd8e1288f78f97cb8
hovercard-subject-tag	repository:510079179
github-keyboard-shortcuts	repository,commit-list,copilot
google-site-verification	Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-url	https://collector.github.com/github/collect
analytics-location	///commits/show
fb:app_id	1401488693436528
apple-itunes-app	app-id=1477376905, app-argument=https://github.com/DistributedDeepLearning/DeepSpeed/commits/master/docs/_tutorials
twitter:image	https://opengraph.githubassets.com/833afe2fb91999facb09646f085f330e5b2b02dfc738744bc501c02e081cebb5/DistributedDeepLearning/DeepSpeed
twitter:card	summary_large_image
og:image	https://opengraph.githubassets.com/833afe2fb91999facb09646f085f330e5b2b02dfc738744bc501c02e081cebb5/DistributedDeepLearning/DeepSpeed
og:image:alt	DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective. - History for docs/_tutorials - DistributedDeepLearning/DeepSpeed
og:image:width	1200
og:image:height	600
og:site_name	GitHub
og:type	object
hostname	github.com
expected-hostname	github.com
None	72b13e0e8d0319acdd27a145cfe73f4f06c791713d0ac4690e41fb68ad28cac0
turbo-cache-control	no-cache
go-import	github.com/DistributedDeepLearning/DeepSpeed git https://github.com/DistributedDeepLearning/DeepSpeed.git
octolytics-dimension-user_id	108561606
octolytics-dimension-user_login	DistributedDeepLearning
octolytics-dimension-repository_id	510079179
octolytics-dimension-repository_nwo	DistributedDeepLearning/DeepSpeed
octolytics-dimension-repository_public	true
octolytics-dimension-repository_is_fork	true
octolytics-dimension-repository_parent_id	235860204
octolytics-dimension-repository_parent_nwo	deepspeedai/DeepSpeed
octolytics-dimension-repository_network_root_id	235860204
octolytics-dimension-repository_network_root_nwo	deepspeedai/DeepSpeed
turbo-body-classes	logged-out env-production page-responsive
disable-turbo	false
browser-stats-url	https://api.github.com/_private/browser/stats
browser-errors-url	https://api.github.com/_private/browser/errors
release	08e79d53fc070870d5b168356afebb1e286a2ffe
ui-target	full
theme-color	#1e2327
color-scheme	light dark

Links:

Skip to content	https://github.com/DistributedDeepLearning/DeepSpeed/commits/master/docs/_tutorials#start-of-content
	https://github.com/
Sign in	https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FDistributedDeepLearning%2FDeepSpeed%2Fcommits%2Fmaster%2Fdocs%2F_tutorials
GitHub CopilotWrite better code with AI	https://github.com/features/copilot
GitHub Copilot appDirect agents from issue to merge	https://github.com/features/ai/github-app
MCP RegistryNewIntegrate external tools	https://github.com/mcp
ActionsAutomate any workflow	https://github.com/features/actions
CodespacesInstant dev environments	https://github.com/features/codespaces
IssuesPlan and track work	https://github.com/features/issues
Code ReviewManage code changes	https://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilities	https://github.com/security/advanced-security
Code securitySecure your code as you build	https://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they start	https://github.com/security/advanced-security/secret-protection
Why GitHub	https://github.com/why-github
Documentation	https://docs.github.com
Blog	https://github.blog
Changelog	https://github.blog/changelog
Marketplace	https://github.com/marketplace
View all features	https://github.com/features
Enterprises	https://github.com/enterprise
Small and medium teams	https://github.com/team
Startups	https://github.com/enterprise/startups
Nonprofits	https://github.com/solutions/industry/nonprofits
App Modernization	https://github.com/solutions/use-case/app-modernization
DevSecOps	https://github.com/solutions/use-case/devsecops
DevOps	https://github.com/solutions/use-case/devops
CI/CD	https://github.com/solutions/use-case/ci-cd
View all use cases	https://github.com/solutions/use-case
Healthcare	https://github.com/solutions/industry/healthcare
Financial services	https://github.com/solutions/industry/financial-services
Manufacturing	https://github.com/solutions/industry/manufacturing
Government	https://github.com/solutions/industry/government
View all industries	https://github.com/solutions/industry
View all solutions	https://github.com/solutions
AI	https://github.com/resources/articles?topic=ai
Software Development	https://github.com/resources/articles?topic=software-development
DevOps	https://github.com/resources/articles?topic=devops
Security	https://github.com/resources/articles?topic=security
View all topics	https://github.com/resources/articles
Customer stories	https://github.com/customer-stories
Events & webinars	https://github.com/resources/events
Ebooks & reports	https://github.com/resources/whitepapers
Business insights	https://github.com/solutions/executive-insights
GitHub Skills	https://skills.github.com
Documentation	https://docs.github.com
Customer support	https://support.github.com
Community forum	https://github.com/orgs/community/discussions
Trust center	https://github.com/trust-center
Partners	https://github.com/partners
View all resources	https://github.com/resources
GitHub SponsorsFund open source developers	https://github.com/open-source/sponsors
Security Lab	https://securitylab.github.com
Maintainer Community	https://maintainers.github.com
Accelerator	https://github.com/open-source/accelerator
GitHub Stars	https://stars.github.com
Archive Program	https://archiveprogram.github.com
Topics	https://github.com/topics
Trending	https://github.com/trending
Collections	https://github.com/collections
Enterprise platformAI-powered developer platform	https://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security features	https://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI features	https://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 support	https://github.com/enterprise/premium-support
Pricing	https://github.com/pricing
Search syntax tips	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentation	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in	https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FDistributedDeepLearning%2FDeepSpeed%2Fcommits%2Fmaster%2Fdocs%2F_tutorials
Sign up	https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fcommits%2Fshow&source=header-repo&source_repo=DistributedDeepLearning%2FDeepSpeed
Reload	https://github.com/DistributedDeepLearning/DeepSpeed/commits/master/docs/_tutorials
Reload	https://github.com/DistributedDeepLearning/DeepSpeed/commits/master/docs/_tutorials
Reload	https://github.com/DistributedDeepLearning/DeepSpeed/commits/master/docs/_tutorials
Please reload this page	https://github.com/DistributedDeepLearning/DeepSpeed/commits/master/docs/_tutorials
DistributedDeepLearning	https://github.com/DistributedDeepLearning
DeepSpeed	https://github.com/DistributedDeepLearning/DeepSpeed
deepspeedai/DeepSpeed	https://github.com/deepspeedai/DeepSpeed
Notifications	https://github.com/login?return_to=%2FDistributedDeepLearning%2FDeepSpeed
Fork 0	https://github.com/login?return_to=%2FDistributedDeepLearning%2FDeepSpeed
Star 0	https://github.com/login?return_to=%2FDistributedDeepLearning%2FDeepSpeed
Code	https://github.com/DistributedDeepLearning/DeepSpeed
Pull requests 0	https://github.com/DistributedDeepLearning/DeepSpeed/pulls
Actions	https://github.com/DistributedDeepLearning/DeepSpeed/actions
Projects	https://github.com/DistributedDeepLearning/DeepSpeed/projects
Security and quality 0	https://github.com/DistributedDeepLearning/DeepSpeed/security
Insights	https://github.com/DistributedDeepLearning/DeepSpeed/pulse
Code	https://github.com/DistributedDeepLearning/DeepSpeed
Pull requests	https://github.com/DistributedDeepLearning/DeepSpeed/pulls
Actions	https://github.com/DistributedDeepLearning/DeepSpeed/actions
Projects	https://github.com/DistributedDeepLearning/DeepSpeed/projects
Security and quality	https://github.com/DistributedDeepLearning/DeepSpeed/security
Insights	https://github.com/DistributedDeepLearning/DeepSpeed/pulse
DeepSpeed	https://github.com/DistributedDeepLearning/DeepSpeed/commits
docs	https://github.com/DistributedDeepLearning/DeepSpeed/commits/master/docs
_tutorials	https://github.com/DistributedDeepLearning/DeepSpeed/commits/master/docs/_tutorials
master	https://github.com/DistributedDeepLearning/DeepSpeed/tree/master
DeepSpeed Monitor Module (Master) (#2013)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/c87f6ee209e2fed141ac4e2e28d4169f159ea487
Quentin-Anthony	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=Quentin-Anthony
jeffra	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=jeffra
c87f6ee	https://github.com/DistributedDeepLearning/DeepSpeed/commit/c87f6ee209e2fed141ac4e2e28d4169f159ea487
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/c87f6ee209e2fed141ac4e2e28d4169f159ea487/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/c87f6ee209e2fed141ac4e2e28d4169f159ea487
Fix broken links (#1873)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/d6db6510526e05788c563d58d916734e9335f6ed
tjruwase	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=tjruwase
jeffra	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=jeffra
d6db651	https://github.com/DistributedDeepLearning/DeepSpeed/commit/d6db6510526e05788c563d58d916734e9335f6ed
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/d6db6510526e05788c563d58d916734e9335f6ed/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/d6db6510526e05788c563d58d916734e9335f6ed
fix dead MoQ link (#1855)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/208d45bbf7cbde2abfb233e7d10803553fbcf126
	https://github.com/jeffra
jeffra	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=jeffra
208d45b	https://github.com/DistributedDeepLearning/DeepSpeed/commit/208d45bbf7cbde2abfb233e7d10803553fbcf126
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/208d45bbf7cbde2abfb233e7d10803553fbcf126/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/208d45bbf7cbde2abfb233e7d10803553fbcf126
Website posts and tutorial improvements (#1799)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/908d61607271bc1b24a3e59e87076a0991a42bd4
cli99	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=cli99
jeffra	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=jeffra
908d616	https://github.com/DistributedDeepLearning/DeepSpeed/commit/908d61607271bc1b24a3e59e87076a0991a42bd4
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/908d61607271bc1b24a3e59e87076a0991a42bd4/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/908d61607271bc1b24a3e59e87076a0991a42bd4
01 adam optimizer (#1790)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/b80e5624e2823e3ad4a0bd625716eeb24921c6c9
b80e562	https://github.com/DistributedDeepLearning/DeepSpeed/commit/b80e5624e2823e3ad4a0bd625716eeb24921c6c9
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/b80e5624e2823e3ad4a0bd625716eeb24921c6c9/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/b80e5624e2823e3ad4a0bd625716eeb24921c6c9
[docker] simplify and update rocm dockerfile (#1819)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/ac71a1a461ca71a7bbe7a421c6b379f658d6bf78
	https://github.com/jeffra
jeffra	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=jeffra
ac71a1a	https://github.com/DistributedDeepLearning/DeepSpeed/commit/ac71a1a461ca71a7bbe7a421c6b379f658d6bf78
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/ac71a1a461ca71a7bbe7a421c6b379f658d6bf78/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/ac71a1a461ca71a7bbe7a421c6b379f658d6bf78
Minjiaz/mos doc (#1802)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/f0304bd1033075f8b6a0a166aa2e7f31343519b4
awan-10	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=awan-10
minjiaz	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=minjiaz
f0304bd	https://github.com/DistributedDeepLearning/DeepSpeed/commit/f0304bd1033075f8b6a0a166aa2e7f31343519b4
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/f0304bd1033075f8b6a0a166aa2e7f31343519b4/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/f0304bd1033075f8b6a0a166aa2e7f31343519b4
Refactor MoE and Groups API to simplify model creation and mangement (#1798)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/c0af6d90f7e63b14d9ccb68d51d42cadc60301da
c0af6d9	https://github.com/DistributedDeepLearning/DeepSpeed/commit/c0af6d90f7e63b14d9ccb68d51d42cadc60301da
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/c0af6d90f7e63b14d9ccb68d51d42cadc60301da/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/c0af6d90f7e63b14d9ccb68d51d42cadc60301da
Generalize the model input format of the flops profiler get_model_profile() API (#1768)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/2151c787a27166f795eb4516f1e191e6730e823d
2151c78	https://github.com/DistributedDeepLearning/DeepSpeed/commit/2151c787a27166f795eb4516f1e191e6730e823d
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/2151c787a27166f795eb4516f1e191e6730e823d/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/2151c787a27166f795eb4516f1e191e6730e823d
[Doc] Add async I/O op (#1754)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/4f96ffd9aba0abbce0582b27c75c5c4e76500856
tjruwase	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=tjruwase
jeffra	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=jeffra
4f96ffd	https://github.com/DistributedDeepLearning/DeepSpeed/commit/4f96ffd9aba0abbce0582b27c75c5c4e76500856
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/4f96ffd9aba0abbce0582b27c75c5c4e76500856/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/4f96ffd9aba0abbce0582b27c75c5c4e76500856
Fix the tensor-slicing with multi-GPU inference and kernel-injection (#1724)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/fa0735760a14a1d02df7949931e4caf6a33eeb0e
	https://github.com/RezaYazdaniAminabadi
RezaYazdaniAminabadi	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=RezaYazdaniAminabadi
fa07357	https://github.com/DistributedDeepLearning/DeepSpeed/commit/fa0735760a14a1d02df7949931e4caf6a33eeb0e
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/fa0735760a14a1d02df7949931e4caf6a33eeb0e/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/fa0735760a14a1d02df7949931e4caf6a33eeb0e
Add codespell to pre-commit checks (#1717)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/4cf970e6bb3c2ff29b2f03fcddb6f2cf26245a23
	https://github.com/aphedges
aphedges	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=aphedges
4cf970e	https://github.com/DistributedDeepLearning/DeepSpeed/commit/4cf970e6bb3c2ff29b2f03fcddb6f2cf26245a23
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/4cf970e6bb3c2ff29b2f03fcddb6f2cf26245a23/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/4cf970e6bb3c2ff29b2f03fcddb6f2cf26245a23
Various ZeRO Stage3 Optimizations + Improvements (including bfloat16 support) (#1453)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/4912e0ad7efcaf97389ae944259aa0e9f331038a
4912e0a	https://github.com/DistributedDeepLearning/DeepSpeed/commit/4912e0ad7efcaf97389ae944259aa0e9f331038a
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/4912e0ad7efcaf97389ae944259aa0e9f331038a/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/4912e0ad7efcaf97389ae944259aa0e9f331038a
Fix inference api & add more description on inference engine tutorial (#1711)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/94de0229fb0d835ca9f3019ff5195edb3c354910
	https://github.com/RezaYazdaniAminabadi
RezaYazdaniAminabadi	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=RezaYazdaniAminabadi
94de022	https://github.com/DistributedDeepLearning/DeepSpeed/commit/94de0229fb0d835ca9f3019ff5195edb3c354910
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/94de0229fb0d835ca9f3019ff5195edb3c354910/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/94de0229fb0d835ca9f3019ff5195edb3c354910
Add more context for the MoE Inference tutorial (#1707)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/e27a60a87993966bbb82281ca93fc8aacd63ff82
e27a60a	https://github.com/DistributedDeepLearning/DeepSpeed/commit/e27a60a87993966bbb82281ca93fc8aacd63ff82
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/e27a60a87993966bbb82281ca93fc8aacd63ff82/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/e27a60a87993966bbb82281ca93fc8aacd63ff82
pr moe tutorial creation (#1704)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/53fdadfb9ad0027bfc44b6c369bd4807e91a4741
yaozhewei	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=yaozhewei
jeffra	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=jeffra
53fdadf	https://github.com/DistributedDeepLearning/DeepSpeed/commit/53fdadfb9ad0027bfc44b6c369bd4807e91a4741
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/53fdadfb9ad0027bfc44b6c369bd4807e91a4741/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/53fdadfb9ad0027bfc44b6c369bd4807e91a4741
add moe-inference tutorial (#1706)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/38e16c696d1b8c4318cfcaf3656e795704a096fb
RezaYazdaniAminabadi	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=RezaYazdaniAminabadi
jeffra	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=jeffra
38e16c6	https://github.com/DistributedDeepLearning/DeepSpeed/commit/38e16c696d1b8c4318cfcaf3656e795704a096fb
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/38e16c696d1b8c4318cfcaf3656e795704a096fb/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/38e16c696d1b8c4318cfcaf3656e795704a096fb
update results about public Pile dataset (#1675)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/aca647991f7c7c4464965fe900d07d1a2a51ab58
	https://github.com/conglongli
conglongli	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=conglongli
aca6479	https://github.com/DistributedDeepLearning/DeepSpeed/commit/aca647991f7c7c4464965fe900d07d1a2a51ab58
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/aca647991f7c7c4464965fe900d07d1a2a51ab58/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/aca647991f7c7c4464965fe900d07d1a2a51ab58
Various small documentation text improvements (#1665)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/d0ab72242711636349609099316f93510c6a9079
manuelciosici	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=manuelciosici
jeffra	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=jeffra
d0ab722	https://github.com/DistributedDeepLearning/DeepSpeed/commit/d0ab72242711636349609099316f93510c6a9079
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/d0ab72242711636349609099316f93510c6a9079/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/d0ab72242711636349609099316f93510c6a9079
Add tensor methods in flops counting and separate macs and flops (#1591)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/082f392a939896e2fef782eabee2200b5e340902
cli99	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=cli99
jeffra	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=jeffra
082f392	https://github.com/DistributedDeepLearning/DeepSpeed/commit/082f392a939896e2fef782eabee2200b5e340902
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/082f392a939896e2fef782eabee2200b5e340902/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/082f392a939896e2fef782eabee2200b5e340902
MoE for NLG tutorial (#1633)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/c6ace162c438e755755d2b078589906480215ffc
	https://github.com/conglongli
conglongli	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=conglongli
c6ace16	https://github.com/DistributedDeepLearning/DeepSpeed/commit/c6ace162c438e755755d2b078589906480215ffc
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/c6ace162c438e755755d2b078589906480215ffc/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/c6ace162c438e755755d2b078589906480215ffc
Sparse Attention: Fix Triton errors (#1608)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/cda7c718954e22f22df222872400e29eaf5708c1
	https://github.com/pwstegman
pwstegman	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=pwstegman
cda7c71	https://github.com/DistributedDeepLearning/DeepSpeed/commit/cda7c718954e22f22df222872400e29eaf5708c1
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/cda7c718954e22f22df222872400e29eaf5708c1/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/cda7c718954e22f22df222872400e29eaf5708c1
Improve pre-commit hooks (#1602)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/fc2f378ece3055fddd13cdf309faa9ab66a1b302
aphedges	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=aphedges
jeffra	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=jeffra
fc2f378	https://github.com/DistributedDeepLearning/DeepSpeed/commit/fc2f378ece3055fddd13cdf309faa9ab66a1b302
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/fc2f378ece3055fddd13cdf309faa9ab66a1b302/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/fc2f378ece3055fddd13cdf309faa9ab66a1b302
force set lf instead of crlf (https://github.com/pre-commit/pre-commit-hooks#mixed-line-ending) (#1598)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/a10e4811fe78b707289132c9695bade4715fe59b
	https://github.com/jeffra
jeffra	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=jeffra
a10e481	https://github.com/DistributedDeepLearning/DeepSpeed/commit/a10e4811fe78b707289132c9695bade4715fe59b
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/a10e4811fe78b707289132c9695bade4715fe59b/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/a10e4811fe78b707289132c9695bade4715fe59b
Add autotuning news post (#1565)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/bda3d0e6b98734c3dd8bef48c71bd4498b2a2dff
	https://github.com/cli99
cli99	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=cli99
bda3d0e	https://github.com/DistributedDeepLearning/DeepSpeed/commit/bda3d0e6b98734c3dd8bef48c71bd4498b2a2dff
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/bda3d0e6b98734c3dd8bef48c71bd4498b2a2dff/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/bda3d0e6b98734c3dd8bef48c71bd4498b2a2dff
Autotuning (#1554)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/9caa74e577c59fa6cf5de3992ea129c979dbad13
9caa74e	https://github.com/DistributedDeepLearning/DeepSpeed/commit/9caa74e577c59fa6cf5de3992ea129c979dbad13
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/9caa74e577c59fa6cf5de3992ea129c979dbad13/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/9caa74e577c59fa6cf5de3992ea129c979dbad13
[docs] fix 404 (#1531)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/76f2b5e51d8cf68d1966dceaf1a562a6f02d73fb
	https://github.com/stas00
stas00	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=stas00
76f2b5e	https://github.com/DistributedDeepLearning/DeepSpeed/commit/76f2b5e51d8cf68d1966dceaf1a562a6f02d73fb
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/76f2b5e51d8cf68d1966dceaf1a562a6f02d73fb/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/76f2b5e51d8cf68d1966dceaf1a562a6f02d73fb
update CL doc (#1506)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/7f5a3addb648f981377eee8c4a3a2d7f2472a548
	https://github.com/conglongli
conglongli	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=conglongli
7f5a3ad	https://github.com/DistributedDeepLearning/DeepSpeed/commit/7f5a3addb648f981377eee8c4a3a2d7f2472a548
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/7f5a3addb648f981377eee8c4a3a2d7f2472a548/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/7f5a3addb648f981377eee8c4a3a2d7f2472a548
[docs] Update DSE Megatron links (#1500)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/a4fff53d4611d425fa42be7ee311111d7fb25c3e
tjruwase	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=tjruwase
jeffra	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=jeffra
a4fff53	https://github.com/DistributedDeepLearning/DeepSpeed/commit/a4fff53d4611d425fa42be7ee311111d7fb25c3e
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/a4fff53d4611d425fa42be7ee311111d7fb25c3e/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/a4fff53d4611d425fa42be7ee311111d7fb25c3e
[docs] 530b update (#1447)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/57a9954240c46b9bc75b3760ddb5a3ce5a3f4c19
	https://github.com/jeffra
jeffra	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=jeffra
57a9954	https://github.com/DistributedDeepLearning/DeepSpeed/commit/57a9954240c46b9bc75b3760ddb5a3ce5a3f4c19
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/57a9954240c46b9bc75b3760ddb5a3ce5a3f4c19/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/57a9954240c46b9bc75b3760ddb5a3ce5a3f4c19
Fix many typos (#1423)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/be789b1665b8cafbd1b865534da501b3b287b17f
aphedges	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=aphedges
tjruwase	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=tjruwase
be789b1	https://github.com/DistributedDeepLearning/DeepSpeed/commit/be789b1665b8cafbd1b865534da501b3b287b17f
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/be789b1665b8cafbd1b865534da501b3b287b17f/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/be789b1665b8cafbd1b865534da501b3b287b17f
Improve inference documentation (#1421)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/aa8d97e6050ae5d748bb2cc93dc081f5cde22c45
	https://github.com/aphedges
aphedges	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=aphedges
aa8d97e	https://github.com/DistributedDeepLearning/DeepSpeed/commit/aa8d97e6050ae5d748bb2cc93dc081f5cde22c45
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/aa8d97e6050ae5d748bb2cc93dc081f5cde22c45/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/aa8d97e6050ae5d748bb2cc93dc081f5cde22c45
add tutorial on pytorch profiler usage (#1350)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/51a2e916b730cf676c66532b19d973a603377cb0
51a2e91	https://github.com/DistributedDeepLearning/DeepSpeed/commit/51a2e916b730cf676c66532b19d973a603377cb0
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/51a2e916b730cf676c66532b19d973a603377cb0/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/51a2e916b730cf676c66532b19d973a603377cb0
DeepSpeed MoE (#1310)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/f28432441bae1020157407a4eca1661e9fe35164
f284324	https://github.com/DistributedDeepLearning/DeepSpeed/commit/f28432441bae1020157407a4eca1661e9fe35164
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/f28432441bae1020157407a4eca1661e9fe35164/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/f28432441bae1020157407a4eca1661e9fe35164
Curriculum learning (#1307)	https://github.com/DistributedDeepLearning/DeepSpeed/commit/b2b34ae342d6f851226e995f2e1021d12e761093
conglongli	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=conglongli
jeffra	https://github.com/DistributedDeepLearning/DeepSpeed/commits?author=jeffra
b2b34ae	https://github.com/DistributedDeepLearning/DeepSpeed/commit/b2b34ae342d6f851226e995f2e1021d12e761093
	https://github.com/DistributedDeepLearning/DeepSpeed/blob/b2b34ae342d6f851226e995f2e1021d12e761093/docs/_tutorials
	https://github.com/DistributedDeepLearning/DeepSpeed/tree/b2b34ae342d6f851226e995f2e1021d12e761093
Next	https://github.com/DistributedDeepLearning/DeepSpeed/commits/master/docs/_tutorials?after=9b70ce56e7af89d5226f9b06ebe1137407f371dc+34
	https://github.com
Terms	https://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacy	https://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Security	https://github.com/security
Status	https://www.githubstatus.com/
Community	https://github.community/
Docs	https://docs.github.com/
Contact	https://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.