René's URL Explorer Experiment


Title: History for bing_bert - DistributedDeepLearning/DeepSpeedExamples · GitHub

Open Graph Title: History for bing_bert - DistributedDeepLearning/DeepSpeedExamples

X Title: History for bing_bert - DistributedDeepLearning/DeepSpeedExamples

Description: Example models using DeepSpeed. Contribute to DistributedDeepLearning/DeepSpeedExamples development by creating an account on GitHub.

Open Graph Description: Example models using DeepSpeed. Contribute to DistributedDeepLearning/DeepSpeedExamples development by creating an account on GitHub.

X Description: Example models using DeepSpeed. Contribute to DistributedDeepLearning/DeepSpeedExamples development by creating an account on GitHub.

Opengraph URL: https://github.com/DistributedDeepLearning/DeepSpeedExamples

X: @github

direct link

Domain: github.com

route-pattern/:user_id/:repository/commits(/*name)
route-controllercommits
route-actionshow
fetch-noncev2:3bf699ea-390b-0505-4b4d-d738522ea7c0
current-catalog-service-hashf3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-idC26A:622FF:2156C:308A5:6A4E22E3
html-safe-nonce41a6db4ea1ddecebf37f39fe41d68fde987743569eacd60128c370a350be3fe6
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJDMjZBOjYyMkZGOjIxNTZDOjMwOEE1OjZBNEUyMkUzIiwidmlzaXRvcl9pZCI6Ijg0NzM3NTU3OTI4NTEyMTUwNzUiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmac6d451fea69f966b42888803b6fa7b2dca39db3166279c20a6dee65aeb5bc6809
hovercard-subject-tagrepository:509726896
github-keyboard-shortcutsrepository,commit-list,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///commits/show
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/DistributedDeepLearning/DeepSpeedExamples/commits/master/bing_bert
twitter:imagehttps://opengraph.githubassets.com/27b4710cf7fa95a90856d840988b5c9e22d772cd2fc6b98f2ef3957f64d3dfbc/DistributedDeepLearning/DeepSpeedExamples
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/27b4710cf7fa95a90856d840988b5c9e22d772cd2fc6b98f2ef3957f64d3dfbc/DistributedDeepLearning/DeepSpeedExamples
og:image:altExample models using DeepSpeed. Contribute to DistributedDeepLearning/DeepSpeedExamples development by creating an account on GitHub.
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None030096ee0db095447bfe77409d33bfac127ca7128299c58deef27c52eaa1b1f0
turbo-cache-controlno-cache
go-importgithub.com/DistributedDeepLearning/DeepSpeedExamples git https://github.com/DistributedDeepLearning/DeepSpeedExamples.git
octolytics-dimension-user_id108561606
octolytics-dimension-user_loginDistributedDeepLearning
octolytics-dimension-repository_id509726896
octolytics-dimension-repository_nwoDistributedDeepLearning/DeepSpeedExamples
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forktrue
octolytics-dimension-repository_parent_id237085793
octolytics-dimension-repository_parent_nwodeepspeedai/DeepSpeedExamples
octolytics-dimension-repository_network_root_id237085793
octolytics-dimension-repository_network_root_nwodeepspeedai/DeepSpeedExamples
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release5fe497b4815fcce3df76c0e246faa739a82c3124
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits/master/bing_bert#start-of-content
https://github.com/
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FDistributedDeepLearning%2FDeepSpeedExamples%2Fcommits%2Fmaster%2Fbing_bert
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub Copilot appDirect agents from issue to mergehttps://github.com/features/ai/github-app
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
View all resourceshttps://github.com/resources
GitHub SponsorsFund open source developershttps://github.com/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/accelerator
GitHub Starshttps://stars.github.com
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FDistributedDeepLearning%2FDeepSpeedExamples%2Fcommits%2Fmaster%2Fbing_bert
Sign up https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fcommits%2Fshow&source=header-repo&source_repo=DistributedDeepLearning%2FDeepSpeedExamples
Reloadhttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits/master/bing_bert
Reloadhttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits/master/bing_bert
Reloadhttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits/master/bing_bert
Please reload this pagehttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits/master/bing_bert
DistributedDeepLearning https://github.com/DistributedDeepLearning
DeepSpeedExampleshttps://github.com/DistributedDeepLearning/DeepSpeedExamples
deepspeedai/DeepSpeedExampleshttps://github.com/deepspeedai/DeepSpeedExamples
Notifications https://github.com/login?return_to=%2FDistributedDeepLearning%2FDeepSpeedExamples
Fork 0 https://github.com/login?return_to=%2FDistributedDeepLearning%2FDeepSpeedExamples
Star 0 https://github.com/login?return_to=%2FDistributedDeepLearning%2FDeepSpeedExamples
Code https://github.com/DistributedDeepLearning/DeepSpeedExamples
Pull requests 0 https://github.com/DistributedDeepLearning/DeepSpeedExamples/pulls
Actions https://github.com/DistributedDeepLearning/DeepSpeedExamples/actions
Projects https://github.com/DistributedDeepLearning/DeepSpeedExamples/projects
Security and quality 0 https://github.com/DistributedDeepLearning/DeepSpeedExamples/security
Insights https://github.com/DistributedDeepLearning/DeepSpeedExamples/pulse
Code https://github.com/DistributedDeepLearning/DeepSpeedExamples
Pull requests https://github.com/DistributedDeepLearning/DeepSpeedExamples/pulls
Actions https://github.com/DistributedDeepLearning/DeepSpeedExamples/actions
Projects https://github.com/DistributedDeepLearning/DeepSpeedExamples/projects
Security and quality https://github.com/DistributedDeepLearning/DeepSpeedExamples/security
Insights https://github.com/DistributedDeepLearning/DeepSpeedExamples/pulse
DeepSpeedExampleshttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits
bing_berthttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits/master/bing_bert
masterhttps://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/master
01 adam optimizer example scripts (#164)https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/4f064fbe71d12c57c16d9b35493f0572e604def8
EugeneLYChttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=EugeneLYC
conglonglihttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=conglongli
4f064fbhttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/4f064fbe71d12c57c16d9b35493f0572e604def8
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/4f064fbe71d12c57c16d9b35493f0572e604def8/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/4f064fbe71d12c57c16d9b35493f0572e604def8
1-bit LAMB optimizer example scripts (#97)https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/f94591eadab23c39e5b361142bb04ec1f752330d
https://github.com/conglongli
conglonglihttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=conglongli
f94591ehttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/f94591eadab23c39e5b361142bb04ec1f752330d
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/f94591eadab23c39e5b361142bb04ec1f752330d/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/f94591eadab23c39e5b361142bb04ec1f752330d
1-bit Adam v2 example scripts (#89)https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/590364d482b592c3a8a44c28141a8139c7918c55
https://github.com/conglongli
conglonglihttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=conglongli
590364dhttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/590364d482b592c3a8a44c28141a8139c7918c55
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/590364d482b592c3a8a44c28141a8139c7918c55/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/590364d482b592c3a8a44c28141a8139c7918c55
Fix transformer kernel call parameters (#81)https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/fde14be9241220e1c99c653c2c38394c9f3748b7
https://github.com/RezaYazdaniAminabadi
RezaYazdaniAminabadihttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=RezaYazdaniAminabadi
fde14behttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/fde14be9241220e1c99c653c2c38394c9f3748b7
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/fde14be9241220e1c99c653c2c38394c9f3748b7/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/fde14be9241220e1c99c653c2c38394c9f3748b7
Add deepspeed for the glue finetuning tasks & bert-large scripts (#77)https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/400cd1bc3524507301f39c659d3069672c4ab464
https://github.com/RezaYazdaniAminabadi
RezaYazdaniAminabadihttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=RezaYazdaniAminabadi
400cd1bhttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/400cd1bc3524507301f39c659d3069672c4ab464
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/400cd1bc3524507301f39c659d3069672c4ab464/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/400cd1bc3524507301f39c659d3069672c4ab464
additional no-decay keys for deepspeed transformer kernel (#75)https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/2d4282b2062018c6862d8050cdd6bf793bec5f21
https://github.com/hxbloom
hxbloomhttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=hxbloom
2d4282bhttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/2d4282b2062018c6862d8050cdd6bf793bec5f21
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/2d4282b2062018c6862d8050cdd6bf793bec5f21/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/2d4282b2062018c6862d8050cdd6bf793bec5f21
add local rank explicitly for mpirun (#72)https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/4fc78486cb001e4cb7e970e49954950198dd86b4
szhengachttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=szhengac
4fc7848https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/4fc78486cb001e4cb7e970e49954950198dd86b4
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/4fc78486cb001e4cb7e970e49954950198dd86b4/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/4fc78486cb001e4cb7e970e49954950198dd86b4
updates across examples to use deepspeed.init_distributed() (see #608) (#71)https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/78d69cb2f89a27b1e9b072df8c3e47d00c024fdc
https://github.com/jeffra
jeffrahttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=jeffra
78d69cbhttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/78d69cb2f89a27b1e9b072df8c3e47d00c024fdc
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/78d69cb2f89a27b1e9b072df8c3e47d00c024fdc/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/78d69cb2f89a27b1e9b072df8c3e47d00c024fdc
modify scripts for fixing the deepspeed-transformer interface (#69)https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/abb270641ca8c33476282bde29916c395a060ae9
https://github.com/RezaYazdaniAminabadi
RezaYazdaniAminabadihttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=RezaYazdaniAminabadi
abb2706https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/abb270641ca8c33476282bde29916c395a060ae9
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/abb270641ca8c33476282bde29916c395a060ae9/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/abb270641ca8c33476282bde29916c395a060ae9
Fix small mistake in mpi script.https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/35b4582486fe096a5c669b6ca35a3d5c6a1ec56b
https://github.com/awan-10
awan-10https://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=awan-10
35b4582https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/35b4582486fe096a5c669b6ca35a3d5c6a1ec56b
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/35b4582486fe096a5c669b6ca35a3d5c6a1ec56b/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/35b4582486fe096a5c669b6ca35a3d5c6a1ec56b
config fixes for one bit adam example (#63)https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/a3cfec7c0f4aeaee2f0bb0f52b21dbf9637ac4f2
https://github.com/conglongli
conglonglihttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=conglongli
a3cfec7https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/a3cfec7c0f4aeaee2f0bb0f52b21dbf9637ac4f2
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/a3cfec7c0f4aeaee2f0bb0f52b21dbf9637ac4f2/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/a3cfec7c0f4aeaee2f0bb0f52b21dbf9637ac4f2
PLD Client (#61) (#62)https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/fa1d1a71c48623db8a091d9cf636a5fe3b8f43c7
tjruwasehttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=tjruwase
minjiazhttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=minjiaz
fa1d1a7https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/fa1d1a71c48623db8a091d9cf636a5fe3b8f43c7
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/fa1d1a71c48623db8a091d9cf636a5fe3b8f43c7/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/fa1d1a71c48623db8a091d9cf636a5fe3b8f43c7
Fix fp32 model undefined var bug (#54)https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/552393506df35c0610d012d9826d6e0bdaa07d11
https://github.com/tjruwase
tjruwasehttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=tjruwase
5523935https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/552393506df35c0610d012d9826d6e0bdaa07d11
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/552393506df35c0610d012d9826d6e0bdaa07d11/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/552393506df35c0610d012d9826d6e0bdaa07d11
add intermediate size in the transformer config (#47)https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/ba63ad0fa861d28b3b33bc2c20f702647403e258
https://github.com/RezaYazdaniAminabadi
RezaYazdaniAminabadihttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=RezaYazdaniAminabadi
ba63ad0https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/ba63ad0fa861d28b3b33bc2c20f702647403e258
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/ba63ad0fa861d28b3b33bc2c20f702647403e258/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/ba63ad0fa861d28b3b33bc2c20f702647403e258
1-bit Adam examples/tutorial (#49)https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/38f09520ab05cd1a928288f6d74428c2549a163c
38f0952https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/38f09520ab05cd1a928288f6d74428c2549a163c
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/38f09520ab05cd1a928288f6d74428c2549a163c/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/38f09520ab05cd1a928288f6d74428c2549a163c
Add sparse attention example (#36)https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/896831c96266e12612c3e7a923d04e68d1f4dd84
jeffrahttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=jeffra
arashasharihttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=arashashari
896831chttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/896831c96266e12612c3e7a923d04e68d1f4dd84
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/896831c96266e12612c3e7a923d04e68d1f4dd84/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/896831c96266e12612c3e7a923d04e68d1f4dd84
add codeowners and remove deepspeed.pt refs (#33)https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/2346cb39106dad3ff4f9a021b4c734f4df76ba99
https://github.com/jeffra
jeffrahttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=jeffra
2346cb3https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/2346cb39106dad3ff4f9a021b4c734f4df76ba99
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/2346cb39106dad3ff4f9a021b4c734f4df76ba99/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/2346cb39106dad3ff4f9a021b4c734f4df76ba99
bring back turing.sources imports (#30)https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/fd869ae1c9de686f8cb92413efeba83fc989027c
conglonglihttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=conglongli
jeffrahttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=jeffra
fd869aehttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/fd869ae1c9de686f8cb92413efeba83fc989027c
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/fd869ae1c9de686f8cb92413efeba83fc989027c/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/fd869ae1c9de686f8cb92413efeba83fc989027c
remove distributed requirement from model building (#31)https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/71ab29d831262870b51a97ba01c13b5b86ee5516
jeffrahttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=jeffra
samyamhttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=samyam
71ab29dhttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/71ab29d831262870b51a97ba01c13b5b86ee5516
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/71ab29d831262870b51a97ba01c13b5b86ee5516/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/71ab29d831262870b51a97ba01c13b5b86ee5516
Support nvidia bert dataset (#27)https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/47766e0d7758a53c2582e517ae1c930bcc012518
https://github.com/tjruwase
tjruwasehttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=tjruwase
47766e0https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/47766e0d7758a53c2582e517ae1c930bcc012518
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/47766e0d7758a53c2582e517ae1c930bcc012518/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/47766e0d7758a53c2582e517ae1c930bcc012518
Create README.mdhttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/fd6fb5148ccf5c9ce222432006f1d93806187cd9
https://github.com/jeffra
jeffrahttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=jeffra
fd6fb51https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/fd6fb5148ccf5c9ce222432006f1d93806187cd9
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/fd6fb5148ccf5c9ce222432006f1d93806187cd9/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/fd6fb5148ccf5c9ce222432006f1d93806187cd9
adding stochastic mode (#24)https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/a8a85a900b2c5725171084da5e8bb3d7dd34427f
https://github.com/RezaYazdaniAminabadi
RezaYazdaniAminabadihttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=RezaYazdaniAminabadi
a8a85a9https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/a8a85a900b2c5725171084da5e8bb3d7dd34427f
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/a8a85a900b2c5725171084da5e8bb3d7dd34427f/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/a8a85a900b2c5725171084da5e8bb3d7dd34427f
Fix bert bug with dist.inithttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/8610e5e3fcce5fb247e3b85ea2bed0f2296b5443
https://github.com/jeffra
jeffrahttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=jeffra
8610e5ehttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/8610e5e3fcce5fb247e3b85ea2bed0f2296b5443
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/8610e5e3fcce5fb247e3b85ea2bed0f2296b5443/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/8610e5e3fcce5fb247e3b85ea2bed0f2296b5443
Update deepspeed_bsz32k_lamb_config_seq512.jsonhttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/1b576d64335b861ee045708a9cb59824c06410f6
https://github.com/samyam
samyamhttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=samyam
1b576d6https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/1b576d64335b861ee045708a9cb59824c06410f6
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/1b576d64335b861ee045708a9cb59824c06410f6/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/1b576d64335b861ee045708a9cb59824c06410f6
cleanup of bert/squad codehttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/c66ce653de30da9eae335ef8d121c3ba4c228490
https://github.com/jeffra
jeffrahttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=jeffra
c66ce65https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/c66ce653de30da9eae335ef8d121c3ba4c228490
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/c66ce653de30da9eae335ef8d121c3ba4c228490/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/c66ce653de30da9eae335ef8d121c3ba4c228490
enable stochastic mode for bing_bert model (#16)https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/91cc01afd6b79f3c2e771c387303d2e83e139041
jeffrahttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=jeffra
eltonzhenghttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=eltonzheng
91cc01ahttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/91cc01afd6b79f3c2e771c387303d2e83e139041
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/91cc01afd6b79f3c2e771c387303d2e83e139041/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/91cc01afd6b79f3c2e771c387303d2e83e139041
DeepSpeed 0.2 support (#21)https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/5426d18a2061b36716f1e055780423e0f92b90a1
5426d18https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/5426d18a2061b36716f1e055780423e0f92b90a1
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/5426d18a2061b36716f1e055780423e0f92b90a1/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/5426d18a2061b36716f1e055780423e0f92b90a1
aml datastore support using a data_path_prefix (#16)https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/6a698b2185dc332d1a35e2353b55a38899a36ef3
https://github.com/jeffra
jeffrahttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=jeffra
6a698b2https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/6a698b2185dc332d1a35e2353b55a38899a36ef3
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/6a698b2185dc332d1a35e2353b55a38899a36ef3/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/6a698b2185dc332d1a35e2353b55a38899a36ef3
Bert pretraining refactor (#15)https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/91a794ccff4ac41e0a2c4aebf6fecc10405e1d8d
https://github.com/jeffra
jeffrahttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=jeffra
91a794chttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/91a794ccff4ac41e0a2c4aebf6fecc10405e1d8d
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/91a794ccff4ac41e0a2c4aebf6fecc10405e1d8d/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/91a794ccff4ac41e0a2c4aebf6fecc10405e1d8d
Adds DS config for bing_bert tutorial. (#14)https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/da388213d783b8c6ceeb63d536e260a57cbe4b89
da38821https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/da388213d783b8c6ceeb63d536e260a57cbe4b89
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/da388213d783b8c6ceeb63d536e260a57cbe4b89/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/da388213d783b8c6ceeb63d536e260a57cbe4b89
Fix formatting issues (#10)https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/32ae819bdb514a348d47a071ceaca509e352fb5e
https://github.com/tjruwase
tjruwasehttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=tjruwase
32ae819https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/32ae819bdb514a348d47a071ceaca509e352fb5e
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/32ae819bdb514a348d47a071ceaca509e352fb5e/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/32ae819bdb514a348d47a071ceaca509e352fb5e
Update ds_train_bert_bsz16k_seq512.sh (#7)https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/0401afe34ece9660e6f18d04852d7561670d1093
https://github.com/dadebarr
dadebarrhttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commits?author=dadebarr
0401afehttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/0401afe34ece9660e6f18d04852d7561670d1093
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/0401afe34ece9660e6f18d04852d7561670d1093/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/0401afe34ece9660e6f18d04852d7561670d1093
BERT example (#6)https://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/0b69ada09ab41d5f3f749e6c7aac9a0d6699f45b
0b69adahttps://github.com/DistributedDeepLearning/DeepSpeedExamples/commit/0b69ada09ab41d5f3f749e6c7aac9a0d6699f45b
https://github.com/DistributedDeepLearning/DeepSpeedExamples/blob/0b69ada09ab41d5f3f749e6c7aac9a0d6699f45b/bing_bert
https://github.com/DistributedDeepLearning/DeepSpeedExamples/tree/0b69ada09ab41d5f3f749e6c7aac9a0d6699f45b
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.