René's URL Explorer Experiment


Title: sequence-parallelism · GitHub Topics · GitHub

Open Graph Title: Build software better, together

X Title: GitHub

Description: GitHub is where people build software. More than 150 million people use GitHub to discover, fork, and contribute to over 420 million projects.

Open Graph Description: GitHub is where people build software. More than 150 million people use GitHub to discover, fork, and contribute to over 420 million projects.

X Description: GitHub is where people build software. More than 150 million people use GitHub to discover, fork, and contribute to over 420 million projects.

Opengraph URL: https://github.com

X: github

direct link

Domain: patch-diff.githubusercontent.com

route-pattern/topics/:topic_name(.:format)
route-controllertopics
route-actionshow
fetch-noncev2:56309b30-c6b8-43b1-1642-506721ab9253
current-catalog-service-hash82c569b93da5c18ed649ebd4c2c79437db4611a6a1373e805a3cb001c64130b7
request-id83CC:1D50:16005B4:1D6F020:698CFF65
html-safe-nonce8eaa78f83df2b8808b7fdd802fe5d8862ba2235d358637264e5e36fc050f3053
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI4M0NDOjFENTA6MTYwMDVCNDoxRDZGMDIwOjY5OENGRjY1IiwidmlzaXRvcl9pZCI6IjUxNzcxNzA1MTExMzAzMjg5MzMiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmacf20d8775df602315b46c2a16747dbb74a24c8d9ab96101899070bc89465569f6
github-keyboard-shortcutscopilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/topics/sequence-parallelism
og:site_nameGitHub
og:imagehttps://github.githubassets.com/assets/github-octocat-13c86b8b336d.png
og:image:typeimage/png
og:image:width1200
og:image:height620
twitter:site:id13334762
twitter:creatorgithub
twitter:creator:id13334762
twitter:cardsummary_large_image
twitter:imagehttps://github.githubassets.com/assets/github-logo-55c5b9a1fe52.png
twitter:image:width1200
twitter:image:height1200
hostnamegithub.com
expected-hostnamegithub.com
Nonef2da95634bce8a94cfa4123788169bfabdf845fd1d790fbaaaaab09dcfebdf28
turbo-cache-controlno-preview
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
releasec21843b18feba17d11efb1895a7db61e8672f2cf
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://patch-diff.githubusercontent.com/topics/sequence-parallelism#start-of-content
https://patch-diff.githubusercontent.com/
Sign in https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Ftopics%2Fsequence-parallelism
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub SparkBuild and deploy intelligent appshttps://github.com/features/spark
GitHub ModelsManage and compare promptshttps://github.com/features/models
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
GitHub SponsorsFund open source developershttps://github.com/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/accelerator
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Ftopics%2Fsequence-parallelism
Sign up https://patch-diff.githubusercontent.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2Ftopics%2Fsequence-parallelism&source=header
Reloadhttps://patch-diff.githubusercontent.com/topics/sequence-parallelism
Reloadhttps://patch-diff.githubusercontent.com/topics/sequence-parallelism
Reloadhttps://patch-diff.githubusercontent.com/topics/sequence-parallelism
Explorehttps://patch-diff.githubusercontent.com/explore
Topicshttps://patch-diff.githubusercontent.com/topics
Trendinghttps://patch-diff.githubusercontent.com/trending
Collectionshttps://patch-diff.githubusercontent.com/collections
Eventshttps://patch-diff.githubusercontent.com/events
GitHub Sponsorshttps://patch-diff.githubusercontent.com/sponsors/explore
Star https://patch-diff.githubusercontent.com/login?return_to=%2Ftopic.sequence-parallelism
NVlabshttps://patch-diff.githubusercontent.com/NVlabs
Long-RLhttps://patch-diff.githubusercontent.com/NVlabs/Long-RL
Star 691 https://patch-diff.githubusercontent.com/login?return_to=%2FNVlabs%2FLong-RL
Code https://patch-diff.githubusercontent.com/NVlabs/Long-RL
Issues https://patch-diff.githubusercontent.com/NVlabs/Long-RL/issues
Pull requests https://patch-diff.githubusercontent.com/NVlabs/Long-RL/pulls
reinforcement-learninghttps://patch-diff.githubusercontent.com/topics/reinforcement-learning
multi-modalityhttps://patch-diff.githubusercontent.com/topics/multi-modality
long-sequencehttps://patch-diff.githubusercontent.com/topics/long-sequence
large-language-modelshttps://patch-diff.githubusercontent.com/topics/large-language-models
sequence-parallelismhttps://patch-diff.githubusercontent.com/topics/sequence-parallelism
efficient-aihttps://patch-diff.githubusercontent.com/topics/efficient-ai
InternLMhttps://patch-diff.githubusercontent.com/InternLM
InternEvohttps://patch-diff.githubusercontent.com/InternLM/InternEvo
Star 418 https://patch-diff.githubusercontent.com/login?return_to=%2FInternLM%2FInternEvo
Code https://patch-diff.githubusercontent.com/InternLM/InternEvo
Issues https://patch-diff.githubusercontent.com/InternLM/InternEvo/issues
Pull requests https://patch-diff.githubusercontent.com/InternLM/InternEvo/pulls
pytorchhttps://patch-diff.githubusercontent.com/topics/pytorch
multi-modalhttps://patch-diff.githubusercontent.com/topics/multi-modal
gemmahttps://patch-diff.githubusercontent.com/topics/gemma
pipeline-parallelismhttps://patch-diff.githubusercontent.com/topics/pipeline-parallelism
transformers-modelshttps://patch-diff.githubusercontent.com/topics/transformers-models
tensor-parallelismhttps://patch-diff.githubusercontent.com/topics/tensor-parallelism
llavahttps://patch-diff.githubusercontent.com/topics/llava
llm-traininghttps://patch-diff.githubusercontent.com/topics/llm-training
internlmhttps://patch-diff.githubusercontent.com/topics/internlm
flash-attentionhttps://patch-diff.githubusercontent.com/topics/flash-attention
zero3https://patch-diff.githubusercontent.com/topics/zero3
llm-frameworkhttps://patch-diff.githubusercontent.com/topics/llm-framework
sequence-parallelismhttps://patch-diff.githubusercontent.com/topics/sequence-parallelism
internlm2https://patch-diff.githubusercontent.com/topics/internlm2
ring-attentionhttps://patch-diff.githubusercontent.com/topics/ring-attention
deepspeed-ulysseshttps://patch-diff.githubusercontent.com/topics/deepspeed-ulysses
llama3https://patch-diff.githubusercontent.com/topics/llama3
910bhttps://patch-diff.githubusercontent.com/topics/910b
xrsrkehttps://patch-diff.githubusercontent.com/xrsrke
pipegoosehttps://patch-diff.githubusercontent.com/xrsrke/pipegoose
Star 86 https://patch-diff.githubusercontent.com/login?return_to=%2Fxrsrke%2Fpipegoose
Code https://patch-diff.githubusercontent.com/xrsrke/pipegoose
Issues https://patch-diff.githubusercontent.com/xrsrke/pipegoose/issues
Pull requests https://patch-diff.githubusercontent.com/xrsrke/pipegoose/pulls
Discussions https://patch-diff.githubusercontent.com/xrsrke/pipegoose/discussions
transformershttps://patch-diff.githubusercontent.com/topics/transformers
moehttps://patch-diff.githubusercontent.com/topics/moe
data-parallelismhttps://patch-diff.githubusercontent.com/topics/data-parallelism
distributed-optimizershttps://patch-diff.githubusercontent.com/topics/distributed-optimizers
model-parallelismhttps://patch-diff.githubusercontent.com/topics/model-parallelism
megatronhttps://patch-diff.githubusercontent.com/topics/megatron
mixture-of-expertshttps://patch-diff.githubusercontent.com/topics/mixture-of-experts
pipeline-parallelismhttps://patch-diff.githubusercontent.com/topics/pipeline-parallelism
huggingface-transformershttps://patch-diff.githubusercontent.com/topics/huggingface-transformers
megatron-lmhttps://patch-diff.githubusercontent.com/topics/megatron-lm
tensor-parallelismhttps://patch-diff.githubusercontent.com/topics/tensor-parallelism
large-scale-language-modelinghttps://patch-diff.githubusercontent.com/topics/large-scale-language-modeling
3d-parallelismhttps://patch-diff.githubusercontent.com/topics/3d-parallelism
zero-1https://patch-diff.githubusercontent.com/topics/zero-1
sequence-parallelismhttps://patch-diff.githubusercontent.com/topics/sequence-parallelism
AlibabaPAIhttps://patch-diff.githubusercontent.com/AlibabaPAI
FlashModelshttps://patch-diff.githubusercontent.com/AlibabaPAI/FlashModels
Star 12 https://patch-diff.githubusercontent.com/login?return_to=%2FAlibabaPAI%2FFlashModels
Code https://patch-diff.githubusercontent.com/AlibabaPAI/FlashModels
Issues https://patch-diff.githubusercontent.com/AlibabaPAI/FlashModels/issues
Pull requests https://patch-diff.githubusercontent.com/AlibabaPAI/FlashModels/pulls
deep-learninghttps://patch-diff.githubusercontent.com/topics/deep-learning
pytorchhttps://patch-diff.githubusercontent.com/topics/pytorch
zerohttps://patch-diff.githubusercontent.com/topics/zero
data-parallelismhttps://patch-diff.githubusercontent.com/topics/data-parallelism
model-parallelismhttps://patch-diff.githubusercontent.com/topics/model-parallelism
distributed-traininghttps://patch-diff.githubusercontent.com/topics/distributed-training
xlahttps://patch-diff.githubusercontent.com/topics/xla
tensor-parallelismhttps://patch-diff.githubusercontent.com/topics/tensor-parallelism
llmhttps://patch-diff.githubusercontent.com/topics/llm
fsdphttps://patch-diff.githubusercontent.com/topics/fsdp
sequence-parallelismhttps://patch-diff.githubusercontent.com/topics/sequence-parallelism
Curate this topic https://github.com/github/explore/tree/master/CONTRIBUTING.md?source=add-description-sequence-parallelism
Learn more https://docs.github.com/en/articles/classifying-your-repository-with-topics
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.