| react-profiling | 0 |
| react-import-map | react,react-dom,react-dom/client,react-dom/profiling,react-is,react-reconciler,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@d5750093facf |
| route-pattern | /:user_id/:repository |
| route-controller | files |
| route-action | disambiguate |
| fetch-nonce | v2:330e24eb-6c77-ca39-d142-e849854b33c3 |
| current-catalog-service-hash | f3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb |
| request-id | C8F2:37C1B1:3443FA:47FAC9:6AF659BD |
| html-safe-nonce | 66243085bb38396535406f210a1d04e3933cb03270ec4293198ff6ccf113e919 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJDOEYyOjM3QzFCMTozNDQzRkE6NDdGQUM5OjZBRjY1OUJEIiwidmlzaXRvcl9pZCI6Ijg1MTE5NzI3NjgzNDQzMzI3MzMiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ== |
| visitor-hmac | 9ce3a7f8fcb123dc2a6d5530c38984c142ed9df6bdd43673101b49071719a31b |
| hovercard-subject-tag | repository:596332767 |
| github-keyboard-shortcuts | repository,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | // |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/microsoft/mscclpp |
| twitter:image | https://opengraph.githubassets.com/6635c44e124cb9a8937be69f0792d8873e9aded917f8b85f3aa4e19c2da085b7/microsoft/mscclpp |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/6635c44e124cb9a8937be69f0792d8873e9aded917f8b85f3aa4e19c2da085b7/microsoft/mscclpp |
| og:image:alt | MSCCL++: A GPU-driven communication stack for scalable AI applications - microsoft/mscclpp |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| hostname | github.com |
| expected-hostname | github.com |
| None | fded9ab97d594702a6a4ebcef0ee4f94c91fb16da7c62cac91ee0125e9c2d58c |
| turbo-cache-control | no-cache |
| go-import | github.com/microsoft/mscclpp git https://github.com/microsoft/mscclpp.git |
| octolytics-dimension-user_id | 6154722 |
| octolytics-dimension-user_login | microsoft |
| octolytics-dimension-repository_id | 596332767 |
| octolytics-dimension-repository_nwo | microsoft/mscclpp |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 596332767 |
| octolytics-dimension-repository_network_root_nwo | microsoft/mscclpp |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 39cd7745159797c426e62ba2199c584d653d4b32 |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
| Skip to content | https://github.com/microsoft/mscclpp#start-of-content |
| https://github.com/ |
| Sign in | https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fmicrosoft%2Fmscclpp |
| GitHubRepository hosting, code review, and collaboration | https://github.com/platform |
| CopilotAI coding agent for tasks, projects, and automated work | https://github.com/features/copilot |
| ActionsCI/CD and automation | https://github.com/features/actions |
| Code QualityQuality analysis, fixes, and enforcement | https://github.com/features/code-quality |
| CodespacesCloud development environments | https://github.com/features/codespaces |
| Code SecurityVulnerability detection and remediation | https://github.com/security/advanced-security/code-security |
| Secret ProtectionSecret scanning and leak prevention | https://github.com/security/advanced-security/secret-protection |
| All Features | https://github.com/features |
| Documentation | https://docs.github.com/en |
| Training | https://learn.github.com/skills |
| Certifications | https://learn.github.com/credentials |
| Build with Copilot | https://github.com/features/ai |
| Customize Copilot | https://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview |
| Integrations | https://github.com/marketplace |
| Trending repos | https://github.com/trending |
| GitHub Sponsors | https://github.com/open-source/sponsors |
| Developer articles | https://github.com/resources/articles |
| ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place. | https://github.blog/changelog/ |
| Enterprises | https://github.com/enterprise |
| Team | https://github.com/team |
| Startups | https://github.com/enterprise/startups |
| Nonprofits | https://github.com/solutions/industry/nonprofits |
| Healthcare | https://github.com/solutions/industry/healthcare |
| Financial services | https://github.com/solutions/industry/financial-services |
| Manufacturing | https://github.com/solutions/industry/manufacturing |
| Government | https://github.com/solutions/industry/government |
| See all industries | https://github.com/solutions/industry |
| Why GitHub | https://github.com/why-github |
| Customer Stories | https://github.com/customer-stories |
| Business insights | https://github.com/solutions/executive-insights |
| Trust Center | https://github.com/trust-center |
| GitHub Advanced SecurityEnterprise-grade code security | https://github.com/security/advanced-security |
| Copilot for businessEnterprise-grade AI features | https://github.com/features/copilot/copilot-business |
| Premium SupportEnterprise-grade 24/7 support | https://github.com/enterprise/premium-support |
| Documentation | https://docs.github.com/en |
| Resource center | https://github.com/resources |
| Blog | https://github.blog/ |
| Events & webinars | https://github.com/resources/events |
| Community Forum | https://github.com/orgs/community/discussions |
| Customer Stories | https://github.com/customer-stories |
| Integrations | https://github.com/marketplace |
| Customer support | https://help.github.com/ |
| Training | https://learn.github.com/skills |
| GitHub Status | https://www.githubstatus.com/ |
| About | https://github.com/about |
| Partners | https://github.com/partners |
| Changelog | https://github.blog/changelog/ |
| GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub. | https://githubuniverse.com/ |
| Pricing | https://github.com/pricing |
| Sign in | https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fmicrosoft%2Fmscclpp |
| Sign up | https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=microsoft%2Fmscclpp |
| Reload | https://github.com/microsoft/mscclpp |
| Reload | https://github.com/microsoft/mscclpp |
| Reload | https://github.com/microsoft/mscclpp |
| microsoft | https://github.com/microsoft |
| mscclpp | https://github.com/microsoft/mscclpp |
| Code | https://github.com/microsoft/mscclpp |
| Issues4 (4) | https://github.com/microsoft/mscclpp/issues |
| Pull requests33 (33) | https://github.com/microsoft/mscclpp/pulls |
| Actions | https://github.com/microsoft/mscclpp/actions |
| Projects | https://github.com/microsoft/mscclpp/projects |
| Security and quality | https://github.com/microsoft/mscclpp/security |
| Insights | https://github.com/microsoft/mscclpp/pulse |
| https://github.com/microsoft/mscclpp |
| mscclpp | https://github.com/microsoft/mscclpp |
| Notifications | https://github.com/login?return_to=%2Fmicrosoft%2Fmscclpp |
| Fork114 (114) | https://github.com/login?return_to=%2Fmicrosoft%2Fmscclpp |
| Star572 (572) | https://github.com/login?return_to=%2Fmicrosoft%2Fmscclpp |
| microsoft.github.io/mscclpp/ | https://microsoft.github.io/mscclpp/ |
| Readme | https://github.com/microsoft/mscclpp#readme-ov-file |
| MIT license | https://github.com/microsoft/mscclpp#MIT-1-ov-file |
| Code of conduct | https://github.com/microsoft/mscclpp#coc-ov-file |
| Security policy | https://github.com/microsoft/mscclpp#security-ov-file |
| Activity | https://github.com/microsoft/mscclpp/activity |
| Custom properties | https://github.com/microsoft/mscclpp/custom-properties |
| 114 forks | https://github.com/microsoft/mscclpp/forks |
| Report repository | https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Fmicrosoft%2Fmscclpp&report=microsoft+%28user%29 |
| Branches | https://github.com/microsoft/mscclpp/branches |
| Tags | https://github.com/microsoft/mscclpp/tags |
| https://github.com/microsoft/mscclpp/branches |
| https://github.com/microsoft/mscclpp/tags |
| 1,023 Commits | https://github.com/microsoft/mscclpp/commits/main/ |
| https://github.com/microsoft/mscclpp/commits/main/ |
| .azure-pipelines | https://github.com/microsoft/mscclpp/tree/main/.azure-pipelines |
| .azure-pipelines | https://github.com/microsoft/mscclpp/tree/main/.azure-pipelines |
| .devcontainer | https://github.com/microsoft/mscclpp/tree/main/.devcontainer |
| .devcontainer | https://github.com/microsoft/mscclpp/tree/main/.devcontainer |
| .github | https://github.com/microsoft/mscclpp/tree/main/.github |
| .github | https://github.com/microsoft/mscclpp/tree/main/.github |
| cmake | https://github.com/microsoft/mscclpp/tree/main/cmake |
| cmake | https://github.com/microsoft/mscclpp/tree/main/cmake |
| docker | https://github.com/microsoft/mscclpp/tree/main/docker |
| docker | https://github.com/microsoft/mscclpp/tree/main/docker |
| docs | https://github.com/microsoft/mscclpp/tree/main/docs |
| docs | https://github.com/microsoft/mscclpp/tree/main/docs |
| examples | https://github.com/microsoft/mscclpp/tree/main/examples |
| examples | https://github.com/microsoft/mscclpp/tree/main/examples |
| include | https://github.com/microsoft/mscclpp/tree/main/include |
| include | https://github.com/microsoft/mscclpp/tree/main/include |
| python | https://github.com/microsoft/mscclpp/tree/main/python |
| python | https://github.com/microsoft/mscclpp/tree/main/python |
| src | https://github.com/microsoft/mscclpp/tree/main/src |
| src | https://github.com/microsoft/mscclpp/tree/main/src |
| test | https://github.com/microsoft/mscclpp/tree/main/test |
| test | https://github.com/microsoft/mscclpp/tree/main/test |
| tools | https://github.com/microsoft/mscclpp/tree/main/tools |
| tools | https://github.com/microsoft/mscclpp/tree/main/tools |
| .clang-format | https://github.com/microsoft/mscclpp/blob/main/.clang-format |
| .clang-format | https://github.com/microsoft/mscclpp/blob/main/.clang-format |
| .codecov.yml | https://github.com/microsoft/mscclpp/blob/main/.codecov.yml |
| .codecov.yml | https://github.com/microsoft/mscclpp/blob/main/.codecov.yml |
| .gitignore | https://github.com/microsoft/mscclpp/blob/main/.gitignore |
| .gitignore | https://github.com/microsoft/mscclpp/blob/main/.gitignore |
| .readthedocs.yaml | https://github.com/microsoft/mscclpp/blob/main/.readthedocs.yaml |
| .readthedocs.yaml | https://github.com/microsoft/mscclpp/blob/main/.readthedocs.yaml |
| CITATION.cff | https://github.com/microsoft/mscclpp/blob/main/CITATION.cff |
| CITATION.cff | https://github.com/microsoft/mscclpp/blob/main/CITATION.cff |
| CMakeLists.txt | https://github.com/microsoft/mscclpp/blob/main/CMakeLists.txt |
| CMakeLists.txt | https://github.com/microsoft/mscclpp/blob/main/CMakeLists.txt |
| CODE_OF_CONDUCT.md | https://github.com/microsoft/mscclpp/blob/main/CODE_OF_CONDUCT.md |
| CODE_OF_CONDUCT.md | https://github.com/microsoft/mscclpp/blob/main/CODE_OF_CONDUCT.md |
| LICENSE | https://github.com/microsoft/mscclpp/blob/main/LICENSE |
| LICENSE | https://github.com/microsoft/mscclpp/blob/main/LICENSE |
| README.md | https://github.com/microsoft/mscclpp/blob/main/README.md |
| README.md | https://github.com/microsoft/mscclpp/blob/main/README.md |
| SECURITY.md | https://github.com/microsoft/mscclpp/blob/main/SECURITY.md |
| SECURITY.md | https://github.com/microsoft/mscclpp/blob/main/SECURITY.md |
| SUPPORT.md | https://github.com/microsoft/mscclpp/blob/main/SUPPORT.md |
| SUPPORT.md | https://github.com/microsoft/mscclpp/blob/main/SUPPORT.md |
| VERSION | https://github.com/microsoft/mscclpp/blob/main/VERSION |
| VERSION | https://github.com/microsoft/mscclpp/blob/main/VERSION |
| pyproject.toml | https://github.com/microsoft/mscclpp/blob/main/pyproject.toml |
| pyproject.toml | https://github.com/microsoft/mscclpp/blob/main/pyproject.toml |
| README | https://github.com/microsoft/mscclpp |
| Code of conduct | https://github.com/microsoft/mscclpp |
| MIT license | https://github.com/microsoft/mscclpp |
| Security | https://github.com/microsoft/mscclpp |
| https://github.com/microsoft/mscclpp#msccl |
| https://github.com/microsoft/mscclpp/releases/latest |
| https://github.com/microsoft/mscclpp/blob/main/LICENSE |
| https://github.com/microsoft/mscclpp/actions/workflows/codeql-analysis.yml |
| https://microsoft.github.io/mscclpp/ |
| https://codecov.io/gh/microsoft/mscclpp |
| https://msazure.visualstudio.com/One/_build/latest?definitionId=398325&branchName=main |
| https://msazure.visualstudio.com/One/_build/latest?definitionId=398325&branchName=main |
| https://msazure.visualstudio.com/One/_build/latest?definitionId=398479&branchName=main |
| https://msazure.visualstudio.com/One/_build/latest?definitionId=320665&repoName=microsoft%2Fmscclpp&branchName=main |
| https://msazure.visualstudio.com/One/_build/latest?definitionId=448013&branchName=main |
| Quick Start | https://microsoft.github.io/mscclpp/quickstart.html |
| Tutorials | https://microsoft.github.io/mscclpp/tutorials.html |
| API Reference | https://microsoft.github.io/mscclpp/cpp_api.html |
| Paper | https://arxiv.org/abs/2504.09014 |
| https://github.com/microsoft/mscclpp#overview |
| https://github.com/microsoft/mscclpp/blob/main/docs/figs/abstractions.png |
| https://github.com/microsoft/mscclpp#performance |
| Azure NDmv4 SKUs | https://learn.microsoft.com/en-us/azure/virtual-machines/ndm-a100-v4-series |
| https://github.com/microsoft/mscclpp/blob/main/docs/figs/mscclpp_vs_nccl_comparison_num_nodes_1.jpeg |
| https://github.com/microsoft/mscclpp/blob/main/docs/figs/mscclpp_vs_nccl_comparison_num_nodes_2.jpeg |
| https://github.com/microsoft/mscclpp#key-concepts |
| https://github.com/microsoft/mscclpp#on-gpu-communication-interfaces-channels |
| https://github.com/microsoft/mscclpp#portchannel-and-memorychannel |
| here | https://github.com/microsoft/mscclpp/blob/main/include/mscclpp/port_channel_device.hpp |
| here | https://github.com/microsoft/mscclpp/blob/main/include/mscclpp/memory_channel_device.hpp |
| https://github.com/microsoft/mscclpp#host-side-communication-proxy |
| https://github.com/microsoft/mscclpp#python-interfaces |
| https://github.com/microsoft/mscclpp#projects-using-msccl |
| Paper link | https://www.usenix.org/conference/nsdi23/presentation/hwang |
| https://github.com/microsoft/ark |
| https://github.com/flashinfer-ai/flashinfer |
| Paper link | https://arxiv.org/abs/2402.06787 |
| https://github.com/InternLM/lmdeploy |
| Paper link | https://arxiv.org/abs/2408.12757 |
| https://github.com/efeslab/Nanoflow |
| https://github.com/ROCm/rccl |
| Paper link | https://arxiv.org/abs/2311.18677 |
| https://github.com/apache/tvm |
| https://github.com/sgl-project/sglang |
| https://github.com/microsoft/mscclpp#contributing |
| https://cla.opensource.microsoft.com | https://cla.opensource.microsoft.com |
| Microsoft Open Source Code of Conduct | https://opensource.microsoft.com/codeofconduct/ |
| Code of Conduct FAQ | https://opensource.microsoft.com/codeofconduct/faq/ |
| https://github.com/microsoft/mscclpp#trademarks |
| Microsoft's Trademark & Brand Guidelines | https://www.microsoft.com/en-us/legal/intellectualproperty/trademarks/usage/general |
| https://github.com/microsoft/mscclpp#citation |
| paper | https://arxiv.org/abs/2504.09014 |
| microsoft.github.io/mscclpp/ | https://microsoft.github.io/mscclpp/ |
| Readme | https://github.com/microsoft/mscclpp#readme-ov-file |
| MIT license | https://github.com/microsoft/mscclpp#MIT-1-ov-file |
| Code of conduct | https://github.com/microsoft/mscclpp#coc-ov-file |
| Security policy | https://github.com/microsoft/mscclpp#security-ov-file |
| Activity | https://github.com/microsoft/mscclpp/activity |
| Custom properties | https://github.com/microsoft/mscclpp/custom-properties |
| 114 forks | https://github.com/microsoft/mscclpp/forks |
| Report repository | https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Fmicrosoft%2Fmscclpp&report=microsoft+%28user%29 |
|
| https://github.com |
| Terms | https://docs.github.com/site-policy/github-terms/github-terms-of-service |
| Privacy | https://docs.github.com/site-policy/privacy-policies/github-privacy-statement |
| Security | https://github.com/security |
| Status | https://www.githubstatus.com/ |
| Community | https://github.community/ |
| Docs | https://docs.github.com/ |
| Contact | https://support.github.com?tags=dotcom-footer |