René's URL Explorer Experiment


Title: NVIDIA/TransformerEngine · Discussions · GitHub

Open Graph Title: NVIDIA/TransformerEngine · Discussions

X Title: NVIDIA/TransformerEngine · Discussions

Description: Explore the GitHub Discussions forum for NVIDIA TransformerEngine. Discuss code, ask questions & collaborate with the developer community.

Open Graph Description: Explore the GitHub Discussions forum for NVIDIA TransformerEngine. Discuss code, ask questions & collaborate with the developer community.

X Description: Explore the GitHub Discussions forum for NVIDIA TransformerEngine. Discuss code, ask questions & collaborate with the developer community.

Opengraph URL: https://github.com/NVIDIA/TransformerEngine/discussions

X: @github

direct link

Domain: github.com

route-pattern/:user_id/:repository/discussions(.:format)
route-controllerdiscussions
route-actionindex
fetch-noncev2:5a812ca1-cfe6-daf8-77cc-24a941efb254
current-catalog-service-hash9f0abe34da433c9b6db74bffa2466494a717b579a96b30a5d252e5090baea7be
request-idBDA2:1E19D3:21C612:2F9453:6A4BC343
html-safe-nonce4d31b2f654407e6ed20c784a51fc9cbd528f99f0801fbd102f268c0d720744ff
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJCREEyOjFFMTlEMzoyMUM2MTI6MkY5NDUzOjZBNEJDMzQzIiwidmlzaXRvcl9pZCI6IjY2NjcyMjE0NDQ5Njk4NzQyNDMiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmac5ee5d7ae5d7685b380e336c3f2e6e007f01c39c223c2a044ecc0da6f52f60b94
hovercard-subject-tagrepository:539057023
github-keyboard-shortcutsrepository,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///discussions/index
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/NVIDIA/TransformerEngine/discussions
twitter:imagehttps://opengraph.githubassets.com/054af6a0e62bab1fdb09aa3ed093f911cf3a150fa8e3fccc60319ea84c11dabe/NVIDIA/TransformerEngine
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/054af6a0e62bab1fdb09aa3ed093f911cf3a150fa8e3fccc60319ea84c11dabe/NVIDIA/TransformerEngine
og:image:altExplore the GitHub Discussions forum for NVIDIA TransformerEngine. Discuss code, ask questions & collaborate with the developer community.
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None14aa00ce5bdb34d0eefb5facbffd7de9e144c688d8a93ef8df902d5f94b51dd7
turbo-cache-controlno-preview
go-importgithub.com/NVIDIA/TransformerEngine git https://github.com/NVIDIA/TransformerEngine.git
octolytics-dimension-user_id1728152
octolytics-dimension-user_loginNVIDIA
octolytics-dimension-repository_id539057023
octolytics-dimension-repository_nwoNVIDIA/TransformerEngine
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id539057023
octolytics-dimension-repository_network_root_nwoNVIDIA/TransformerEngine
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release58b8f89190447502561829f30862aa0a99d53367
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/NVIDIA/TransformerEngine/discussions#start-of-content
https://github.com/
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FNVIDIA%2FTransformerEngine%2Fdiscussions
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub Copilot appDirect agents from issue to mergehttps://github.com/features/ai/github-app
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
View all resourceshttps://github.com/resources
GitHub SponsorsFund open source developershttps://github.com/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/accelerator
GitHub Starshttps://stars.github.com
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FNVIDIA%2FTransformerEngine%2Fdiscussions
Sign up https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fdiscussions%2Findex&source=header-repo&source_repo=NVIDIA%2FTransformerEngine
Reloadhttps://github.com/NVIDIA/TransformerEngine/discussions
Reloadhttps://github.com/NVIDIA/TransformerEngine/discussions
Reloadhttps://github.com/NVIDIA/TransformerEngine/discussions
Please reload this pagehttps://github.com/NVIDIA/TransformerEngine/discussions
NVIDIA https://github.com/NVIDIA
TransformerEnginehttps://github.com/NVIDIA/TransformerEngine
Notifications https://github.com/login?return_to=%2FNVIDIA%2FTransformerEngine
Fork 764 https://github.com/login?return_to=%2FNVIDIA%2FTransformerEngine
Star 3.4k https://github.com/login?return_to=%2FNVIDIA%2FTransformerEngine
Code https://github.com/NVIDIA/TransformerEngine
Issues 153 https://github.com/NVIDIA/TransformerEngine/issues
Pull requests 144 https://github.com/NVIDIA/TransformerEngine/pulls
Discussions https://github.com/NVIDIA/TransformerEngine/discussions
Actions https://github.com/NVIDIA/TransformerEngine/actions
Security and quality 0 https://github.com/NVIDIA/TransformerEngine/security
Insights https://github.com/NVIDIA/TransformerEngine/pulse
Code https://github.com/NVIDIA/TransformerEngine
Issues https://github.com/NVIDIA/TransformerEngine/issues
Pull requests https://github.com/NVIDIA/TransformerEngine/pulls
Discussions https://github.com/NVIDIA/TransformerEngine/discussions
Actions https://github.com/NVIDIA/TransformerEngine/actions
Security and quality https://github.com/NVIDIA/TransformerEngine/security
Insights https://github.com/NVIDIA/TransformerEngine/pulse
Latest activity https://github.com/NVIDIA/TransformerEngine/discussions
Date created https://github.com/NVIDIA/TransformerEngine/discussions?discussions_q=sort%3Adate_created
Top: Past day https://github.com/NVIDIA/TransformerEngine/discussions?discussions_q=sort%3Atop+created%3A%3E%3D2026-07-05
Top: Past week https://github.com/NVIDIA/TransformerEngine/discussions?discussions_q=sort%3Atop+created%3A%3E%3D2026-06-29
Top: Past month https://github.com/NVIDIA/TransformerEngine/discussions?discussions_q=sort%3Atop+created%3A%3E%3D2026-06-06
Top: Past year https://github.com/NVIDIA/TransformerEngine/discussions?discussions_q=sort%3Atop+created%3A%3E%3D2025-07-06
Top: All https://github.com/NVIDIA/TransformerEngine/discussions?discussions_q=sort%3Atop
Please reload this pagehttps://github.com/NVIDIA/TransformerEngine/discussions
Open https://github.com/NVIDIA/TransformerEngine/discussions?discussions_q=is%3Aopen
Closed https://github.com/NVIDIA/TransformerEngine/discussions?discussions_q=is%3Aclosed
Locked https://github.com/NVIDIA/TransformerEngine/discussions?discussions_q=is%3Alocked
Unlocked https://github.com/NVIDIA/TransformerEngine/discussions?discussions_q=is%3Aunlocked
Answered https://github.com/NVIDIA/TransformerEngine/discussions?discussions_q=is%3Aanswered
Unanswered https://github.com/NVIDIA/TransformerEngine/discussions?discussions_q=is%3Aunanswered
Verified https://github.com/NVIDIA/TransformerEngine/discussions?discussions_q=is%3Averified
All https://github.com/NVIDIA/TransformerEngine/discussions?discussions_q=
View all discussions https://github.com/NVIDIA/TransformerEngine/discussions
📣 Announcements https://github.com/NVIDIA/TransformerEngine/discussions/categories/announcements
💬 General https://github.com/NVIDIA/TransformerEngine/discussions/categories/general
💡 Ideas https://github.com/NVIDIA/TransformerEngine/discussions/categories/ideas
🗳️ Polls https://github.com/NVIDIA/TransformerEngine/discussions/categories/polls
🙏 Q&A https://github.com/NVIDIA/TransformerEngine/discussions/categories/q-a
🙌 Show and tell https://github.com/NVIDIA/TransformerEngine/discussions/categories/show-and-tell
Please reload this pagehttps://github.com/NVIDIA/TransformerEngine/discussions
Community guidelines https://docs.github.com/articles/github-community-guidelines
docs.nvidia.com/deeplearning/transformer-engine/user-guide/index.html https://docs.nvidia.com/deeplearning/transformer-engine/user-guide/index.html
nvfp4 support for Spark DGXhttps://github.com/NVIDIA/TransformerEngine/discussions/2336
vidavakilhttps://github.com/vidavakil
Q&Ahttps://github.com/NVIDIA/TransformerEngine/discussions/categories/q-a
https://github.com/vidavakil
https://github.com/Advait251206
https://github.com/vidavakil
https://github.com/Advait251206
1https://github.com/NVIDIA/TransformerEngine/discussions/2336
SM120 Supporthttps://github.com/NVIDIA/TransformerEngine/discussions/2313
JamesDConleyhttps://github.com/JamesDConley
Q&Ahttps://github.com/NVIDIA/TransformerEngine/discussions/categories/q-a
https://github.com/JamesDConley
https://github.com/Advait251206
https://github.com/JamesDConley
https://github.com/Advait251206
1https://github.com/NVIDIA/TransformerEngine/discussions/2313
How to calibrate weights of models after apply Accelerating a Hugging Face Llama 3 models with Transformer Enginehttps://github.com/NVIDIA/TransformerEngine/discussions/1748
xuanvinh1997https://github.com/xuanvinh1997
Q&Ahttps://github.com/NVIDIA/TransformerEngine/discussions/categories/q-a
https://github.com/xuanvinh1997
https://github.com/Advait251206
https://github.com/xuanvinh1997
https://github.com/Advait251206
1https://github.com/NVIDIA/TransformerEngine/discussions/1748
verification of fp8 precisionhttps://github.com/NVIDIA/TransformerEngine/discussions/1367
kraza8https://github.com/kraza8
Q&Ahttps://github.com/NVIDIA/TransformerEngine/discussions/categories/q-a
https://github.com/kraza8
https://github.com/Advait251206
https://github.com/kraza8
https://github.com/Advait251206
1https://github.com/NVIDIA/TransformerEngine/discussions/1367
Is the delayed scaling computation overlapped with another computation?https://github.com/NVIDIA/TransformerEngine/discussions/1231
avizon-awshttps://github.com/avizon-aws
Q&Ahttps://github.com/NVIDIA/TransformerEngine/discussions/categories/q-a
https://github.com/avizon-aws
https://github.com/Advait251206
https://github.com/avizon-aws
https://github.com/Advait251206
1https://github.com/NVIDIA/TransformerEngine/discussions/1231
Can this module be used for training on an Ada GPU?https://github.com/NVIDIA/TransformerEngine/discussions/770
scissorstailhttps://github.com/scissorstail
Q&Ahttps://github.com/NVIDIA/TransformerEngine/discussions/categories/q-a
https://github.com/scissorstail
https://github.com/Advait251206
https://github.com/scissorstail
https://github.com/Advait251206
1https://github.com/NVIDIA/TransformerEngine/discussions/770
Latency/Energy Calculationhttps://github.com/NVIDIA/TransformerEngine/discussions/240
krishnateja95https://github.com/krishnateja95
Q&Ahttps://github.com/NVIDIA/TransformerEngine/discussions/categories/q-a
https://github.com/krishnateja95
https://github.com/Advait251206
https://github.com/krishnateja95
https://github.com/Advait251206
1https://github.com/NVIDIA/TransformerEngine/discussions/240
When are you going to release the new versionhttps://github.com/NVIDIA/TransformerEngine/discussions/2182
lorenzosciutohttps://github.com/lorenzosciuto
Q&Ahttps://github.com/NVIDIA/TransformerEngine/discussions/categories/q-a
https://github.com/lorenzosciuto
https://github.com/nvMelissa
https://github.com/lorenzosciuto
https://github.com/nvMelissa
1https://github.com/NVIDIA/TransformerEngine/discussions/2182
Support for aarch64https://github.com/NVIDIA/TransformerEngine/discussions/1434
michaelghorganhttps://github.com/michaelghorgan
Q&Ahttps://github.com/NVIDIA/TransformerEngine/discussions/categories/q-a
https://github.com/michaelghorgan
https://github.com/johnnynunez
https://github.com/michaelghorgan
https://github.com/johnnynunez
3https://github.com/NVIDIA/TransformerEngine/discussions/1434
How about the torch.compile in TransformerEnginehttps://github.com/NVIDIA/TransformerEngine/discussions/1237
south-oceanhttps://github.com/south-ocean
Q&Ahttps://github.com/NVIDIA/TransformerEngine/discussions/categories/q-a
https://github.com/south-ocean
https://github.com/south-ocean
0https://github.com/NVIDIA/TransformerEngine/discussions/1237
te.Embedding layer?https://github.com/NVIDIA/TransformerEngine/discussions/665
sopotchttps://github.com/sopotc
Q&Ahttps://github.com/NVIDIA/TransformerEngine/discussions/categories/q-a
https://github.com/sopotc
https://github.com/timmoon10
https://github.com/Andrew-Luo1
https://github.com/sopotc
https://github.com/timmoon10
https://github.com/Andrew-Luo1
2https://github.com/NVIDIA/TransformerEngine/discussions/665
Clarification for the precision part in fp8_primerhttps://github.com/NVIDIA/TransformerEngine/discussions/835
YangFei1990https://github.com/YangFei1990
Q&Ahttps://github.com/NVIDIA/TransformerEngine/discussions/categories/q-a
https://github.com/YangFei1990
https://github.com/Andrew-Luo1
https://github.com/YangFei1990
https://github.com/Andrew-Luo1
3https://github.com/NVIDIA/TransformerEngine/discussions/835
Official example for multi-GPU training didn't work on 4090https://github.com/NVIDIA/TransformerEngine/discussions/388
QIU-Shuohttps://github.com/QIU-Shuo
Generalhttps://github.com/NVIDIA/TransformerEngine/discussions/categories/general
https://github.com/QIU-Shuo
https://github.com/Xiaoyiyong555
https://github.com/QIU-Shuo
https://github.com/Xiaoyiyong555
1https://github.com/NVIDIA/TransformerEngine/discussions/388
Could you share any papers/books that provide underlying explanations for this project?https://github.com/NVIDIA/TransformerEngine/discussions/807
nicks64https://github.com/nicks64
Generalhttps://github.com/NVIDIA/TransformerEngine/discussions/categories/general
https://github.com/nicks64
https://github.com/sbhavani
https://github.com/timmoon10
https://github.com/nicks64
https://github.com/sbhavani
https://github.com/timmoon10
4https://github.com/NVIDIA/TransformerEngine/discussions/807
[Pytorch] Is the fwd_amx_history of first module is used before required allreduce communicationhttps://github.com/NVIDIA/TransformerEngine/discussions/725
mst9009https://github.com/mst9009
Generalhttps://github.com/NVIDIA/TransformerEngine/discussions/categories/general
https://github.com/mst9009
https://github.com/mst9009
0https://github.com/NVIDIA/TransformerEngine/discussions/725
What is the data type in AllReduce？https://github.com/NVIDIA/TransformerEngine/discussions/428
MARD1NOhttps://github.com/MARD1NO
Q&Ahttps://github.com/NVIDIA/TransformerEngine/discussions/categories/q-a
https://github.com/MARD1NO
https://github.com/MARD1NO
0https://github.com/NVIDIA/TransformerEngine/discussions/428
FP8 formathttps://github.com/NVIDIA/TransformerEngine/discussions/354
stella-jxuhttps://github.com/stella-jxu
Q&Ahttps://github.com/NVIDIA/TransformerEngine/discussions/categories/q-a
https://github.com/stella-jxu
https://github.com/ksivaman
https://github.com/stella-jxu
https://github.com/ksivaman
1https://github.com/NVIDIA/TransformerEngine/discussions/354
Enabling sequence_parallel slows down training with fp16https://github.com/NVIDIA/TransformerEngine/discussions/283
cavdardhttps://github.com/cavdard
Q&Ahttps://github.com/NVIDIA/TransformerEngine/discussions/categories/q-a
https://github.com/cavdard
https://github.com/rahul003
https://github.com/ptrendx
https://github.com/cavdard
https://github.com/rahul003
https://github.com/ptrendx
8https://github.com/NVIDIA/TransformerEngine/discussions/283
[Question] What is the memory footprint of te.Linear() weights ?https://github.com/NVIDIA/TransformerEngine/discussions/239
vince62shttps://github.com/vince62s
Q&Ahttps://github.com/NVIDIA/TransformerEngine/discussions/categories/q-a
https://github.com/vince62s
https://github.com/ptrendx
https://github.com/vince62s
https://github.com/ptrendx
1https://github.com/NVIDIA/TransformerEngine/discussions/239
How does TransformerEngine interact with TensorRT/Onnx?https://github.com/NVIDIA/TransformerEngine/discussions/238
tylerweitzmanhttps://github.com/tylerweitzman
Q&Ahttps://github.com/NVIDIA/TransformerEngine/discussions/categories/q-a
https://github.com/tylerweitzman
https://github.com/nzmora-nvidia
https://github.com/tylerweitzman
https://github.com/nzmora-nvidia
1https://github.com/NVIDIA/TransformerEngine/discussions/238
How to run LLaMa inference?https://github.com/NVIDIA/TransformerEngine/discussions/243
SinanAkkoyunhttps://github.com/SinanAkkoyun
Q&Ahttps://github.com/NVIDIA/TransformerEngine/discussions/categories/q-a
https://github.com/SinanAkkoyun
https://github.com/SinanAkkoyun
1https://github.com/NVIDIA/TransformerEngine/discussions/243
FP8 questions...https://github.com/NVIDIA/TransformerEngine/discussions/242
vgoklanihttps://github.com/vgoklani
Q&Ahttps://github.com/NVIDIA/TransformerEngine/discussions/categories/q-a
https://github.com/vgoklani
https://github.com/ptrendx
https://github.com/vgoklani
https://github.com/ptrendx
3https://github.com/NVIDIA/TransformerEngine/discussions/242
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.