René's URL Explorer Experiment


Title: GitHub - sail-sg/Adan: Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models · GitHub

Open Graph Title: GitHub - sail-sg/Adan: Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

X Title: GitHub - sail-sg/Adan: Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

Description: Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models - sail-sg/Adan

Open Graph Description: Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models - sail-sg/Adan

X Description: Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models - sail-sg/Adan

Opengraph URL: https://github.com/sail-sg/Adan

X: @github

direct link

Domain: github.com

route-pattern/:user_id/:repository
route-controllerfiles
route-actiondisambiguate
fetch-noncev2:00d9460e-b923-7740-dbfe-b565659bee3a
current-catalog-service-hashf3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-idC458:139951:107FD:16117:6A4BBDAC
html-safe-nonce8ec0189425b131ca8fce190ba36d8858a99a36bd780c13b7c56511f312770147
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJDNDU4OjEzOTk1MToxMDdGRDoxNjExNzo2QTRCQkRBQyIsInZpc2l0b3JfaWQiOiI2NTk0MDIzNDk4NDYwMTUxMjEyIiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0=
visitor-hmac18abd6bdb69e40f379ec7ebe62df77df8ced2754b5724a1d8dc895b96dda0e19
hovercard-subject-tagrepository:531471133
github-keyboard-shortcutsrepository,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location//
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/sail-sg/Adan
twitter:imagehttps://opengraph.githubassets.com/4ddc75c33b48f405572d62507be663f070dd0cddcffbcb5b1079e854fa4303a5/sail-sg/Adan
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/4ddc75c33b48f405572d62507be663f070dd0cddcffbcb5b1079e854fa4303a5/sail-sg/Adan
og:image:altAdan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models - sail-sg/Adan
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
Noneae1c14875555a1dd92bdef45baa6dd9aa796df891e4e471989f7117fe3139fc1
turbo-cache-controlno-cache
go-importgithub.com/sail-sg/Adan git https://github.com/sail-sg/Adan.git
octolytics-dimension-user_id85740051
octolytics-dimension-user_loginsail-sg
octolytics-dimension-repository_id531471133
octolytics-dimension-repository_nwosail-sg/Adan
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id531471133
octolytics-dimension-repository_network_root_nwosail-sg/Adan
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
releaseb15c57117aeff522995a9578e1185f6c45d6c562
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/sail-sg/Adan#start-of-content
https://github.com/
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsail-sg%2FAdan
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub Copilot appDirect agents from issue to mergehttps://github.com/features/ai/github-app
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
View all resourceshttps://github.com/resources
GitHub SponsorsFund open source developershttps://github.com/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/accelerator
GitHub Starshttps://stars.github.com
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsail-sg%2FAdan
Sign up https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=sail-sg%2FAdan
Reloadhttps://github.com/sail-sg/Adan
Reloadhttps://github.com/sail-sg/Adan
Reloadhttps://github.com/sail-sg/Adan
Please reload this pagehttps://github.com/sail-sg/Adan
sail-sg https://github.com/sail-sg
Adanhttps://github.com/sail-sg/Adan
Notifications https://github.com/login?return_to=%2Fsail-sg%2FAdan
Fork 69 https://github.com/login?return_to=%2Fsail-sg%2FAdan
Star 819 https://github.com/login?return_to=%2Fsail-sg%2FAdan
Code https://github.com/sail-sg/Adan
Issues 6 https://github.com/sail-sg/Adan/issues
Pull requests 0 https://github.com/sail-sg/Adan/pulls
Actions https://github.com/sail-sg/Adan/actions
Projects https://github.com/sail-sg/Adan/projects
Security and quality 0 https://github.com/sail-sg/Adan/security
Insights https://github.com/sail-sg/Adan/pulse
Code https://github.com/sail-sg/Adan
Issues https://github.com/sail-sg/Adan/issues
Pull requests https://github.com/sail-sg/Adan/pulls
Actions https://github.com/sail-sg/Adan/actions
Projects https://github.com/sail-sg/Adan/projects
Security and quality https://github.com/sail-sg/Adan/security
Insights https://github.com/sail-sg/Adan/pulse
https://github.com/sail-sg/Adan
Brancheshttps://github.com/sail-sg/Adan/branches
Tagshttps://github.com/sail-sg/Adan/tags
https://github.com/sail-sg/Adan/branches
https://github.com/sail-sg/Adan/tags
30 Commitshttps://github.com/sail-sg/Adan/commits/main/
https://github.com/sail-sg/Adan/commits/main/
CVhttps://github.com/sail-sg/Adan/tree/main/CV
CVhttps://github.com/sail-sg/Adan/tree/main/CV
NLPhttps://github.com/sail-sg/Adan/tree/main/NLP
NLPhttps://github.com/sail-sg/Adan/tree/main/NLP
dreamfusionhttps://github.com/sail-sg/Adan/tree/main/dreamfusion
dreamfusionhttps://github.com/sail-sg/Adan/tree/main/dreamfusion
fused_adanhttps://github.com/sail-sg/Adan/tree/main/fused_adan
fused_adanhttps://github.com/sail-sg/Adan/tree/main/fused_adan
gpt2https://github.com/sail-sg/Adan/tree/main/gpt2
gpt2https://github.com/sail-sg/Adan/tree/main/gpt2
LICENSEhttps://github.com/sail-sg/Adan/blob/main/LICENSE
LICENSEhttps://github.com/sail-sg/Adan/blob/main/LICENSE
README.mdhttps://github.com/sail-sg/Adan/blob/main/README.md
README.mdhttps://github.com/sail-sg/Adan/blob/main/README.md
adan.pyhttps://github.com/sail-sg/Adan/blob/main/adan.py
adan.pyhttps://github.com/sail-sg/Adan/blob/main/adan.py
setup.pyhttps://github.com/sail-sg/Adan/blob/main/setup.py
setup.pyhttps://github.com/sail-sg/Adan/blob/main/setup.py
READMEhttps://github.com/sail-sg/Adan
Apache-2.0 licensehttps://github.com/sail-sg/Adan
https://github.com/sail-sg/Adan#adan-adaptive-nesterov-momentum-algorithm-for-faster-optimizing-deep-models
herehttps://arxiv.org/abs/2208.06677
https://github.com/sail-sg/Adan#supported-projects
Manifyhttps://github.com/pchlenski/manify
NeMohttps://github.com/NVIDIA/NeMo/blob/main/nemo/core/optim/adan.py
NVIDIAhttps://github.com/NVIDIA/NeMo
Consistent3Dhttps://github.com/sail-sg/Consistent3D
MDT V2https://github.com/sail-sg/MDT
D-Adaptationhttps://github.com/facebookresearch/dadaptation
Meta AIhttps://github.com/facebookresearch
Paddlehttps://github.com/PaddlePaddle/Paddle/pull/55048#commits-pushed-563d32c
Baidu(百度飞浆)https://github.com/PaddlePaddle/Paddle
Timmhttps://github.com/rwightman/pytorch-image-models
Huggingfacehttps://github.com/huggingface
DreamFusion Projecthttps://github.com/ashawkey/stable-dreamfusion
herehttps://github.com/sail-sg/Adan/blob/main/dreamfusion
MMClassificationhttps://github.com/open-mmlab/mmclassification/tree/dev-1.x
OpenMMLabhttps://openmmlab.com/
herehttps://github.com/open-mmlab/mmclassification/pull/1180
DenisVorotyntsev/Adanhttps://github.com/DenisVorotyntsev/Adan
Deepmind/optaxhttps://github.com/deepmind/optax
https://github.com/sail-sg/Adan#news
https://github.com/sail-sg/Adan#installation
https://github.com/sail-sg/Adan#usage
https://github.com/sail-sg/Adan#1-two-steps-to-use-adan
https://github.com/sail-sg/Adan#2-tips-for-experiments
ZeroRedundancyOptimizerhttps://pytorch.org/tutorials/recipes/zero_redundancy_optimizer.html
https://github.com/sail-sg/Adan#3-more-extra-detailed-stepsresults
Instructionhttps://github.com/sail-sg/Adan/blob/main/CV/timm
Instructionhttps://github.com/sail-sg/Adan/blob/main/CV/MAE
Instructionhttps://github.com/sail-sg/Adan/blob/main/NLP/BERT
Instructionhttps://github.com/sail-sg/Adan/blob/main/NLP/Transformer-XL
Instructionhttps://github.com/sail-sg/Adan/blob/main/gpt2
Resutlshttps://github.com/sail-sg/Adan/blob/main/dreamfusion
https://github.com/sail-sg/Adan#results-for-various-tasks
https://github.com/sail-sg/Adan#results-on-large-language-models
https://github.com/sail-sg/Adan#mixture-of-experts-moe
MoE modelshttps://arxiv.org/pdf/2406.06563
RedPajama-v2 datasethttps://github.com/togethercomputer/RedPajama-Data
https://private-user-images.githubusercontent.com/10042844/345148828-4c69c8d2-cb52-4c96-8d6b-574adc8ca775.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3ODMzNDg5NTMsIm5iZiI6MTc4MzM0ODY1MywicGF0aCI6Ii8xMDA0Mjg0NC8zNDUxNDg4MjgtNGM2OWM4ZDItY2I1Mi00Yzk2LThkNmItNTc0YWRjOGNhNzc1LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNjA3MDYlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjYwNzA2VDE0MzczM1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTFlNTQyY2JmYWFhOWFhN2UzOWUyY2U1NDdmMmZmZDgwN2FiOTBmZWVjMTAzNTUxNTY0MjgwZjhmYzFjMTg2NWUmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JnJlc3BvbnNlLWNvbnRlbnQtdHlwZT1pbWFnZSUyRnBuZyJ9.wuoCYK86ktouLYZ0lRWwZHkdQ2PnrGiK_eOLd4wyhHE
https://private-user-images.githubusercontent.com/10042844/345148649-d8d79ee3-c19c-4cdf-9ba0-939d030f49a9.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3ODMzNDg5NTMsIm5iZiI6MTc4MzM0ODY1MywicGF0aCI6Ii8xMDA0Mjg0NC8zNDUxNDg2NDktZDhkNzllZTMtYzE5Yy00Y2RmLTliYTAtOTM5ZDAzMGY0OWE5LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNjA3MDYlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjYwNzA2VDE0MzczM1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWY4ODgxZjljZDA2NDY3YjdhMzM3MDM1MTJhY2E4ZTBlOWQ4OWI1ZWQ0NjdkMWQ5ZjFkNzc2ZmM1NDUxMzk2ZjgmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JnJlc3BvbnNlLWNvbnRlbnQtdHlwZT1pbWFnZSUyRnBuZyJ9.d2fs60Q2ER32V60ROM5jJodwqsYnH0Xlu00KKm--POY
https://github.com/sail-sg/Adan#gpt2-345m
BigCodehttps://www.bigcode-project.org/
HumanEvalhttps://github.com/openai/human-eval
HumanEvalhttps://github.com/openai/human-eval
log&confighttps://github.com/sail-sg/Adan/files/10362486/gpt2-adam.log
log&confighttps://github.com/sail-sg/Adan/files/10362485/gpt2-adan.log
https://github.com/sail-sg/Adan#results-on-vision-tasks
confighttps://github.com/sail-sg/Adan/blob/main/CV/timm/exp_results/ViT/small/args_vit-s_150-I.yaml
loghttps://github.com/sail-sg/Adan/blob/main/CV/timm/exp_results/ViT/small/summary_vit-s_150-I.csv
confighttps://github.com/sail-sg/Adan/blob/main/CV/timm/exp_results/ViT/small/args_vit-s_150.yaml
loghttps://github.com/sail-sg/Adan/blob/main/CV/timm/exp_results/ViT/small/summary_vit-s_150.csv
confighttps://github.com/sail-sg/Adan/blob/main/CV/timm/exp_results/ViT/small/args_vit-s_300-I.yaml
loghttps://github.com/sail-sg/Adan/blob/main/CV/timm/exp_results/ViT/small/summary_vit-s_300-I.csv
confighttps://github.com/sail-sg/Adan/blob/main/CV/timm/exp_results/ViT/small/args_vit-s_300.yaml
loghttps://github.com/sail-sg/Adan/blob/main/CV/timm/exp_results/ViT/small/summary_vit-s_300.csv
confighttps://github.com/sail-sg/Adan/blob/main/CV/timm/exp_results/ViT/base/args_vit-B_150.yaml
loghttps://github.com/sail-sg/Adan/blob/main/CV/timm/exp_results/ViT/base/summary_vit-B_150.csv
confighttps://github.com/sail-sg/Adan/blob/main/CV/timm/exp_results/ViT/base/args_vit-B_300_T.yaml
loghttps://github.com/sail-sg/Adan/blob/main/CV/timm/exp_results/ViT/base/summary_vit-B_300_T.csv
confighttps://github.com/sail-sg/Adan/blob/main/CV/timm/exp_results/ResNet/Res50/args_res50_100.yaml
loghttps://github.com/sail-sg/Adan/blob/main/CV/timm/exp_results/ResNet/Res50/summary_res50_100.csv
confighttps://github.com/sail-sg/Adan/blob/main/CV/timm/exp_results/ResNet/Res50/args_res50_200.yaml
loghttps://github.com/sail-sg/Adan/blob/main/CV/timm/exp_results/ResNet/Res50/summary_res50_200.csv
confighttps://github.com/sail-sg/Adan/blob/main/CV/timm/exp_results/ResNet/Res50/args_res50_300.yaml
loghttps://github.com/sail-sg/Adan/blob/main/CV/timm/exp_results/ResNet/Res50/summary_res50_300.csv
confighttps://github.com/sail-sg/Adan/blob/main/CV/timm/exp_results/ResNet/Res101/args_res101_100.yaml
loghttps://github.com/sail-sg/Adan/blob/main/CV/timm/exp_results/ResNet/Res101/summary_res101_100.csv
confighttps://github.com/sail-sg/Adan/blob/main/CV/timm/exp_results/ResNet/Res101/args_res101_200.yaml
loghttps://github.com/sail-sg/Adan/blob/main/CV/timm/exp_results/ResNet/Res101/summary_res101_200.csv
confighttps://github.com/sail-sg/Adan/blob/main/CV/timm/exp_results/ResNet/Res101/args_res101_300.yaml
loghttps://github.com/sail-sg/Adan/blob/main/CV/timm/exp_results/ResNet/Res101/summary_res101_300.csv
confighttps://github.com/sail-sg/Adan/blob/main/CV/timm/exp_results/ConvNext/small/args_cvnext_150.yaml
loghttps://github.com/sail-sg/Adan/blob/main/CV/timm/exp_results/ConvNext/small/summary_cvnext_150.csv
confighttps://github.com/sail-sg/Adan/blob/main/CV/timm/exp_results/ConvNext/small/args_cvnext_300.yaml
loghttps://github.com/sail-sg/Adan/blob/main/CV/timm/exp_results/ConvNext/small/summary_cvnext_300.csv
confighttps://github.com/sail-sg/Adan/blob/main/CV/MAE/README.md
log-pretrainhttps://github.com/sail-sg/Adan/blob/main/CV/MAE/exp_results/MAE/base/log_base_pretrain.txt
log-finetunehttps://github.com/sail-sg/Adan/blob/main/CV/MAE/exp_results/MAE/base/log_base_ft.txt
confighttps://github.com/sail-sg/Adan/blob/main/CV/MAE/README.md
log-pretrainhttps://github.com/sail-sg/Adan/blob/main/CV/MAE/exp_results/MAE/large/log_large_pretrain.txt
log-finetunehttps://github.com/sail-sg/Adan/blob/main/CV/MAE/exp_results/MAE/large/log_large_ft.txt
https://github.com/sail-sg/Adan#results-on-nlp-tasks
https://github.com/sail-sg/Adan#bert-base
instructionshttps://github.com/sail-sg/Adan/blob/main/NLP/BERT/README.md
confighttps://github.com/sail-sg/Adan/blob/main/NLP/BERT/config/pretraining/bert-adan.yaml
loghttps://github.com/sail-sg/Adan/blob/main/NLP/BERT/exp_results/pretrain/hydra_train-adan.log
confighttps://github.com/sail-sg/Adan/blob/main/NLP/BERT/config/finetuning/cola-adan.yaml
confighttps://github.com/sail-sg/Adan/blob/main/NLP/BERT/config/finetuning/sst_2-adan.yaml
confighttps://github.com/sail-sg/Adan/blob/main/NLP/BERT/config/finetuning/sts_b-adan.yaml
confighttps://github.com/sail-sg/Adan/blob/main/NLP/BERT/config/finetuning/qqp-adan.yaml
confighttps://github.com/sail-sg/Adan/blob/main/NLP/BERT/config/finetuning/mnli-adan.yaml
confighttps://github.com/sail-sg/Adan/blob/main/NLP/BERT/config/finetuning/qnli-adan.yaml
confighttps://github.com/sail-sg/Adan/blob/main/NLP/BERT/config/finetuning/rte-adan.yaml
https://github.com/sail-sg/Adan#transformer-xl-base
log&confighttps://github.com/sail-sg/Adan/blob/main/NLP/Transformer-XL/exp_results/log-adam.txt
log&confighttps://github.com/sail-sg/Adan/blob/main/NLP/Transformer-XL/exp_results/log-50k.txt
log&confighttps://github.com/sail-sg/Adan/blob/main/NLP/Transformer-XL/exp_results/log-100k.txt
log&confighttps://github.com/sail-sg/Adan/blob/main/NLP/Transformer-XL/exp_results/log-200k.txt
https://github.com/sail-sg/Adan#results-on-large-language-models-1
https://github.com/sail-sg/Adan#gpt2-345m-1
BigCodehttps://www.bigcode-project.org/
HumanEvalhttps://github.com/openai/human-eval
HumanEvalhttps://github.com/openai/human-eval
log&confighttps://github.com/sail-sg/Adan/files/10362486/gpt2-adam.log
log&confighttps://github.com/sail-sg/Adan/files/10362485/gpt2-adan.log
https://github.com/sail-sg/Adan#results-on-diffusion-models
DreamFusion Projecthttps://github.com/ashawkey/stable-dreamfusion
herehttps://github.com/sail-sg/Adan/blob/main/dreamfusion
https://github.com/sail-sg/Adan#memory-and-efficiency
herehttps://github.com/sail-sg/Adan/blob/main/fused_adan/README.md
deep-learning https://github.com/topics/deep-learning
optimizer https://github.com/topics/optimizer
pytorch https://github.com/topics/pytorch
artificial-intelligence https://github.com/topics/artificial-intelligence
moe https://github.com/topics/moe
resnet https://github.com/topics/resnet
vit https://github.com/topics/vit
diffusion https://github.com/topics/diffusion
mae https://github.com/topics/mae
fairseq https://github.com/topics/fairseq
cuda-programming https://github.com/topics/cuda-programming
bert-model https://github.com/topics/bert-model
gpt2 https://github.com/topics/gpt2
transformer-xl https://github.com/topics/transformer-xl
timm https://github.com/topics/timm
convnext https://github.com/topics/convnext
adan https://github.com/topics/adan
llms https://github.com/topics/llms
dreamfusion https://github.com/topics/dreamfusion
llm-training https://github.com/topics/llm-training
Readme https://github.com/sail-sg/Adan#readme-ov-file
Apache-2.0 license https://github.com/sail-sg/Adan#Apache-2.0-1-ov-file
Please reload this pagehttps://github.com/sail-sg/Adan
Activityhttps://github.com/sail-sg/Adan/activity
Custom propertieshttps://github.com/sail-sg/Adan/custom-properties
69 forkshttps://github.com/sail-sg/Adan/forks
Report repository https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Fsail-sg%2FAdan&report=sail-sg+%28user%29
Please reload this pagehttps://github.com/sail-sg/Adan
Contributorshttps://github.com/sail-sg/Adan/graphs/contributors
Please reload this pagehttps://github.com/sail-sg/Adan
Python 87.8% https://github.com/sail-sg/Adan/search?l=python
Cuda 7.1% https://github.com/sail-sg/Adan/search?l=cuda
C++ 4.2% https://github.com/sail-sg/Adan/search?l=c%2B%2B
Shell 0.9% https://github.com/sail-sg/Adan/search?l=shell
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.