René's URL Explorer Experiment


Title: GitHub - LightricksResearch/ast: Code for the Interspeech 2021 paper "AST: Audio Spectrogram Transformer".

Open Graph Title: GitHub - LightricksResearch/ast: Code for the Interspeech 2021 paper "AST: Audio Spectrogram Transformer".

X Title: GitHub - LightricksResearch/ast: Code for the Interspeech 2021 paper "AST: Audio Spectrogram Transformer".

Description: Code for the Interspeech 2021 paper "AST: Audio Spectrogram Transformer". - LightricksResearch/ast

Open Graph Description: Code for the Interspeech 2021 paper "AST: Audio Spectrogram Transformer". - LightricksResearch/ast

X Description: Code for the Interspeech 2021 paper "AST: Audio Spectrogram Transformer". - LightricksResearch/ast

Mail addresses
yuangong@mit.edu

Opengraph URL: https://github.com/LightricksResearch/ast

X: @github

direct link

Domain: patch-diff.githubusercontent.com

route-pattern/:user_id/:repository
route-controllerfiles
route-actiondisambiguate
fetch-noncev2:631a7a8b-dfb5-88e2-2916-41227f853566
current-catalog-service-hashf3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-id875A:80411:24E880C:32FB4D9:698CE288
html-safe-nonce846c4fb6e8cfa752c2d8fd9bdb1ac0483793091b0a1cc5df39eb2e459b442153
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI4NzVBOjgwNDExOjI0RTg4MEM6MzJGQjREOTo2OThDRTI4OCIsInZpc2l0b3JfaWQiOiIxNzg0MDE5MTk0NzgzNTIzNDY0IiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0=
visitor-hmac500606ce98b1d363c0618e76eb4b7d1bfe72bd988a4f6c273b78efd4aca35244
hovercard-subject-tagrepository:714611628
github-keyboard-shortcutsrepository,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location//
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/LightricksResearch/ast
twitter:imagehttps://opengraph.githubassets.com/405e3acc5d9cadaded9863daa7988f5401bf20302a7546874cc9c1133594a7bf/LightricksResearch/ast
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/405e3acc5d9cadaded9863daa7988f5401bf20302a7546874cc9c1133594a7bf/LightricksResearch/ast
og:image:altCode for the Interspeech 2021 paper "AST: Audio Spectrogram Transformer". - LightricksResearch/ast
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None640eeb7b6ff4d8d106235d228c0c286e82592d4d2403227b5b2b4fc5832297a4
turbo-cache-controlno-preview
go-importgithub.com/LightricksResearch/ast git https://github.com/LightricksResearch/ast.git
octolytics-dimension-user_id65680634
octolytics-dimension-user_loginLightricksResearch
octolytics-dimension-repository_id714611628
octolytics-dimension-repository_nwoLightricksResearch/ast
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forktrue
octolytics-dimension-repository_parent_id373303693
octolytics-dimension-repository_parent_nwoYuanGongND/ast
octolytics-dimension-repository_network_root_id373303693
octolytics-dimension-repository_network_root_nwoYuanGongND/ast
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release3d444f0a47beeeac94cddbb51c91ab408befe8d4
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://patch-diff.githubusercontent.com/LightricksResearch/ast#start-of-content
https://patch-diff.githubusercontent.com/
Sign in https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2FLightricksResearch%2Fast
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub SparkBuild and deploy intelligent appshttps://github.com/features/spark
GitHub ModelsManage and compare promptshttps://github.com/features/models
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
GitHub SponsorsFund open source developershttps://github.com/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/accelerator
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2FLightricksResearch%2Fast
Sign up https://patch-diff.githubusercontent.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=LightricksResearch%2Fast
Reloadhttps://patch-diff.githubusercontent.com/LightricksResearch/ast
Reloadhttps://patch-diff.githubusercontent.com/LightricksResearch/ast
Reloadhttps://patch-diff.githubusercontent.com/LightricksResearch/ast
LightricksResearch https://patch-diff.githubusercontent.com/LightricksResearch
asthttps://patch-diff.githubusercontent.com/LightricksResearch/ast
YuanGongND/asthttps://patch-diff.githubusercontent.com/YuanGongND/ast
Notifications https://patch-diff.githubusercontent.com/login?return_to=%2FLightricksResearch%2Fast
Fork 0 https://patch-diff.githubusercontent.com/login?return_to=%2FLightricksResearch%2Fast
Star 0 https://patch-diff.githubusercontent.com/login?return_to=%2FLightricksResearch%2Fast
BSD-3-Clause license https://patch-diff.githubusercontent.com/LightricksResearch/ast/blob/master/LICENSE
0 stars https://patch-diff.githubusercontent.com/LightricksResearch/ast/stargazers
242 forks https://patch-diff.githubusercontent.com/LightricksResearch/ast/forks
Branches https://patch-diff.githubusercontent.com/LightricksResearch/ast/branches
Tags https://patch-diff.githubusercontent.com/LightricksResearch/ast/tags
Activity https://patch-diff.githubusercontent.com/LightricksResearch/ast/activity
Star https://patch-diff.githubusercontent.com/login?return_to=%2FLightricksResearch%2Fast
Notifications https://patch-diff.githubusercontent.com/login?return_to=%2FLightricksResearch%2Fast
Code https://patch-diff.githubusercontent.com/LightricksResearch/ast
Pull requests 0 https://patch-diff.githubusercontent.com/LightricksResearch/ast/pulls
Actions https://patch-diff.githubusercontent.com/LightricksResearch/ast/actions
Projects 0 https://patch-diff.githubusercontent.com/LightricksResearch/ast/projects
Security 0 https://patch-diff.githubusercontent.com/LightricksResearch/ast/security
Insights https://patch-diff.githubusercontent.com/LightricksResearch/ast/pulse
Code https://patch-diff.githubusercontent.com/LightricksResearch/ast
Pull requests https://patch-diff.githubusercontent.com/LightricksResearch/ast/pulls
Actions https://patch-diff.githubusercontent.com/LightricksResearch/ast/actions
Projects https://patch-diff.githubusercontent.com/LightricksResearch/ast/projects
Security https://patch-diff.githubusercontent.com/LightricksResearch/ast/security
Insights https://patch-diff.githubusercontent.com/LightricksResearch/ast/pulse
Brancheshttps://patch-diff.githubusercontent.com/LightricksResearch/ast/branches
Tagshttps://patch-diff.githubusercontent.com/LightricksResearch/ast/tags
https://patch-diff.githubusercontent.com/LightricksResearch/ast/branches
https://patch-diff.githubusercontent.com/LightricksResearch/ast/tags
125 Commitshttps://patch-diff.githubusercontent.com/LightricksResearch/ast/commits/master/
https://patch-diff.githubusercontent.com/LightricksResearch/ast/commits/master/
colabhttps://patch-diff.githubusercontent.com/LightricksResearch/ast/tree/master/colab
colabhttps://patch-diff.githubusercontent.com/LightricksResearch/ast/tree/master/colab
egshttps://patch-diff.githubusercontent.com/LightricksResearch/ast/tree/master/egs
egshttps://patch-diff.githubusercontent.com/LightricksResearch/ast/tree/master/egs
pretrained_modelshttps://patch-diff.githubusercontent.com/LightricksResearch/ast/tree/master/pretrained_models
pretrained_modelshttps://patch-diff.githubusercontent.com/LightricksResearch/ast/tree/master/pretrained_models
src_asthttps://patch-diff.githubusercontent.com/LightricksResearch/ast/tree/master/src_ast
src_asthttps://patch-diff.githubusercontent.com/LightricksResearch/ast/tree/master/src_ast
.gitignorehttps://patch-diff.githubusercontent.com/LightricksResearch/ast/blob/master/.gitignore
.gitignorehttps://patch-diff.githubusercontent.com/LightricksResearch/ast/blob/master/.gitignore
AST_ Audio Spectrogram Transformer _ Papers With Code.pdfhttps://patch-diff.githubusercontent.com/LightricksResearch/ast/blob/master/AST_%20Audio%20Spectrogram%20Transformer%20_%20Papers%20With%20Code.pdf
AST_ Audio Spectrogram Transformer _ Papers With Code.pdfhttps://patch-diff.githubusercontent.com/LightricksResearch/ast/blob/master/AST_%20Audio%20Spectrogram%20Transformer%20_%20Papers%20With%20Code.pdf
LICENSEhttps://patch-diff.githubusercontent.com/LightricksResearch/ast/blob/master/LICENSE
LICENSEhttps://patch-diff.githubusercontent.com/LightricksResearch/ast/blob/master/LICENSE
README.mdhttps://patch-diff.githubusercontent.com/LightricksResearch/ast/blob/master/README.md
README.mdhttps://patch-diff.githubusercontent.com/LightricksResearch/ast/blob/master/README.md
ast.pnghttps://patch-diff.githubusercontent.com/LightricksResearch/ast/blob/master/ast.png
ast.pnghttps://patch-diff.githubusercontent.com/LightricksResearch/ast/blob/master/ast.png
requirements.txthttps://patch-diff.githubusercontent.com/LightricksResearch/ast/blob/master/requirements.txt
requirements.txthttps://patch-diff.githubusercontent.com/LightricksResearch/ast/blob/master/requirements.txt
READMEhttps://patch-diff.githubusercontent.com/LightricksResearch/ast
Licensehttps://patch-diff.githubusercontent.com/LightricksResearch/ast
https://patch-diff.githubusercontent.com/LightricksResearch/ast#ast-audio-spectrogram-transformer
Newshttps://patch-diff.githubusercontent.com/LightricksResearch/ast#News
Introductionhttps://patch-diff.githubusercontent.com/LightricksResearch/ast#Introduction
Citinghttps://patch-diff.githubusercontent.com/LightricksResearch/ast#Citing
Getting Startedhttps://patch-diff.githubusercontent.com/LightricksResearch/ast#Getting-Started
ESC-50 Recipehttps://patch-diff.githubusercontent.com/LightricksResearch/ast#ESC-50-Recipe
Speechcommands Recipehttps://patch-diff.githubusercontent.com/LightricksResearch/ast#Speechcommands-V2-Recipe
AudioSet Recipehttps://patch-diff.githubusercontent.com/LightricksResearch/ast#Audioset-Recipe
Pretrained Modelshttps://patch-diff.githubusercontent.com/LightricksResearch/ast#Pretrained-Models
Use Pretrained Model For Downstream Taskshttps://patch-diff.githubusercontent.com/LightricksResearch/ast#Use-Pretrained-Model-For-Downstream-Tasks
Contacthttps://patch-diff.githubusercontent.com/LightricksResearch/ast#Contact
https://patch-diff.githubusercontent.com/LightricksResearch/ast#news
[here]https://github.com/YuanGongND/ltu
https://colab.research.google.com/github/YuanGongND/ast/blob/master/colab/AST_Inference_Demo.ipynb
bughttps://github.com/YuanGongND/ast/issues/58
herehttps://colab.research.google.com/github/YuanGongND/ast/blob/master/colab/torchaudio_SpecMasking_1_1.ipynb
CMKD: CNN/Transformer-Based Cross-Model Knowledge Distillation for Audio Classificationhttps://arxiv.org/abs/2203.06760
Self-Supervised AST (SSAST)https://arxiv.org/abs/2110.09784
[here]https://github.com/YuanGongND/ssast
PSLA training pipelinehttps://arxiv.org/abs/2102.01243
[here]https://github.com/YuanGongND/psla
https://patch-diff.githubusercontent.com/LightricksResearch/ast#introduction
https://github.com/YuanGongND/ast/blob/master/ast.png?raw=true
AST: Audio Spectrogram Transformerhttps://arxiv.org/abs/2104.01778
ISCA SIGML talkhttps://www.youtube.com/watch?v=CSRDbqGY0Vw
https://colab.research.google.com/github/YuanGongND/ast/blob/master/colab/AST_Inference_Demo.ipynb
https://patch-diff.githubusercontent.com/LightricksResearch/ast#citing
https://patch-diff.githubusercontent.com/LightricksResearch/ast#getting-started
herehttps://github.com/YuanGongND/ast/blob/102f0477099f83e04f6f2b30a498464b78bbaf46/src/dataloader.py#L191
https://colab.research.google.com/github/YuanGongND/ast/blob/master/colab/AST_Inference_Demo.ipynb
https://patch-diff.githubusercontent.com/LightricksResearch/ast#esc-50-recipe
https://patch-diff.githubusercontent.com/LightricksResearch/ast#speechcommands-v2-recipe
https://patch-diff.githubusercontent.com/LightricksResearch/ast#audioset-recipe
PSLA paperhttps://arxiv.org/abs/2102.01243
PSLA paperhttps://arxiv.org/abs/2102.01243
https://patch-diff.githubusercontent.com/LightricksResearch/ast#pretrained-models
Full AudioSet, 10 tstride, 10 fstride, with Weight Averaging (0.459 mAP)https://www.dropbox.com/s/ca0b1v2nlxzyeb4/audioset_10_10_0.4593.pth?dl=1
Full AudioSet, 10 tstride, 10 fstride, without Weight Averaging, Model 1 (0.450 mAP)https://www.dropbox.com/s/1tv0hovue1bxupk/audioset_10_10_0.4495.pth?dl=1
Full AudioSet, 10 tstride, 10 fstride, without Weight Averaging, Model 2 (0.448 mAP)https://www.dropbox.com/s/6u5sikl4b9wo4u5/audioset_10_10_0.4483.pth?dl=1
Full AudioSet, 10 tstride, 10 fstride, without Weight Averaging, Model 3 (0.448 mAP)https://www.dropbox.com/s/kt6i0v9fvfm1mbq/audioset_10_10_0.4475.pth?dl=1
Full AudioSet, 12 tstride, 12 fstride, without Weight Averaging, Model (0.447 mAP)https://www.dropbox.com/s/snfhx3tizr4nuc8/audioset_12_12_0.4467.pth?dl=1
Full AudioSet, 14 tstride, 14 fstride, without Weight Averaging, Model (0.443 mAP)https://www.dropbox.com/s/z18s6pemtnxm4k7/audioset_14_14_0.4431.pth?dl=1
Full AudioSet, 16 tstride, 16 fstride, without Weight Averaging, Model (0.442 mAP)https://www.dropbox.com/s/mdsa4t1xmcimia6/audioset_16_16_0.4422.pth?dl=1
Speechcommands V2-35, 10 tstride, 10 fstride, without Weight Averaging, Model (98.12% accuracy on evaluation set)https://www.dropbox.com/s/q0tbqpwv44pquwy/speechcommands_10_10_0.9812.pth?dl=1
OneDrive linkshttps://mitprod-my.sharepoint.com/:f:/g/personal/yuangong_mit_edu/ErLKkiP-GwVMgdsCeGEjsmoBMtGvXMkX3tCj5_I0E7ikNA?e=JE9Om8
腾讯微云链接们https://share.weiyun.com/xRGK6zmg
[OneDrive]https://mitprod-my.sharepoint.com/:u:/g/personal/yuangong_mit_edu/EWrY3raql55CqxZNV3cVSkABaoU7pXQxAeJXudE1PTNzQg?e=gwEICj
[腾讯微云]https://share.weiyun.com/kcmk2KHw
https://patch-diff.githubusercontent.com/LightricksResearch/ast#use-pretrained-model-for-downstream-tasks
PSLA paperhttps://arxiv.org/abs/2102.01243
https://patch-diff.githubusercontent.com/LightricksResearch/ast#contact
Readme https://patch-diff.githubusercontent.com/LightricksResearch/ast#readme-ov-file
BSD-3-Clause license https://patch-diff.githubusercontent.com/LightricksResearch/ast#BSD-3-Clause-1-ov-file
Please reload this pagehttps://patch-diff.githubusercontent.com/LightricksResearch/ast
Activityhttps://patch-diff.githubusercontent.com/LightricksResearch/ast/activity
Custom propertieshttps://patch-diff.githubusercontent.com/LightricksResearch/ast/custom-properties
0 starshttps://patch-diff.githubusercontent.com/LightricksResearch/ast/stargazers
0 watchinghttps://patch-diff.githubusercontent.com/LightricksResearch/ast/watchers
0 forkshttps://patch-diff.githubusercontent.com/LightricksResearch/ast/forks
Report repository https://patch-diff.githubusercontent.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2FLightricksResearch%2Fast&report=LightricksResearch+%28user%29
Releaseshttps://patch-diff.githubusercontent.com/LightricksResearch/ast/releases
Packages 0https://patch-diff.githubusercontent.com/orgs/LightricksResearch/packages?repo_name=ast
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.