| route-pattern | /:user_id/:repository |
| route-controller | files |
| route-action | disambiguate |
| fetch-nonce | v2:631a7a8b-dfb5-88e2-2916-41227f853566 |
| current-catalog-service-hash | f3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb |
| request-id | 875A:80411:24E880C:32FB4D9:698CE288 |
| html-safe-nonce | 846c4fb6e8cfa752c2d8fd9bdb1ac0483793091b0a1cc5df39eb2e459b442153 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI4NzVBOjgwNDExOjI0RTg4MEM6MzJGQjREOTo2OThDRTI4OCIsInZpc2l0b3JfaWQiOiIxNzg0MDE5MTk0NzgzNTIzNDY0IiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0= |
| visitor-hmac | 500606ce98b1d363c0618e76eb4b7d1bfe72bd988a4f6c273b78efd4aca35244 |
| hovercard-subject-tag | repository:714611628 |
| github-keyboard-shortcuts | repository,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | // |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/LightricksResearch/ast |
| twitter:image | https://opengraph.githubassets.com/405e3acc5d9cadaded9863daa7988f5401bf20302a7546874cc9c1133594a7bf/LightricksResearch/ast |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/405e3acc5d9cadaded9863daa7988f5401bf20302a7546874cc9c1133594a7bf/LightricksResearch/ast |
| og:image:alt | Code for the Interspeech 2021 paper "AST: Audio Spectrogram Transformer". - LightricksResearch/ast |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| hostname | github.com |
| expected-hostname | github.com |
| None | 640eeb7b6ff4d8d106235d228c0c286e82592d4d2403227b5b2b4fc5832297a4 |
| turbo-cache-control | no-preview |
| go-import | github.com/LightricksResearch/ast git https://github.com/LightricksResearch/ast.git |
| octolytics-dimension-user_id | 65680634 |
| octolytics-dimension-user_login | LightricksResearch |
| octolytics-dimension-repository_id | 714611628 |
| octolytics-dimension-repository_nwo | LightricksResearch/ast |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | true |
| octolytics-dimension-repository_parent_id | 373303693 |
| octolytics-dimension-repository_parent_nwo | YuanGongND/ast |
| octolytics-dimension-repository_network_root_id | 373303693 |
| octolytics-dimension-repository_network_root_nwo | YuanGongND/ast |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 3d444f0a47beeeac94cddbb51c91ab408befe8d4 |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
| Skip to content | https://patch-diff.githubusercontent.com/LightricksResearch/ast#start-of-content |
|
| https://patch-diff.githubusercontent.com/ |
|
Sign in
| https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2FLightricksResearch%2Fast |
| GitHub CopilotWrite better code with AI | https://github.com/features/copilot |
| GitHub SparkBuild and deploy intelligent apps | https://github.com/features/spark |
| GitHub ModelsManage and compare prompts | https://github.com/features/models |
| MCP RegistryNewIntegrate external tools | https://github.com/mcp |
| ActionsAutomate any workflow | https://github.com/features/actions |
| CodespacesInstant dev environments | https://github.com/features/codespaces |
| IssuesPlan and track work | https://github.com/features/issues |
| Code ReviewManage code changes | https://github.com/features/code-review |
| GitHub Advanced SecurityFind and fix vulnerabilities | https://github.com/security/advanced-security |
| Code securitySecure your code as you build | https://github.com/security/advanced-security/code-security |
| Secret protectionStop leaks before they start | https://github.com/security/advanced-security/secret-protection |
| Why GitHub | https://github.com/why-github |
| Documentation | https://docs.github.com |
| Blog | https://github.blog |
| Changelog | https://github.blog/changelog |
| Marketplace | https://github.com/marketplace |
| View all features | https://github.com/features |
| Enterprises | https://github.com/enterprise |
| Small and medium teams | https://github.com/team |
| Startups | https://github.com/enterprise/startups |
| Nonprofits | https://github.com/solutions/industry/nonprofits |
| App Modernization | https://github.com/solutions/use-case/app-modernization |
| DevSecOps | https://github.com/solutions/use-case/devsecops |
| DevOps | https://github.com/solutions/use-case/devops |
| CI/CD | https://github.com/solutions/use-case/ci-cd |
| View all use cases | https://github.com/solutions/use-case |
| Healthcare | https://github.com/solutions/industry/healthcare |
| Financial services | https://github.com/solutions/industry/financial-services |
| Manufacturing | https://github.com/solutions/industry/manufacturing |
| Government | https://github.com/solutions/industry/government |
| View all industries | https://github.com/solutions/industry |
| View all solutions | https://github.com/solutions |
| AI | https://github.com/resources/articles?topic=ai |
| Software Development | https://github.com/resources/articles?topic=software-development |
| DevOps | https://github.com/resources/articles?topic=devops |
| Security | https://github.com/resources/articles?topic=security |
| View all topics | https://github.com/resources/articles |
| Customer stories | https://github.com/customer-stories |
| Events & webinars | https://github.com/resources/events |
| Ebooks & reports | https://github.com/resources/whitepapers |
| Business insights | https://github.com/solutions/executive-insights |
| GitHub Skills | https://skills.github.com |
| Documentation | https://docs.github.com |
| Customer support | https://support.github.com |
| Community forum | https://github.com/orgs/community/discussions |
| Trust center | https://github.com/trust-center |
| Partners | https://github.com/partners |
| GitHub SponsorsFund open source developers | https://github.com/sponsors |
| Security Lab | https://securitylab.github.com |
| Maintainer Community | https://maintainers.github.com |
| Accelerator | https://github.com/accelerator |
| Archive Program | https://archiveprogram.github.com |
| Topics | https://github.com/topics |
| Trending | https://github.com/trending |
| Collections | https://github.com/collections |
| Enterprise platformAI-powered developer platform | https://github.com/enterprise |
| GitHub Advanced SecurityEnterprise-grade security features | https://github.com/security/advanced-security |
| Copilot for BusinessEnterprise-grade AI features | https://github.com/features/copilot/copilot-business |
| Premium SupportEnterprise-grade 24/7 support | https://github.com/premium-support |
| Pricing | https://github.com/pricing |
| Search syntax tips | https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax |
| documentation | https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax |
|
Sign in
| https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2FLightricksResearch%2Fast |
|
Sign up
| https://patch-diff.githubusercontent.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=LightricksResearch%2Fast |
| Reload | https://patch-diff.githubusercontent.com/LightricksResearch/ast |
| Reload | https://patch-diff.githubusercontent.com/LightricksResearch/ast |
| Reload | https://patch-diff.githubusercontent.com/LightricksResearch/ast |
|
LightricksResearch
| https://patch-diff.githubusercontent.com/LightricksResearch |
| ast | https://patch-diff.githubusercontent.com/LightricksResearch/ast |
| YuanGongND/ast | https://patch-diff.githubusercontent.com/YuanGongND/ast |
|
Notifications
| https://patch-diff.githubusercontent.com/login?return_to=%2FLightricksResearch%2Fast |
|
Fork
0
| https://patch-diff.githubusercontent.com/login?return_to=%2FLightricksResearch%2Fast |
|
Star
0
| https://patch-diff.githubusercontent.com/login?return_to=%2FLightricksResearch%2Fast |
|
BSD-3-Clause license
| https://patch-diff.githubusercontent.com/LightricksResearch/ast/blob/master/LICENSE |
|
0
stars
| https://patch-diff.githubusercontent.com/LightricksResearch/ast/stargazers |
|
242
forks
| https://patch-diff.githubusercontent.com/LightricksResearch/ast/forks |
|
Branches
| https://patch-diff.githubusercontent.com/LightricksResearch/ast/branches |
|
Tags
| https://patch-diff.githubusercontent.com/LightricksResearch/ast/tags |
|
Activity
| https://patch-diff.githubusercontent.com/LightricksResearch/ast/activity |
|
Star
| https://patch-diff.githubusercontent.com/login?return_to=%2FLightricksResearch%2Fast |
|
Notifications
| https://patch-diff.githubusercontent.com/login?return_to=%2FLightricksResearch%2Fast |
|
Code
| https://patch-diff.githubusercontent.com/LightricksResearch/ast |
|
Pull requests
0
| https://patch-diff.githubusercontent.com/LightricksResearch/ast/pulls |
|
Actions
| https://patch-diff.githubusercontent.com/LightricksResearch/ast/actions |
|
Projects
0
| https://patch-diff.githubusercontent.com/LightricksResearch/ast/projects |
|
Security
0
| https://patch-diff.githubusercontent.com/LightricksResearch/ast/security |
|
Insights
| https://patch-diff.githubusercontent.com/LightricksResearch/ast/pulse |
|
Code
| https://patch-diff.githubusercontent.com/LightricksResearch/ast |
|
Pull requests
| https://patch-diff.githubusercontent.com/LightricksResearch/ast/pulls |
|
Actions
| https://patch-diff.githubusercontent.com/LightricksResearch/ast/actions |
|
Projects
| https://patch-diff.githubusercontent.com/LightricksResearch/ast/projects |
|
Security
| https://patch-diff.githubusercontent.com/LightricksResearch/ast/security |
|
Insights
| https://patch-diff.githubusercontent.com/LightricksResearch/ast/pulse |
| Branches | https://patch-diff.githubusercontent.com/LightricksResearch/ast/branches |
| Tags | https://patch-diff.githubusercontent.com/LightricksResearch/ast/tags |
| https://patch-diff.githubusercontent.com/LightricksResearch/ast/branches |
| https://patch-diff.githubusercontent.com/LightricksResearch/ast/tags |
| 125 Commits | https://patch-diff.githubusercontent.com/LightricksResearch/ast/commits/master/ |
| https://patch-diff.githubusercontent.com/LightricksResearch/ast/commits/master/ |
| colab | https://patch-diff.githubusercontent.com/LightricksResearch/ast/tree/master/colab |
| colab | https://patch-diff.githubusercontent.com/LightricksResearch/ast/tree/master/colab |
| egs | https://patch-diff.githubusercontent.com/LightricksResearch/ast/tree/master/egs |
| egs | https://patch-diff.githubusercontent.com/LightricksResearch/ast/tree/master/egs |
| pretrained_models | https://patch-diff.githubusercontent.com/LightricksResearch/ast/tree/master/pretrained_models |
| pretrained_models | https://patch-diff.githubusercontent.com/LightricksResearch/ast/tree/master/pretrained_models |
| src_ast | https://patch-diff.githubusercontent.com/LightricksResearch/ast/tree/master/src_ast |
| src_ast | https://patch-diff.githubusercontent.com/LightricksResearch/ast/tree/master/src_ast |
| .gitignore | https://patch-diff.githubusercontent.com/LightricksResearch/ast/blob/master/.gitignore |
| .gitignore | https://patch-diff.githubusercontent.com/LightricksResearch/ast/blob/master/.gitignore |
| AST_ Audio Spectrogram Transformer _ Papers With Code.pdf | https://patch-diff.githubusercontent.com/LightricksResearch/ast/blob/master/AST_%20Audio%20Spectrogram%20Transformer%20_%20Papers%20With%20Code.pdf |
| AST_ Audio Spectrogram Transformer _ Papers With Code.pdf | https://patch-diff.githubusercontent.com/LightricksResearch/ast/blob/master/AST_%20Audio%20Spectrogram%20Transformer%20_%20Papers%20With%20Code.pdf |
| LICENSE | https://patch-diff.githubusercontent.com/LightricksResearch/ast/blob/master/LICENSE |
| LICENSE | https://patch-diff.githubusercontent.com/LightricksResearch/ast/blob/master/LICENSE |
| README.md | https://patch-diff.githubusercontent.com/LightricksResearch/ast/blob/master/README.md |
| README.md | https://patch-diff.githubusercontent.com/LightricksResearch/ast/blob/master/README.md |
| ast.png | https://patch-diff.githubusercontent.com/LightricksResearch/ast/blob/master/ast.png |
| ast.png | https://patch-diff.githubusercontent.com/LightricksResearch/ast/blob/master/ast.png |
| requirements.txt | https://patch-diff.githubusercontent.com/LightricksResearch/ast/blob/master/requirements.txt |
| requirements.txt | https://patch-diff.githubusercontent.com/LightricksResearch/ast/blob/master/requirements.txt |
| README | https://patch-diff.githubusercontent.com/LightricksResearch/ast |
| License | https://patch-diff.githubusercontent.com/LightricksResearch/ast |
| https://patch-diff.githubusercontent.com/LightricksResearch/ast#ast-audio-spectrogram-transformer |
| News | https://patch-diff.githubusercontent.com/LightricksResearch/ast#News |
| Introduction | https://patch-diff.githubusercontent.com/LightricksResearch/ast#Introduction |
| Citing | https://patch-diff.githubusercontent.com/LightricksResearch/ast#Citing |
| Getting Started | https://patch-diff.githubusercontent.com/LightricksResearch/ast#Getting-Started |
| ESC-50 Recipe | https://patch-diff.githubusercontent.com/LightricksResearch/ast#ESC-50-Recipe |
| Speechcommands Recipe | https://patch-diff.githubusercontent.com/LightricksResearch/ast#Speechcommands-V2-Recipe |
| AudioSet Recipe | https://patch-diff.githubusercontent.com/LightricksResearch/ast#Audioset-Recipe |
| Pretrained Models | https://patch-diff.githubusercontent.com/LightricksResearch/ast#Pretrained-Models |
| Use Pretrained Model For Downstream Tasks | https://patch-diff.githubusercontent.com/LightricksResearch/ast#Use-Pretrained-Model-For-Downstream-Tasks |
| Contact | https://patch-diff.githubusercontent.com/LightricksResearch/ast#Contact |
| https://patch-diff.githubusercontent.com/LightricksResearch/ast#news |
| [here] | https://github.com/YuanGongND/ltu |
| https://colab.research.google.com/github/YuanGongND/ast/blob/master/colab/AST_Inference_Demo.ipynb |
| bug | https://github.com/YuanGongND/ast/issues/58 |
| here | https://colab.research.google.com/github/YuanGongND/ast/blob/master/colab/torchaudio_SpecMasking_1_1.ipynb |
| CMKD: CNN/Transformer-Based Cross-Model Knowledge Distillation for Audio Classification | https://arxiv.org/abs/2203.06760 |
| Self-Supervised AST (SSAST) | https://arxiv.org/abs/2110.09784 |
| [here] | https://github.com/YuanGongND/ssast |
| PSLA training pipeline | https://arxiv.org/abs/2102.01243 |
| [here] | https://github.com/YuanGongND/psla |
| https://patch-diff.githubusercontent.com/LightricksResearch/ast#introduction |
| https://github.com/YuanGongND/ast/blob/master/ast.png?raw=true |
| AST: Audio Spectrogram Transformer | https://arxiv.org/abs/2104.01778 |
| ISCA SIGML talk | https://www.youtube.com/watch?v=CSRDbqGY0Vw |
| https://colab.research.google.com/github/YuanGongND/ast/blob/master/colab/AST_Inference_Demo.ipynb |
| https://patch-diff.githubusercontent.com/LightricksResearch/ast#citing |
| https://patch-diff.githubusercontent.com/LightricksResearch/ast#getting-started |
| here | https://github.com/YuanGongND/ast/blob/102f0477099f83e04f6f2b30a498464b78bbaf46/src/dataloader.py#L191 |
| https://colab.research.google.com/github/YuanGongND/ast/blob/master/colab/AST_Inference_Demo.ipynb |
| https://patch-diff.githubusercontent.com/LightricksResearch/ast#esc-50-recipe |
| https://patch-diff.githubusercontent.com/LightricksResearch/ast#speechcommands-v2-recipe |
| https://patch-diff.githubusercontent.com/LightricksResearch/ast#audioset-recipe |
| PSLA paper | https://arxiv.org/abs/2102.01243 |
| PSLA paper | https://arxiv.org/abs/2102.01243 |
| https://patch-diff.githubusercontent.com/LightricksResearch/ast#pretrained-models |
| Full AudioSet, 10 tstride, 10 fstride, with Weight Averaging (0.459 mAP) | https://www.dropbox.com/s/ca0b1v2nlxzyeb4/audioset_10_10_0.4593.pth?dl=1 |
| Full AudioSet, 10 tstride, 10 fstride, without Weight Averaging, Model 1 (0.450 mAP) | https://www.dropbox.com/s/1tv0hovue1bxupk/audioset_10_10_0.4495.pth?dl=1 |
| Full AudioSet, 10 tstride, 10 fstride, without Weight Averaging, Model 2 (0.448 mAP) | https://www.dropbox.com/s/6u5sikl4b9wo4u5/audioset_10_10_0.4483.pth?dl=1 |
| Full AudioSet, 10 tstride, 10 fstride, without Weight Averaging, Model 3 (0.448 mAP) | https://www.dropbox.com/s/kt6i0v9fvfm1mbq/audioset_10_10_0.4475.pth?dl=1 |
| Full AudioSet, 12 tstride, 12 fstride, without Weight Averaging, Model (0.447 mAP) | https://www.dropbox.com/s/snfhx3tizr4nuc8/audioset_12_12_0.4467.pth?dl=1 |
| Full AudioSet, 14 tstride, 14 fstride, without Weight Averaging, Model (0.443 mAP) | https://www.dropbox.com/s/z18s6pemtnxm4k7/audioset_14_14_0.4431.pth?dl=1 |
| Full AudioSet, 16 tstride, 16 fstride, without Weight Averaging, Model (0.442 mAP) | https://www.dropbox.com/s/mdsa4t1xmcimia6/audioset_16_16_0.4422.pth?dl=1 |
| Speechcommands V2-35, 10 tstride, 10 fstride, without Weight Averaging, Model (98.12% accuracy on evaluation set) | https://www.dropbox.com/s/q0tbqpwv44pquwy/speechcommands_10_10_0.9812.pth?dl=1 |
| OneDrive links | https://mitprod-my.sharepoint.com/:f:/g/personal/yuangong_mit_edu/ErLKkiP-GwVMgdsCeGEjsmoBMtGvXMkX3tCj5_I0E7ikNA?e=JE9Om8 |
| 腾讯微云链接们 | https://share.weiyun.com/xRGK6zmg |
| [OneDrive] | https://mitprod-my.sharepoint.com/:u:/g/personal/yuangong_mit_edu/EWrY3raql55CqxZNV3cVSkABaoU7pXQxAeJXudE1PTNzQg?e=gwEICj |
| [腾讯微云] | https://share.weiyun.com/kcmk2KHw |
| https://patch-diff.githubusercontent.com/LightricksResearch/ast#use-pretrained-model-for-downstream-tasks |
| PSLA paper | https://arxiv.org/abs/2102.01243 |
| https://patch-diff.githubusercontent.com/LightricksResearch/ast#contact |
|
Readme
| https://patch-diff.githubusercontent.com/LightricksResearch/ast#readme-ov-file |
|
BSD-3-Clause license
| https://patch-diff.githubusercontent.com/LightricksResearch/ast#BSD-3-Clause-1-ov-file |
| Please reload this page | https://patch-diff.githubusercontent.com/LightricksResearch/ast |
|
Activity | https://patch-diff.githubusercontent.com/LightricksResearch/ast/activity |
|
Custom properties | https://patch-diff.githubusercontent.com/LightricksResearch/ast/custom-properties |
|
0
stars | https://patch-diff.githubusercontent.com/LightricksResearch/ast/stargazers |
|
0
watching | https://patch-diff.githubusercontent.com/LightricksResearch/ast/watchers |
|
0
forks | https://patch-diff.githubusercontent.com/LightricksResearch/ast/forks |
|
Report repository
| https://patch-diff.githubusercontent.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2FLightricksResearch%2Fast&report=LightricksResearch+%28user%29 |
| Releases | https://patch-diff.githubusercontent.com/LightricksResearch/ast/releases |
| Packages
0 | https://patch-diff.githubusercontent.com/orgs/LightricksResearch/packages?repo_name=ast |
|
| https://github.com |
| Terms | https://docs.github.com/site-policy/github-terms/github-terms-of-service |
| Privacy | https://docs.github.com/site-policy/privacy-policies/github-privacy-statement |
| Security | https://github.com/security |
| Status | https://www.githubstatus.com/ |
| Community | https://github.community/ |
| Docs | https://docs.github.com/ |
| Contact | https://support.github.com?tags=dotcom-footer |