René's URL Explorer Experiment


Title: GitHub - microsoft/unilm: Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

Open Graph Title: GitHub - microsoft/unilm: Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

X Title: GitHub - microsoft/unilm: Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

Description: Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities - microsoft/unilm

Open Graph Description: Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities - microsoft/unilm

X Description: Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities - microsoft/unilm

Mail addresses
fuwei@microsoft.com
fuwei@microsoft.com

Opengraph URL: https://github.com/microsoft/unilm

X: @github

direct link

Domain: patch-diff.githubusercontent.com

route-pattern/:user_id/:repository
route-controllerfiles
route-actiondisambiguate
fetch-noncev2:c55f1207-27ba-e9f5-1205-1a12a1646341
current-catalog-service-hashf3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-idBFF6:3DC8AB:9233AF:C93E05:696FEB8C
html-safe-nonce1a7618e69783e264ae2c485ce357ab266384acf2afd2159fbcca099644dc0cd9
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJCRkY2OjNEQzhBQjo5MjMzQUY6QzkzRTA1OjY5NkZFQjhDIiwidmlzaXRvcl9pZCI6IjM2NzU1MTcyNDI4NDIyNzg3OTYiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmac15f901f6e6d2fea106fe2141bc14a3f5ca8dfc1cb3bf2161759e43de443fcf3c
hovercard-subject-tagrepository:198350484
github-keyboard-shortcutsrepository,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location//
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/microsoft/unilm
twitter:imagehttps://opengraph.githubassets.com/f22e6453ae6184e983676d0953dee1437ac1891ccc2ecfaa5ca70a0e7d7e99c1/microsoft/unilm
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/f22e6453ae6184e983676d0953dee1437ac1891ccc2ecfaa5ca70a0e7d7e99c1/microsoft/unilm
og:image:altLarge-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities - microsoft/unilm
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None2b218dbdee134592a2dbfabd454a1070986f1fbedb8334bf06b8f2ccc3449130
turbo-cache-controlno-preview
go-importgithub.com/microsoft/unilm git https://github.com/microsoft/unilm.git
octolytics-dimension-user_id6154722
octolytics-dimension-user_loginmicrosoft
octolytics-dimension-repository_id198350484
octolytics-dimension-repository_nwomicrosoft/unilm
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id198350484
octolytics-dimension-repository_network_root_nwomicrosoft/unilm
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
releasebcaac379a58a3ed99a1b0502e2a8f5cfd3a7b54b
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://patch-diff.githubusercontent.com/microsoft/unilm#start-of-content
https://patch-diff.githubusercontent.com/
Sign in https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Fmicrosoft%2Funilm
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub SparkBuild and deploy intelligent appshttps://github.com/features/spark
GitHub ModelsManage and compare promptshttps://github.com/features/models
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
GitHub SponsorsFund open source developershttps://github.com/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/accelerator
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Fmicrosoft%2Funilm
Sign up https://patch-diff.githubusercontent.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=microsoft%2Funilm
Reloadhttps://patch-diff.githubusercontent.com/microsoft/unilm
Reloadhttps://patch-diff.githubusercontent.com/microsoft/unilm
Reloadhttps://patch-diff.githubusercontent.com/microsoft/unilm
microsoft https://patch-diff.githubusercontent.com/microsoft
unilmhttps://patch-diff.githubusercontent.com/microsoft/unilm
Notifications https://patch-diff.githubusercontent.com/login?return_to=%2Fmicrosoft%2Funilm
Fork 2.7k https://patch-diff.githubusercontent.com/login?return_to=%2Fmicrosoft%2Funilm
Star 22k https://patch-diff.githubusercontent.com/login?return_to=%2Fmicrosoft%2Funilm
aka.ms/GeneralAIhttps://aka.ms/GeneralAI
MIT license https://patch-diff.githubusercontent.com/microsoft/unilm/blob/master/LICENSE
22k stars https://patch-diff.githubusercontent.com/microsoft/unilm/stargazers
2.7k forks https://patch-diff.githubusercontent.com/microsoft/unilm/forks
Branches https://patch-diff.githubusercontent.com/microsoft/unilm/branches
Tags https://patch-diff.githubusercontent.com/microsoft/unilm/tags
Activity https://patch-diff.githubusercontent.com/microsoft/unilm/activity
Star https://patch-diff.githubusercontent.com/login?return_to=%2Fmicrosoft%2Funilm
Notifications https://patch-diff.githubusercontent.com/login?return_to=%2Fmicrosoft%2Funilm
Code https://patch-diff.githubusercontent.com/microsoft/unilm
Issues 640 https://patch-diff.githubusercontent.com/microsoft/unilm/issues
Pull requests 37 https://patch-diff.githubusercontent.com/microsoft/unilm/pulls
Actions https://patch-diff.githubusercontent.com/microsoft/unilm/actions
Projects 0 https://patch-diff.githubusercontent.com/microsoft/unilm/projects
Models https://patch-diff.githubusercontent.com/microsoft/unilm/models
Security Uh oh! There was an error while loading. Please reload this page. https://patch-diff.githubusercontent.com/microsoft/unilm/security
Please reload this pagehttps://patch-diff.githubusercontent.com/microsoft/unilm
Insights https://patch-diff.githubusercontent.com/microsoft/unilm/pulse
Code https://patch-diff.githubusercontent.com/microsoft/unilm
Issues https://patch-diff.githubusercontent.com/microsoft/unilm/issues
Pull requests https://patch-diff.githubusercontent.com/microsoft/unilm/pulls
Actions https://patch-diff.githubusercontent.com/microsoft/unilm/actions
Projects https://patch-diff.githubusercontent.com/microsoft/unilm/projects
Models https://patch-diff.githubusercontent.com/microsoft/unilm/models
Security https://patch-diff.githubusercontent.com/microsoft/unilm/security
Insights https://patch-diff.githubusercontent.com/microsoft/unilm/pulse
Brancheshttps://patch-diff.githubusercontent.com/microsoft/unilm/branches
Tagshttps://patch-diff.githubusercontent.com/microsoft/unilm/tags
https://patch-diff.githubusercontent.com/microsoft/unilm/branches
https://patch-diff.githubusercontent.com/microsoft/unilm/tags
1,243 Commitshttps://patch-diff.githubusercontent.com/microsoft/unilm/commits/master/
https://patch-diff.githubusercontent.com/microsoft/unilm/commits/master/
.github/ISSUE_TEMPLATEhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/.github/ISSUE_TEMPLATE
.github/ISSUE_TEMPLATEhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/.github/ISSUE_TEMPLATE
Diff-Transformerhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/Diff-Transformer
Diff-Transformerhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/Diff-Transformer
LatentLMhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/LatentLM
LatentLMhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/LatentLM
PFPOhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/PFPO
PFPOhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/PFPO
ReSAhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/ReSA
ReSAhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/ReSA
YOCOhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/YOCO
YOCOhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/YOCO
adalmhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/adalm
adalmhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/adalm
beatshttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/beats
beatshttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/beats
beithttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/beit
beithttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/beit
beit2https://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/beit2
beit2https://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/beit2
beit3https://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/beit3
beit3https://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/beit3
bitnethttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/bitnet
bitnethttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/bitnet
decodinghttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/decoding
decodinghttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/decoding
deepnethttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/deepnet
deepnethttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/deepnet
deltalmhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/deltalm
deltalmhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/deltalm
dithttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/dit
dithttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/dit
e5https://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/e5
e5https://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/e5
edgelmhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/edgelm
edgelmhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/edgelm
glanhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/glan
glanhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/glan
infoxlmhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/infoxlm
infoxlmhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/infoxlm
kosmos-1https://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/kosmos-1
kosmos-1https://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/kosmos-1
kosmos-2.5https://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/kosmos-2.5
kosmos-2.5https://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/kosmos-2.5
kosmos-2https://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/kosmos-2
kosmos-2https://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/kosmos-2
layoutlmhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/layoutlm
layoutlmhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/layoutlm
layoutlmfthttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/layoutlmft
layoutlmfthttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/layoutlmft
layoutlmv2https://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/layoutlmv2
layoutlmv2https://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/layoutlmv2
layoutlmv3https://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/layoutlmv3
layoutlmv3https://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/layoutlmv3
layoutreaderhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/layoutreader
layoutreaderhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/layoutreader
layoutxlmhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/layoutxlm
layoutxlmhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/layoutxlm
longnethttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/longnet
longnethttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/longnet
longvithttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/longvit
longvithttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/longvit
markuplmhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/markuplm
markuplmhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/markuplm
mathscalehttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/mathscale
mathscalehttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/mathscale
metalmhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/metalm
metalmhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/metalm
minilmhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/minilm
minilmhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/minilm
retnethttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/retnet
retnethttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/retnet
s2s-fthttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/s2s-ft
s2s-fthttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/s2s-ft
simlmhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/simlm
simlmhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/simlm
speechlmhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/speechlm
speechlmhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/speechlm
speecht5https://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/speecht5
speecht5https://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/speecht5
storagehttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/storage
storagehttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/storage
textdiffuser-2https://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/textdiffuser-2
textdiffuser-2https://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/textdiffuser-2
textdiffuserhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/textdiffuser
textdiffuserhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/textdiffuser
trocrhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/trocr
trocrhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/trocr
unilm-v1https://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/unilm-v1
unilm-v1https://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/unilm-v1
unilmhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/unilm
unilmhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/unilm
unimimhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/unimim
unimimhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/unimim
vallehttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/valle
vallehttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/valle
vl-beithttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/vl-beit
vl-beithttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/vl-beit
vlmohttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/vlmo
vlmohttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/vlmo
wavlmhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/wavlm
wavlmhttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/wavlm
xdochttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/xdoc
xdochttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/xdoc
xlmthttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/xlmt
xlmthttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/xlmt
xmoehttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/xmoe
xmoehttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/xmoe
xtunehttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/xtune
xtunehttps://patch-diff.githubusercontent.com/microsoft/unilm/tree/master/xtune
.gitignorehttps://patch-diff.githubusercontent.com/microsoft/unilm/blob/master/.gitignore
.gitignorehttps://patch-diff.githubusercontent.com/microsoft/unilm/blob/master/.gitignore
.gitmoduleshttps://patch-diff.githubusercontent.com/microsoft/unilm/blob/master/.gitmodules
.gitmoduleshttps://patch-diff.githubusercontent.com/microsoft/unilm/blob/master/.gitmodules
CODE_OF_CONDUCT.mdhttps://patch-diff.githubusercontent.com/microsoft/unilm/blob/master/CODE_OF_CONDUCT.md
CODE_OF_CONDUCT.mdhttps://patch-diff.githubusercontent.com/microsoft/unilm/blob/master/CODE_OF_CONDUCT.md
CONTRIBUTING.mdhttps://patch-diff.githubusercontent.com/microsoft/unilm/blob/master/CONTRIBUTING.md
CONTRIBUTING.mdhttps://patch-diff.githubusercontent.com/microsoft/unilm/blob/master/CONTRIBUTING.md
LICENSEhttps://patch-diff.githubusercontent.com/microsoft/unilm/blob/master/LICENSE
LICENSEhttps://patch-diff.githubusercontent.com/microsoft/unilm/blob/master/LICENSE
NOTICE.mdhttps://patch-diff.githubusercontent.com/microsoft/unilm/blob/master/NOTICE.md
NOTICE.mdhttps://patch-diff.githubusercontent.com/microsoft/unilm/blob/master/NOTICE.md
README.mdhttps://patch-diff.githubusercontent.com/microsoft/unilm/blob/master/README.md
README.mdhttps://patch-diff.githubusercontent.com/microsoft/unilm/blob/master/README.md
SECURITY.mdhttps://patch-diff.githubusercontent.com/microsoft/unilm/blob/master/SECURITY.md
SECURITY.mdhttps://patch-diff.githubusercontent.com/microsoft/unilm/blob/master/SECURITY.md
READMEhttps://patch-diff.githubusercontent.com/microsoft/unilm
Code of conducthttps://patch-diff.githubusercontent.com/microsoft/unilm
Contributinghttps://patch-diff.githubusercontent.com/microsoft/unilm
MIT licensehttps://patch-diff.githubusercontent.com/microsoft/unilm
Securityhttps://patch-diff.githubusercontent.com/microsoft/unilm
aka.ms/GeneralAIhttps://aka.ms/GeneralAI
https://patch-diff.githubusercontent.com/microsoft/unilm#akamsgeneralai
https://patch-diff.githubusercontent.com/microsoft/unilm#hiring
https://patch-diff.githubusercontent.com/microsoft/unilm#foundation-architecture
repohttps://github.com/microsoft/torchscale
https://patch-diff.githubusercontent.com/microsoft/unilm#torchscale---a-library-of-foundation-architectures-repo
DeepNethttps://github.com/microsoft/unilm/tree/master/deepnet
Foundation Transformers (Magneto)https://arxiv.org/abs/2210.06423
Length-Extrapolatablehttps://arxiv.org/abs/2212.10554
X-MoEhttps://github.com/microsoft/unilm/tree/master/xmoe
https://patch-diff.githubusercontent.com/microsoft/unilm#the-revolution-of-model-architecture
BitNethttps://arxiv.org/abs/2310.11453
RetNethttps://arxiv.org/abs/2307.08621
LongNethttps://arxiv.org/abs/2307.02486
https://patch-diff.githubusercontent.com/microsoft/unilm#foundation-models
https://patch-diff.githubusercontent.com/microsoft/unilm#the-evolution-of-mllm-multimodal-llm
Kosmos-2.5https://github.com/microsoft/unilm/tree/master/kosmos-2.5
Kosmos-2https://github.com/microsoft/unilm/tree/master/kosmos-2
Kosmos-1https://arxiv.org/abs/2302.14045
MetaLMhttps://github.com/microsoft/unilm/tree/master/metalm
https://patch-diff.githubusercontent.com/microsoft/unilm#language--multilingual
UniLMhttps://github.com/microsoft/unilm/tree/master/unilm
InfoXLM/XLM-Ehttps://github.com/microsoft/unilm/tree/master/infoxlm
DeltaLM/mT6https://github.com/microsoft/unilm/tree/master/deltalm
MiniLMhttps://github.com/microsoft/unilm/tree/master/minilm
AdaLMhttps://github.com/microsoft/unilm/tree/master/adalm
EdgeLMhttps://github.com/microsoft/unilm/tree/master/edgelm
SimLMhttps://github.com/microsoft/unilm/tree/master/simlm
E5https://github.com/microsoft/unilm/tree/master/e5
MiniLLMhttps://arxiv.org/abs/2306.08543
https://patch-diff.githubusercontent.com/microsoft/unilm#vision
BEiThttps://github.com/microsoft/unilm/tree/master/beit
BEiT-2https://github.com/microsoft/unilm/tree/master/beit2
DiThttps://github.com/microsoft/unilm/tree/master/dit
TextDiffuserhttps://github.com/microsoft/unilm/tree/master/textdiffuser
TextDiffuser-2https://github.com/microsoft/unilm/tree/master/textdiffuser-2
https://patch-diff.githubusercontent.com/microsoft/unilm#speech
WavLMhttps://github.com/microsoft/unilm/tree/master/wavlm
VALL-Ehttps://github.com/microsoft/unilm/tree/master/valle
https://patch-diff.githubusercontent.com/microsoft/unilm#multimodal-x--language
LayoutLMhttps://github.com/microsoft/unilm/tree/master/layoutlm
LayoutLMv2https://github.com/microsoft/unilm/tree/master/layoutlmv2
LayoutLMv3https://github.com/microsoft/unilm/tree/master/layoutlmv3
Document AIhttps://www.microsoft.com/en-us/research/project/document-ai/
LayoutXLMhttps://github.com/microsoft/unilm/tree/master/layoutxlm
MarkupLMhttps://github.com/microsoft/unilm/tree/master/markuplm
XDochttps://github.com/microsoft/unilm/tree/master/xdoc
UniSpeechhttps://arxiv.org/abs/2101.07597
UniSpeech-SAThttps://arxiv.org/pdf/2110.05752.pdf
SpeechT5https://arxiv.org/abs/2110.07205
SpeechLMhttps://arxiv.org/abs/2209.15329
VLMohttps://github.com/microsoft/unilm/tree/master/vlmo
VL-BEiThttps://github.com/microsoft/unilm/tree/master/vl-beit
BEiT-3https://github.com/microsoft/unilm/tree/master/beit3
https://patch-diff.githubusercontent.com/microsoft/unilm#toolkits
s2s-fthttps://github.com/microsoft/unilm/tree/master/s2s-ft
Aggressive Decodinghttps://arxiv.org/pdf/2205.10350.pdf
https://patch-diff.githubusercontent.com/microsoft/unilm#applications
TrOCRhttps://github.com/microsoft/unilm/tree/master/trocr
LayoutReaderhttps://github.com/microsoft/unilm/tree/master/layoutreader
XLM-Thttps://github.com/microsoft/unilm/tree/master/xlmt
https://patch-diff.githubusercontent.com/microsoft/unilm#links
repohttps://github.com/microsoft/lmops
https://patch-diff.githubusercontent.com/microsoft/unilm#llmops-repo
repohttps://github.com/microsoft/redstone
https://patch-diff.githubusercontent.com/microsoft/unilm#redstone-repo
https://patch-diff.githubusercontent.com/microsoft/unilm#news
RedStonehttps://github.com/microsoft/redstone
LongNethttps://github.com/microsoft/unilm/tree/master/longnet
LongViThttps://github.com/microsoft/unilm/tree/master/longvit
TextDiffuser-2https://github.com/microsoft/unilm/tree/master/textdiffuser-2
demohttps://huggingface.co/spaces/JingyeChen22/TextDiffuser-2
Kosmos-2.5https://arxiv.org/abs/2309.11419
TextDiffuserhttps://github.com/microsoft/unilm/tree/master/textdiffuser
BEiT-3https://github.com/microsoft/unilm/tree/master/beit3
Kosmos-1https://arxiv.org/abs/2302.14045
VALL-Ehttps://arxiv.org/abs/2301.02111
https://aka.ms/vallehttps://aka.ms/valle
E5https://github.com/microsoft/unilm/tree/master/e5
TorchScale 0.1.1https://github.com/microsoft/torchscale
TrOCRhttps://arxiv.org/abs/2109.10282
XDochttps://github.com/microsoft/unilm/tree/master/xdoc
TrOCRhttps://github.com/microsoft/unilm/tree/master/trocr
BEiT v2https://github.com/microsoft/unilm/tree/master/beit2
BEiT-3https://arxiv.org/abs/2208.10442
SimLMhttps://github.com/microsoft/unilm/tree/master/simlm
DiThttps://arxiv.org/abs/2203.02378
LayoutLMv3https://arxiv.org/abs/2204.08387
MetaLMhttps://github.com/microsoft/unilm/tree/master/metalm
VL-BEiThttps://github.com/microsoft/unilm/tree/master/vl-beit
LayoutLMv3 Chinesehttps://github.com/microsoft/unilm/tree/master/layoutlmv3#form-understanding-on-xfund
Aggressive Decodinghttps://github.com/microsoft/unilm/tree/master/decoding
DeepNethttps://arxiv.org/abs/2203.00555
X-MoEhttps://arxiv.org/abs/2204.09179
LayoutLMv3https://github.com/microsoft/unilm/tree/master/layoutlmv3
EdgeFormerhttps://github.com/microsoft/unilm/tree/master/edgelm
DiThttps://github.com/microsoft/unilm/tree/master/dit
Document Layout Analysishttps://huggingface.co/spaces/nielsr/dit-document-layout-analysis
Document Image Classificationhttps://huggingface.co/spaces/microsoft/document-image-transformer
BEiThttps://openreview.net/forum?id=p-BhZSz59o4
TrOCRhttps://github.com/microsoft/unilm/tree/master/trocr
VLMohttps://github.com/microsoft/unilm/tree/master/vlmo
VQA Challengehttps://eval.ai/web/challenges/challenge-page/830/leaderboard/2278
Multilingual translation at scale: 10000 language pairs and beyondhttps://www.microsoft.com/en-us/translator/blog/2021/11/22/multilingual-translation-at-scale-10000-language-pairs-and-beyond/
MarkupLMhttps://github.com/microsoft/unilm/tree/master/markuplm
VLMohttps://github.com/microsoft/unilm/tree/master/vlmo
BEiThttps://github.com/microsoft/unilm/tree/master/beit
WavLMhttps://github.com/microsoft/unilm/tree/master/wavlm
SUPERBhttps://superbbenchmark.org/leaderboard
WavLMhttps://github.com/microsoft/unilm/tree/master/wavlm
TrOCRhttps://huggingface.co/transformers/master/model_doc/trocr.html
HuggingFacehttps://github.com/huggingface/transformers
XLM-Ehttps://arxiv.org/abs/2106.16138
InfoXLMhttps://arxiv.org/abs/2007.07834
XTREMEhttps://sites.research.google/xtreme
Bloghttps://www.microsoft.com/en-us/research/blog/microsoft-turing-universal-language-representation-model-t-ulrv5-tops-xtreme-leaderboard-and-trains-100x-faster/
LayoutLM-casedhttps://huggingface.co/microsoft/layoutlm-base-cased
HuggingFacehttps://github.com/huggingface/transformers
TrOCRhttps://github.com/microsoft/unilm/tree/master/trocr
BEiThttps://github.com/microsoft/unilm/tree/master/beit
LayoutLMv2https://huggingface.co/transformers/master/model_doc/layoutlmv2.html
LayoutXLMhttps://huggingface.co/transformers/master/model_doc/layoutxlm.html
HuggingFacehttps://github.com/huggingface/transformers
LayoutReaderhttps://github.com/microsoft/unilm/tree/master/layoutreader
DeltaLMhttps://github.com/microsoft/unilm/tree/master/deltalm
BEiThttps://huggingface.co/transformers/master/model_doc/beit.html
HuggingFacehttps://github.com/huggingface/transformers
BEiThttps://github.com/microsoft/unilm/tree/master/beit
LayoutLMv2https://github.com/microsoft/unilm/tree/master/layoutlmv2
LayoutXLMhttps://github.com/microsoft/unilm/tree/master/layoutxlm
MiniLMv2https://github.com/microsoft/unilm/tree/master/minilm
AdaLMhttps://github.com/microsoft/unilm/tree/master/adalm
LayoutLMv2https://github.com/microsoft/unilm/tree/master/layoutlmv2
LayoutXLMhttps://github.com/microsoft/unilm/tree/master/layoutxlm
XFUNDhttps://github.com/doc-analysis/XFUND
InfoXLMhttps://github.com/microsoft/unilm/tree/master/infoxlm
LayoutLMv2https://arxiv.org/abs/2012.14740
DocVQAhttps://rrc.cvc.uab.es/?ch=17&com=evaluation&task=1
SROIEhttps://rrc.cvc.uab.es/?ch=13&com=evaluation&task=3
InfoXLMhttps://arxiv.org/abs/2007.07834
XTREMEhttps://sites.research.google/xtreme
Bloghttps://www.microsoft.com/en-us/research/blog/microsoft-turing-universal-language-representation-model-t-ulrv2-tops-xtreme-leaderboard/
MiniLMhttps://github.com/microsoft/unilm/tree/master/minilm
InfoXLM (Multilingual UniLM)https://github.com/microsoft/unilm/tree/master/infoxlm
arXivhttps://arxiv.org/pdf/2007.07834.pdf
UniLMv2https://github.com/microsoft/unilm/tree/master/unilm
LayoutLMhttps://github.com/microsoft/unilm/tree/master/layoutlm
Multilingual MiniLMhttps://github.com/microsoft/unilm/tree/master/minilm
UniLMv1https://github.com/microsoft/unilm/tree/master/unilm-v1
https://patch-diff.githubusercontent.com/microsoft/unilm#license
transformershttps://github.com/huggingface/transformers
Microsoft Open Source Code of Conducthttps://opensource.microsoft.com/codeofconduct
https://patch-diff.githubusercontent.com/microsoft/unilm#contact-information
Furu Weihttps://thegenerality.com
aka.ms/GeneralAIhttps://aka.ms/GeneralAI
nlp https://patch-diff.githubusercontent.com/topics/nlp
kosmos https://patch-diff.githubusercontent.com/topics/kosmos
deepnet https://patch-diff.githubusercontent.com/topics/deepnet
multimodal https://patch-diff.githubusercontent.com/topics/multimodal
bitnet https://patch-diff.githubusercontent.com/topics/bitnet
pre-trained-model https://patch-diff.githubusercontent.com/topics/pre-trained-model
unilm https://patch-diff.githubusercontent.com/topics/unilm
minilm https://patch-diff.githubusercontent.com/topics/minilm
layoutlm https://patch-diff.githubusercontent.com/topics/layoutlm
beit https://patch-diff.githubusercontent.com/topics/beit
document-ai https://patch-diff.githubusercontent.com/topics/document-ai
layoutxlm https://patch-diff.githubusercontent.com/topics/layoutxlm
trocr https://patch-diff.githubusercontent.com/topics/trocr
foundation-models https://patch-diff.githubusercontent.com/topics/foundation-models
llm https://patch-diff.githubusercontent.com/topics/llm
beit-3 https://patch-diff.githubusercontent.com/topics/beit-3
xlm-e https://patch-diff.githubusercontent.com/topics/xlm-e
mllm https://patch-diff.githubusercontent.com/topics/mllm
kosmos-1 https://patch-diff.githubusercontent.com/topics/kosmos-1
textdiffuser https://patch-diff.githubusercontent.com/topics/textdiffuser
Readme https://patch-diff.githubusercontent.com/microsoft/unilm#readme-ov-file
MIT license https://patch-diff.githubusercontent.com/microsoft/unilm#MIT-1-ov-file
Code of conduct https://patch-diff.githubusercontent.com/microsoft/unilm#coc-ov-file
Contributing https://patch-diff.githubusercontent.com/microsoft/unilm#contributing-ov-file
Security policy https://patch-diff.githubusercontent.com/microsoft/unilm#security-ov-file
Please reload this pagehttps://patch-diff.githubusercontent.com/microsoft/unilm
Activityhttps://patch-diff.githubusercontent.com/microsoft/unilm/activity
Custom propertieshttps://patch-diff.githubusercontent.com/microsoft/unilm/custom-properties
22k starshttps://patch-diff.githubusercontent.com/microsoft/unilm/stargazers
298 watchinghttps://patch-diff.githubusercontent.com/microsoft/unilm/watchers
2.7k forkshttps://patch-diff.githubusercontent.com/microsoft/unilm/forks
Report repository https://patch-diff.githubusercontent.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Fmicrosoft%2Funilm&report=microsoft+%28user%29
Releases 4https://patch-diff.githubusercontent.com/microsoft/unilm/releases
YOCO Latest May 9, 2024 https://patch-diff.githubusercontent.com/microsoft/unilm/releases/tag/yoco.v0
+ 3 releaseshttps://patch-diff.githubusercontent.com/microsoft/unilm/releases
Please reload this pagehttps://patch-diff.githubusercontent.com/microsoft/unilm
Contributors 62https://patch-diff.githubusercontent.com/microsoft/unilm/graphs/contributors
https://github.com/gitnlp
https://github.com/donglixp
https://github.com/wolfshow
https://github.com/Dod-o
https://github.com/JingyeChen
https://github.com/MarkWuNLP
https://github.com/ranpox
https://github.com/addf400
https://github.com/lockon-n
https://github.com/YTianZHU
https://github.com/shumingma
https://github.com/intfloat
https://github.com/wenhui0924
https://github.com/getao
+ 48 contributorshttps://patch-diff.githubusercontent.com/microsoft/unilm/graphs/contributors
Python 83.9% https://patch-diff.githubusercontent.com/microsoft/unilm/search?l=python
Jupyter Notebook 12.6% https://patch-diff.githubusercontent.com/microsoft/unilm/search?l=jupyter-notebook
Shell 2.3% https://patch-diff.githubusercontent.com/microsoft/unilm/search?l=shell
Cuda 0.6% https://patch-diff.githubusercontent.com/microsoft/unilm/search?l=cuda
C++ 0.3% https://patch-diff.githubusercontent.com/microsoft/unilm/search?l=c%2B%2B
Cython 0.2% https://patch-diff.githubusercontent.com/microsoft/unilm/search?l=cython
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.