René's URL Explorer Experiment

Title: GitHub - codeboxldd/transformers: 🤗 Transformers: State-of-the-art Natural Language Processing for Pytorch, TensorFlow, and JAX. · GitHub

Open Graph Title: GitHub - codeboxldd/transformers: 🤗 Transformers: State-of-the-art Natural Language Processing for Pytorch, TensorFlow, and JAX.

X Title: GitHub - codeboxldd/transformers: 🤗 Transformers: State-of-the-art Natural Language Processing for Pytorch, TensorFlow, and JAX.

Description: 🤗 Transformers: State-of-the-art Natural Language Processing for Pytorch, TensorFlow, and JAX. - codeboxldd/transformers

Open Graph Description: 🤗 Transformers: State-of-the-art Natural Language Processing for Pytorch, TensorFlow, and JAX. - codeboxldd/transformers

X Description: 🤗 Transformers: State-of-the-art Natural Language Processing for Pytorch, TensorFlow, and JAX. - codeboxldd/transformers

Opengraph URL: https://github.com/codeboxldd/transformers

X: @github

direct link

Domain: github.com

route-pattern	/:user_id/:repository
route-controller	files
route-action	disambiguate
fetch-nonce	v2:93e7fcaa-5e6e-ec52-9812-44ef0fad0036
current-catalog-service-hash	f3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-id	BD6C:21DF5A:3DC32A5:574F1DA:6A54F452
html-safe-nonce	bd5287db2494d21612fabc5cf5de07da4729e759125fa6306098c65396ea7d0c
visitor-payload	eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJCRDZDOjIxREY1QTozREMzMkE1OjU3NEYxREE6NkE1NEY0NTIiLCJ2aXNpdG9yX2lkIjoiNTc2ODU4MjE2NDg2MzMxNzA3NCIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmac	5671b48460d6872f325b98dc939700b3630bc799f58890b9dece0a4f853822e8
hovercard-subject-tag	repository:424240278
github-keyboard-shortcuts	repository,copilot
google-site-verification	Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-url	https://collector.github.com/github/collect
analytics-location	//
fb:app_id	1401488693436528
apple-itunes-app	app-id=1477376905, app-argument=https://github.com/codeboxldd/transformers
twitter:image	https://opengraph.githubassets.com/73d1bcce429ad345baf85f7a10e74e669bdd56debbc5c39afaabedf9bf0b73af/codeboxldd/transformers
twitter:card	summary_large_image
og:image	https://opengraph.githubassets.com/73d1bcce429ad345baf85f7a10e74e669bdd56debbc5c39afaabedf9bf0b73af/codeboxldd/transformers
og:image:alt	🤗 Transformers: State-of-the-art Natural Language Processing for Pytorch, TensorFlow, and JAX. - codeboxldd/transformers
og:image:width	1200
og:image:height	600
og:site_name	GitHub
og:type	object
hostname	github.com
expected-hostname	github.com
None	eae2aab99907699a22d2c8449aa683ca74454fca87211b98f7c7b722086b2839
turbo-cache-control	no-cache
go-import	github.com/codeboxldd/transformers git https://github.com/codeboxldd/transformers.git
octolytics-dimension-user_id	27270856
octolytics-dimension-user_login	codeboxldd
octolytics-dimension-repository_id	424240278
octolytics-dimension-repository_nwo	codeboxldd/transformers
octolytics-dimension-repository_public	true
octolytics-dimension-repository_is_fork	true
octolytics-dimension-repository_parent_id	155220641
octolytics-dimension-repository_parent_nwo	huggingface/transformers
octolytics-dimension-repository_network_root_id	155220641
octolytics-dimension-repository_network_root_nwo	huggingface/transformers
turbo-body-classes	logged-out env-production page-responsive
disable-turbo	false
browser-stats-url	https://api.github.com/_private/browser/stats
browser-errors-url	https://api.github.com/_private/browser/errors
release	dd26d3896747463b6bd56edd5e290edb595c3cbc
ui-target	full
theme-color	#1e2327
color-scheme	light dark

Links:

Skip to content	https://github.com/codeboxldd/transformers#start-of-content
	https://github.com/
Sign in	https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fcodeboxldd%2Ftransformers
GitHub CopilotWrite better code with AI	https://github.com/features/copilot
GitHub Copilot appDirect agents from issue to merge	https://github.com/features/ai/github-app
MCP RegistryNewIntegrate external tools	https://github.com/mcp
ActionsAutomate any workflow	https://github.com/features/actions
CodespacesInstant dev environments	https://github.com/features/codespaces
IssuesPlan and track work	https://github.com/features/issues
Code ReviewManage code changes	https://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilities	https://github.com/security/advanced-security
Code securitySecure your code as you build	https://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they start	https://github.com/security/advanced-security/secret-protection
Why GitHub	https://github.com/why-github
Documentation	https://docs.github.com
Blog	https://github.blog
Changelog	https://github.blog/changelog
Marketplace	https://github.com/marketplace
View all features	https://github.com/features
Enterprises	https://github.com/enterprise
Small and medium teams	https://github.com/team
Startups	https://github.com/enterprise/startups
Nonprofits	https://github.com/solutions/industry/nonprofits
App Modernization	https://github.com/solutions/use-case/app-modernization
DevSecOps	https://github.com/solutions/use-case/devsecops
DevOps	https://github.com/solutions/use-case/devops
CI/CD	https://github.com/solutions/use-case/ci-cd
View all use cases	https://github.com/solutions/use-case
Healthcare	https://github.com/solutions/industry/healthcare
Financial services	https://github.com/solutions/industry/financial-services
Manufacturing	https://github.com/solutions/industry/manufacturing
Government	https://github.com/solutions/industry/government
View all industries	https://github.com/solutions/industry
View all solutions	https://github.com/solutions
AI	https://github.com/resources/articles?topic=ai
Software Development	https://github.com/resources/articles?topic=software-development
DevOps	https://github.com/resources/articles?topic=devops
Security	https://github.com/resources/articles?topic=security
View all topics	https://github.com/resources/articles
Customer stories	https://github.com/customer-stories
Events & webinars	https://github.com/resources/events
Ebooks & reports	https://github.com/resources/whitepapers
Business insights	https://github.com/solutions/executive-insights
GitHub Skills	https://skills.github.com
Documentation	https://docs.github.com
Customer support	https://support.github.com
Community forum	https://github.com/orgs/community/discussions
Trust center	https://github.com/trust-center
Partners	https://github.com/partners
View all resources	https://github.com/resources
GitHub SponsorsFund open source developers	https://github.com/open-source/sponsors
Security Lab	https://securitylab.github.com
Maintainer Community	https://maintainers.github.com
Accelerator	https://github.com/open-source/accelerator
GitHub Stars	https://stars.github.com
Archive Program	https://archiveprogram.github.com
Topics	https://github.com/topics
Trending	https://github.com/trending
Collections	https://github.com/collections
Enterprise platformAI-powered developer platform	https://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security features	https://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI features	https://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 support	https://github.com/enterprise/premium-support
Pricing	https://github.com/pricing
Search syntax tips	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentation	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in	https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fcodeboxldd%2Ftransformers
Sign up	https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=codeboxldd%2Ftransformers
Reload	https://github.com/codeboxldd/transformers
Reload	https://github.com/codeboxldd/transformers
Reload	https://github.com/codeboxldd/transformers
codeboxldd	https://github.com/codeboxldd
transformers	https://github.com/codeboxldd/transformers
huggingface/transformers	https://github.com/huggingface/transformers
Notifications	https://github.com/login?return_to=%2Fcodeboxldd%2Ftransformers
Fork 0	https://github.com/login?return_to=%2Fcodeboxldd%2Ftransformers
Star 1	https://github.com/login?return_to=%2Fcodeboxldd%2Ftransformers
Code	https://github.com/codeboxldd/transformers
Pull requests 0	https://github.com/codeboxldd/transformers/pulls
Actions	https://github.com/codeboxldd/transformers/actions
Projects	https://github.com/codeboxldd/transformers/projects
Security and quality 0	https://github.com/codeboxldd/transformers/security
Insights	https://github.com/codeboxldd/transformers/pulse
Code	https://github.com/codeboxldd/transformers
Pull requests	https://github.com/codeboxldd/transformers/pulls
Actions	https://github.com/codeboxldd/transformers/actions
Projects	https://github.com/codeboxldd/transformers/projects
Security and quality	https://github.com/codeboxldd/transformers/security
Insights	https://github.com/codeboxldd/transformers/pulse
	https://github.com/codeboxldd/transformers
Branches	https://github.com/codeboxldd/transformers/branches
Tags	https://github.com/codeboxldd/transformers/tags
	https://github.com/codeboxldd/transformers/branches
	https://github.com/codeboxldd/transformers/tags
8,260 Commits	https://github.com/codeboxldd/transformers/commits/master/
	https://github.com/codeboxldd/transformers/commits/master/
.circleci	https://github.com/codeboxldd/transformers/tree/master/.circleci
.circleci	https://github.com/codeboxldd/transformers/tree/master/.circleci
.github	https://github.com/codeboxldd/transformers/tree/master/.github
.github	https://github.com/codeboxldd/transformers/tree/master/.github
docker	https://github.com/codeboxldd/transformers/tree/master/docker
docker	https://github.com/codeboxldd/transformers/tree/master/docker
docs	https://github.com/codeboxldd/transformers/tree/master/docs
docs	https://github.com/codeboxldd/transformers/tree/master/docs
examples	https://github.com/codeboxldd/transformers/tree/master/examples
examples	https://github.com/codeboxldd/transformers/tree/master/examples
model_cards	https://github.com/codeboxldd/transformers/tree/master/model_cards
model_cards	https://github.com/codeboxldd/transformers/tree/master/model_cards
notebooks	https://github.com/codeboxldd/transformers/tree/master/notebooks
notebooks	https://github.com/codeboxldd/transformers/tree/master/notebooks
scripts	https://github.com/codeboxldd/transformers/tree/master/scripts
scripts	https://github.com/codeboxldd/transformers/tree/master/scripts
src/transformers	https://github.com/codeboxldd/transformers/tree/master/src/transformers
src/transformers	https://github.com/codeboxldd/transformers/tree/master/src/transformers
templates	https://github.com/codeboxldd/transformers/tree/master/templates
templates	https://github.com/codeboxldd/transformers/tree/master/templates
tests	https://github.com/codeboxldd/transformers/tree/master/tests
tests	https://github.com/codeboxldd/transformers/tree/master/tests
utils	https://github.com/codeboxldd/transformers/tree/master/utils
utils	https://github.com/codeboxldd/transformers/tree/master/utils
.coveragerc	https://github.com/codeboxldd/transformers/blob/master/.coveragerc
.coveragerc	https://github.com/codeboxldd/transformers/blob/master/.coveragerc
.gitattributes	https://github.com/codeboxldd/transformers/blob/master/.gitattributes
.gitattributes	https://github.com/codeboxldd/transformers/blob/master/.gitattributes
.gitignore	https://github.com/codeboxldd/transformers/blob/master/.gitignore
.gitignore	https://github.com/codeboxldd/transformers/blob/master/.gitignore
CITATION.cff	https://github.com/codeboxldd/transformers/blob/master/CITATION.cff
CITATION.cff	https://github.com/codeboxldd/transformers/blob/master/CITATION.cff
CODE_OF_CONDUCT.md	https://github.com/codeboxldd/transformers/blob/master/CODE_OF_CONDUCT.md
CODE_OF_CONDUCT.md	https://github.com/codeboxldd/transformers/blob/master/CODE_OF_CONDUCT.md
CONTRIBUTING.md	https://github.com/codeboxldd/transformers/blob/master/CONTRIBUTING.md
CONTRIBUTING.md	https://github.com/codeboxldd/transformers/blob/master/CONTRIBUTING.md
ISSUES.md	https://github.com/codeboxldd/transformers/blob/master/ISSUES.md
ISSUES.md	https://github.com/codeboxldd/transformers/blob/master/ISSUES.md
LICENSE	https://github.com/codeboxldd/transformers/blob/master/LICENSE
LICENSE	https://github.com/codeboxldd/transformers/blob/master/LICENSE
MANIFEST.in	https://github.com/codeboxldd/transformers/blob/master/MANIFEST.in
MANIFEST.in	https://github.com/codeboxldd/transformers/blob/master/MANIFEST.in
Makefile	https://github.com/codeboxldd/transformers/blob/master/Makefile
Makefile	https://github.com/codeboxldd/transformers/blob/master/Makefile
README.md	https://github.com/codeboxldd/transformers/blob/master/README.md
README.md	https://github.com/codeboxldd/transformers/blob/master/README.md
README_ko.md	https://github.com/codeboxldd/transformers/blob/master/README_ko.md
README_ko.md	https://github.com/codeboxldd/transformers/blob/master/README_ko.md
README_zh-hans.md	https://github.com/codeboxldd/transformers/blob/master/README_zh-hans.md
README_zh-hans.md	https://github.com/codeboxldd/transformers/blob/master/README_zh-hans.md
README_zh-hant.md	https://github.com/codeboxldd/transformers/blob/master/README_zh-hant.md
README_zh-hant.md	https://github.com/codeboxldd/transformers/blob/master/README_zh-hant.md
hubconf.py	https://github.com/codeboxldd/transformers/blob/master/hubconf.py
hubconf.py	https://github.com/codeboxldd/transformers/blob/master/hubconf.py
pyproject.toml	https://github.com/codeboxldd/transformers/blob/master/pyproject.toml
pyproject.toml	https://github.com/codeboxldd/transformers/blob/master/pyproject.toml
setup.cfg	https://github.com/codeboxldd/transformers/blob/master/setup.cfg
setup.cfg	https://github.com/codeboxldd/transformers/blob/master/setup.cfg
setup.py	https://github.com/codeboxldd/transformers/blob/master/setup.py
setup.py	https://github.com/codeboxldd/transformers/blob/master/setup.py
valohai.yaml	https://github.com/codeboxldd/transformers/blob/master/valohai.yaml
valohai.yaml	https://github.com/codeboxldd/transformers/blob/master/valohai.yaml
README	https://github.com/codeboxldd/transformers
Code of conduct	https://github.com/codeboxldd/transformers
Contributing	https://github.com/codeboxldd/transformers
License	https://github.com/codeboxldd/transformers
	https://raw.githubusercontent.com/huggingface/transformers/master/docs/source/imgs/transformers_logo_name.png
	https://circleci.com/gh/huggingface/transformers
	https://github.com/huggingface/transformers/blob/master/LICENSE
	https://huggingface.co/transformers/index.html
	https://github.com/huggingface/transformers/releases
	https://github.com/huggingface/transformers/blob/master/CODE_OF_CONDUCT.md
	https://zenodo.org/badge/latestdoi/155220641
简体中文	https://github.com/huggingface/transformers/blob/master/README_zh-hans.md
繁體中文	https://github.com/huggingface/transformers/blob/master/README_zh-hant.md
한국어	https://github.com/huggingface/transformers/blob/master/README_ko.md
	https://github.com/codeboxldd/transformers#------------english---------简体中文---------繁體中文---------한국어----
	https://github.com/codeboxldd/transformers#----state-of-the-art-natural-language-processing-for-jax-pytorch-and-tensorflow
	https://hf.co/course
	https://github.com/codeboxldd/transformers#----
model hub	https://huggingface.co/models
Jax	https://jax.readthedocs.io/en/latest/
PyTorch	https://pytorch.org/
TensorFlow	https://www.tensorflow.org/
	https://github.com/codeboxldd/transformers#online-demos
model hub	https://huggingface.co/models
private model hosting, versioning, & an inference API	https://huggingface.co/pricing
Masked word completion with BERT	https://huggingface.co/bert-base-uncased?text=Paris+is+the+%5BMASK%5D+of+France
Name Entity Recognition with Electra	https://huggingface.co/dbmdz/electra-large-discriminator-finetuned-conll03-english?text=My+name+is+Sarah+and+I+live+in+London+city
Text generation with GPT-2	https://huggingface.co/gpt2?text=A+long+time+ago%2C+
Natural Language Inference with RoBERTa	https://huggingface.co/roberta-large-mnli?text=The+dog+was+lost.+Nobody+lost+any+animal
Summarization with BART	https://huggingface.co/facebook/bart-large-cnn?text=The+tower+is+324+metres+%281%2C063+ft%29+tall%2C+about+the+same+height+as+an+81-storey+building%2C+and+the+tallest+structure+in+Paris.+Its+base+is+square%2C+measuring+125+metres+%28410+ft%29+on+each+side.+During+its+construction%2C+the+Eiffel+Tower+surpassed+the+Washington+Monument+to+become+the+tallest+man-made+structure+in+the+world%2C+a+title+it+held+for+41+years+until+the+Chrysler+Building+in+New+York+City+was+finished+in+1930.+It+was+the+first+structure+to+reach+a+height+of+300+metres.+Due+to+the+addition+of+a+broadcasting+aerial+at+the+top+of+the+tower+in+1957%2C+it+is+now+taller+than+the+Chrysler+Building+by+5.2+metres+%2817+ft%29.+Excluding+transmitters%2C+the+Eiffel+Tower+is+the+second+tallest+free-standing+structure+in+France+after+the+Millau+Viaduct
Question answering with DistilBERT	https://huggingface.co/distilbert-base-uncased-distilled-squad?text=Which+name+is+also+used+to+describe+the+Amazon+rainforest+in+English%3F&context=The+Amazon+rainforest+%28Portuguese%3A+Floresta+Amaz%C3%B4nica+or+Amaz%C3%B4nia%3B+Spanish%3A+Selva+Amaz%C3%B3nica%2C+Amazon%C3%ADa+or+usually+Amazonia%3B+French%3A+For%C3%AAt+amazonienne%3B+Dutch%3A+Amazoneregenwoud%29%2C+also+known+in+English+as+Amazonia+or+the+Amazon+Jungle%2C+is+a+moist+broadleaf+forest+that+covers+most+of+the+Amazon+basin+of+South+America.+This+basin+encompasses+7%2C000%2C000+square+kilometres+%282%2C700%2C000+sq+mi%29%2C+of+which+5%2C500%2C000+square+kilometres+%282%2C100%2C000+sq+mi%29+are+covered+by+the+rainforest.+This+region+includes+territory+belonging+to+nine+nations.+The+majority+of+the+forest+is+contained+within+Brazil%2C+with+60%25+of+the+rainforest%2C+followed+by+Peru+with+13%25%2C+Colombia+with+10%25%2C+and+with+minor+amounts+in+Venezuela%2C+Ecuador%2C+Bolivia%2C+Guyana%2C+Suriname+and+French+Guiana.+States+or+departments+in+four+nations+contain+%22Amazonas%22+in+their+names.+The+Amazon+represents+over+half+of+the+planet%27s+remaining+rainforests%2C+and+comprises+the+largest+and+most+biodiverse+tract+of+tropical+rainforest+in+the+world%2C+with+an+estimated+390+billion+individual+trees+divided+into+16%2C000+species
Translation with T5	https://huggingface.co/t5-base?text=My+name+is+Wolfgang+and+I+live+in+Berlin
Write With Transformer	https://transformer.huggingface.co
	https://github.com/codeboxldd/transformers#if-you-are-looking-for-custom-support-from-the-hugging-face-team
	https://huggingface.co/support
	https://github.com/codeboxldd/transformers#quick-tour
this tutorial	https://huggingface.co/transformers/task_summary.html
Pytorch nn.Module	https://pytorch.org/docs/stable/nn.html#torch.nn.Module
TensorFlow tf.keras.Model	https://www.tensorflow.org/api_docs/python/tf/keras/Model
This tutorial	https://huggingface.co/transformers/training.html
	https://github.com/codeboxldd/transformers#why-should-i-use-transformers
	https://github.com/codeboxldd/transformers#why-shouldnt-i-use-transformers
examples folder	https://github.com/huggingface/transformers/tree/master/examples
	https://github.com/codeboxldd/transformers#installation
	https://github.com/codeboxldd/transformers#with-pip
virtual environment	https://docs.python.org/3/library/venv.html
user guide	https://packaging.python.org/guides/installing-using-pip-and-virtual-environments/
TensorFlow installation page	https://www.tensorflow.org/install/
PyTorch installation page	https://pytorch.org/get-started/locally/#start-locally
Flax installation page	https://github.com/google/flax#quick-install
install the library from source	https://huggingface.co/transformers/installation.html#installing-from-source
	https://github.com/codeboxldd/transformers#with-conda
	https://github.com/codeboxldd/transformers#model-architectures
All the model checkpoints	https://huggingface.co/models
model hub	https://huggingface.co
users	https://huggingface.co/users
organizations	https://huggingface.co/organizations
	https://camo.githubusercontent.com/f36a36c84f2ff8605938db0f71595cdfebb5ebc941833aeb2591205f220bc9d2/68747470733a2f2f696d672e736869656c64732e696f2f656e64706f696e743f75726c3d68747470733a2f2f68756767696e67666163652e636f2f6170692f736869656c64732f6d6f64656c7326636f6c6f723d627269676874677265656e
here	https://huggingface.co/transformers/model_summary.html
ALBERT	https://huggingface.co/transformers/model_doc/albert.html
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations	https://arxiv.org/abs/1909.11942
BART	https://huggingface.co/transformers/model_doc/bart.html
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension	https://arxiv.org/pdf/1910.13461.pdf
BARThez	https://huggingface.co/transformers/model_doc/barthez.html
BARThez: a Skilled Pretrained French Sequence-to-Sequence Model	https://arxiv.org/abs/2010.12321
BARTpho	https://huggingface.co/transformers/model_doc/bartpho.html
BARTpho: Pre-trained Sequence-to-Sequence Models for Vietnamese	https://arxiv.org/abs/2109.09701
BEiT	https://huggingface.co/transformers/model_doc/beit.html
BEiT: BERT Pre-Training of Image Transformers	https://arxiv.org/abs/2106.08254
BERT	https://huggingface.co/transformers/model_doc/bert.html
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding	https://arxiv.org/abs/1810.04805
BERTweet	https://huggingface.co/transformers/model_doc/bertweet.html
BERTweet: A pre-trained language model for English Tweets	https://aclanthology.org/2020.emnlp-demos.2/
BERT For Sequence Generation	https://huggingface.co/transformers/model_doc/bertgeneration.html
Leveraging Pre-trained Checkpoints for Sequence Generation Tasks	https://arxiv.org/abs/1907.12461
BigBird-RoBERTa	https://huggingface.co/transformers/model_doc/bigbird.html
Big Bird: Transformers for Longer Sequences	https://arxiv.org/abs/2007.14062
BigBird-Pegasus	https://huggingface.co/transformers/model_doc/bigbird_pegasus.html
Big Bird: Transformers for Longer Sequences	https://arxiv.org/abs/2007.14062
Blenderbot	https://huggingface.co/transformers/model_doc/blenderbot.html
Recipes for building an open-domain chatbot	https://arxiv.org/abs/2004.13637
BlenderbotSmall	https://huggingface.co/transformers/model_doc/blenderbot_small.html
Recipes for building an open-domain chatbot	https://arxiv.org/abs/2004.13637
BORT	https://huggingface.co/transformers/model_doc/bort.html
Optimal Subarchitecture Extraction For BERT	https://arxiv.org/abs/2010.10499
ByT5	https://huggingface.co/transformers/model_doc/byt5.html
ByT5: Towards a token-free future with pre-trained byte-to-byte models	https://arxiv.org/abs/2105.13626
CamemBERT	https://huggingface.co/transformers/model_doc/camembert.html
CamemBERT: a Tasty French Language Model	https://arxiv.org/abs/1911.03894
CANINE	https://huggingface.co/transformers/model_doc/canine.html
CANINE: Pre-training an Efficient Tokenization-Free Encoder for Language Representation	https://arxiv.org/abs/2103.06874
CLIP	https://huggingface.co/transformers/model_doc/clip.html
Learning Transferable Visual Models From Natural Language Supervision	https://arxiv.org/abs/2103.00020
ConvBERT	https://huggingface.co/transformers/model_doc/convbert.html
ConvBERT: Improving BERT with Span-based Dynamic Convolution	https://arxiv.org/abs/2008.02496
CPM	https://huggingface.co/transformers/model_doc/cpm.html
CPM: A Large-scale Generative Chinese Pre-trained Language Model	https://arxiv.org/abs/2012.00413
CTRL	https://huggingface.co/transformers/model_doc/ctrl.html
CTRL: A Conditional Transformer Language Model for Controllable Generation	https://arxiv.org/abs/1909.05858
DeBERTa	https://huggingface.co/transformers/model_doc/deberta.html
DeBERTa: Decoding-enhanced BERT with Disentangled Attention	https://arxiv.org/abs/2006.03654
DeBERTa-v2	https://huggingface.co/transformers/model_doc/deberta_v2.html
DeBERTa: Decoding-enhanced BERT with Disentangled Attention	https://arxiv.org/abs/2006.03654
DeiT	https://huggingface.co/transformers/model_doc/deit.html
Training data-efficient image transformers & distillation through attention	https://arxiv.org/abs/2012.12877
DETR	https://huggingface.co/transformers/model_doc/detr.html
End-to-End Object Detection with Transformers	https://arxiv.org/abs/2005.12872
DialoGPT	https://huggingface.co/transformers/model_doc/dialogpt.html
DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation	https://arxiv.org/abs/1911.00536
DistilBERT	https://huggingface.co/transformers/model_doc/distilbert.html
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter	https://arxiv.org/abs/1910.01108
DistilGPT2	https://github.com/huggingface/transformers/tree/master/examples/distillation
DistilRoBERTa	https://github.com/huggingface/transformers/tree/master/examples/distillation
DistilmBERT	https://github.com/huggingface/transformers/tree/master/examples/distillation
DPR	https://huggingface.co/transformers/model_doc/dpr.html
Dense Passage Retrieval for Open-Domain Question Answering	https://arxiv.org/abs/2004.04906
EncoderDecoder	https://huggingface.co/transformers/model_doc/encoderdecoder.html
Leveraging Pre-trained Checkpoints for Sequence Generation Tasks	https://arxiv.org/abs/1907.12461
ELECTRA	https://huggingface.co/transformers/model_doc/electra.html
ELECTRA: Pre-training text encoders as discriminators rather than generators	https://arxiv.org/abs/2003.10555
FlauBERT	https://huggingface.co/transformers/model_doc/flaubert.html
FlauBERT: Unsupervised Language Model Pre-training for French	https://arxiv.org/abs/1912.05372
FNet	https://huggingface.co/transformers/model_doc/fnet.html
FNet: Mixing Tokens with Fourier Transforms	https://arxiv.org/abs/2105.03824
Funnel Transformer	https://huggingface.co/transformers/model_doc/funnel.html
Funnel-Transformer: Filtering out Sequential Redundancy for Efficient Language Processing	https://arxiv.org/abs/2006.03236
GPT	https://huggingface.co/transformers/model_doc/gpt.html
Improving Language Understanding by Generative Pre-Training	https://blog.openai.com/language-unsupervised/
GPT-2	https://huggingface.co/transformers/model_doc/gpt2.html
Language Models are Unsupervised Multitask Learners	https://blog.openai.com/better-language-models/
GPT-J	https://huggingface.co/transformers/model_doc/gptj.html
kingoflolz/mesh-transformer-jax	https://github.com/kingoflolz/mesh-transformer-jax/
GPT Neo	https://huggingface.co/transformers/model_doc/gpt_neo.html
EleutherAI/gpt-neo	https://github.com/EleutherAI/gpt-neo
Hubert	https://huggingface.co/transformers/model_doc/hubert.html
HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units	https://arxiv.org/abs/2106.07447
I-BERT	https://huggingface.co/transformers/model_doc/ibert.html
I-BERT: Integer-only BERT Quantization	https://arxiv.org/abs/2101.01321
LayoutLM	https://huggingface.co/transformers/model_doc/layoutlm.html
LayoutLM: Pre-training of Text and Layout for Document Image Understanding	https://arxiv.org/abs/1912.13318
LayoutLMv2	https://huggingface.co/transformers/model_doc/layoutlmv2.html
LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understanding	https://arxiv.org/abs/2012.14740
LayoutXLM	https://huggingface.co/transformers/model_doc/layoutlmv2.html
LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understanding	https://arxiv.org/abs/2104.08836
LED	https://huggingface.co/transformers/model_doc/led.html
Longformer: The Long-Document Transformer	https://arxiv.org/abs/2004.05150
Longformer	https://huggingface.co/transformers/model_doc/longformer.html
Longformer: The Long-Document Transformer	https://arxiv.org/abs/2004.05150
LUKE	https://huggingface.co/transformers/model_doc/luke.html
LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention	https://arxiv.org/abs/2010.01057
LXMERT	https://huggingface.co/transformers/model_doc/lxmert.html
LXMERT: Learning Cross-Modality Encoder Representations from Transformers for Open-Domain Question Answering	https://arxiv.org/abs/1908.07490
M2M100	https://huggingface.co/transformers/model_doc/m2m_100.html
Beyond English-Centric Multilingual Machine Translation	https://arxiv.org/abs/2010.11125
MarianMT	https://huggingface.co/transformers/model_doc/marian.html
OPUS	http://opus.nlpl.eu/
Marian Framework	https://marian-nmt.github.io/
MBart	https://huggingface.co/transformers/model_doc/mbart.html
Multilingual Denoising Pre-training for Neural Machine Translation	https://arxiv.org/abs/2001.08210
MBart-50	https://huggingface.co/transformers/model_doc/mbart.html
Multilingual Translation with Extensible Multilingual Pretraining and Finetuning	https://arxiv.org/abs/2008.00401
Megatron-BERT	https://huggingface.co/transformers/model_doc/megatron_bert.html
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism	https://arxiv.org/abs/1909.08053
Megatron-GPT2	https://huggingface.co/transformers/model_doc/megatron_gpt2.html
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism	https://arxiv.org/abs/1909.08053
MPNet	https://huggingface.co/transformers/model_doc/mpnet.html
MPNet: Masked and Permuted Pre-training for Language Understanding	https://arxiv.org/abs/2004.09297
MT5	https://huggingface.co/transformers/model_doc/mt5.html
mT5: A massively multilingual pre-trained text-to-text transformer	https://arxiv.org/abs/2010.11934
Pegasus	https://huggingface.co/transformers/model_doc/pegasus.html
PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization	https://arxiv.org/abs/1912.08777
PhoBERT	https://huggingface.co/transformers/model_doc/phobert.html
PhoBERT: Pre-trained language models for Vietnamese	https://www.aclweb.org/anthology/2020.findings-emnlp.92/
ProphetNet	https://huggingface.co/transformers/model_doc/prophetnet.html
ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-training	https://arxiv.org/abs/2001.04063
Reformer	https://huggingface.co/transformers/model_doc/reformer.html
Reformer: The Efficient Transformer	https://arxiv.org/abs/2001.04451
RemBERT	https://huggingface.co/transformers/model_doc/rembert.html
Rethinking embedding coupling in pre-trained language models	https://arxiv.org/pdf/2010.12821.pdf
RoBERTa	https://huggingface.co/transformers/model_doc/roberta.html
Robustly Optimized BERT Pretraining Approach	https://arxiv.org/abs/1907.11692
RoFormer	https://huggingface.co/transformers/model_doc/roformer.html
RoFormer: Enhanced Transformer with Rotary Position Embedding	https://arxiv.org/pdf/2104.09864v1.pdf
SegFormer	https://huggingface.co/transformers/model_doc/segformer.html
SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers	https://arxiv.org/abs/2105.15203
SEW	https://huggingface.co/transformers/model_doc/sew.html
Performance-Efficiency Trade-offs in Unsupervised Pre-training for Speech Recognition	https://arxiv.org/abs/2109.06870
SEW-D	https://huggingface.co/transformers/model_doc/sew_d.html
Performance-Efficiency Trade-offs in Unsupervised Pre-training for Speech Recognition	https://arxiv.org/abs/2109.06870
SpeechToTextTransformer	https://huggingface.co/transformers/model_doc/speech_to_text.html
fairseq S2T: Fast Speech-to-Text Modeling with fairseq	https://arxiv.org/abs/2010.05171
SpeechToTextTransformer2	https://huggingface.co/transformers/model_doc/speech_to_text_2.html
Large-Scale Self- and Semi-Supervised Learning for Speech Translation	https://arxiv.org/abs/2104.06678
Splinter	https://huggingface.co/transformers/model_doc/splinter.html
Few-Shot Question Answering by Pretraining Span Selection	https://arxiv.org/abs/2101.00438
SqueezeBert	https://huggingface.co/transformers/model_doc/squeezebert.html
SqueezeBERT: What can computer vision teach NLP about efficient neural networks?	https://arxiv.org/abs/2006.11316
T5	https://huggingface.co/transformers/model_doc/t5.html
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer	https://arxiv.org/abs/1910.10683
T5v1.1	https://huggingface.co/transformers/model_doc/t5v1.1.html
google-research/text-to-text-transfer-transformer	https://github.com/google-research/text-to-text-transfer-transformer/blob/main/released_checkpoints.md#t511
TAPAS	https://huggingface.co/transformers/model_doc/tapas.html
TAPAS: Weakly Supervised Table Parsing via Pre-training	https://arxiv.org/abs/2004.02349
Transformer-XL	https://huggingface.co/transformers/model_doc/transformerxl.html
Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context	https://arxiv.org/abs/1901.02860
TrOCR	https://huggingface.co/transformers/model_doc/trocr.html
TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models	https://arxiv.org/abs/2109.10282
UniSpeech	https://huggingface.co/transformers/model_doc/unispeech.html
UniSpeech: Unified Speech Representation Learning with Labeled and Unlabeled Data	https://arxiv.org/abs/2101.07597
UniSpeechSat	https://huggingface.co/transformers/model_doc/unispeech_sat.html
UNISPEECH-SAT: UNIVERSAL SPEECH REPRESENTATION LEARNING WITH SPEAKER AWARE PRE-TRAINING	https://arxiv.org/abs/2110.05752
Vision Transformer (ViT)	https://huggingface.co/transformers/model_doc/vit.html
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale	https://arxiv.org/abs/2010.11929
VisualBERT	https://huggingface.co/transformers/model_doc/visual_bert.html
VisualBERT: A Simple and Performant Baseline for Vision and Language	https://arxiv.org/pdf/1908.03557
Wav2Vec2	https://huggingface.co/transformers/model_doc/wav2vec2.html
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations	https://arxiv.org/abs/2006.11477
XLM	https://huggingface.co/transformers/model_doc/xlm.html
Cross-lingual Language Model Pretraining	https://arxiv.org/abs/1901.07291
XLM-ProphetNet	https://huggingface.co/transformers/model_doc/xlmprophetnet.html
ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-training	https://arxiv.org/abs/2001.04063
XLM-RoBERTa	https://huggingface.co/transformers/model_doc/xlmroberta.html
Unsupervised Cross-lingual Representation Learning at Scale	https://arxiv.org/abs/1911.02116
XLNet	https://huggingface.co/transformers/model_doc/xlnet.html
XLNet: Generalized Autoregressive Pretraining for Language Understanding	https://arxiv.org/abs/1906.08237
XLSR-Wav2Vec2	https://huggingface.co/transformers/model_doc/xlsr_wav2vec2.html
Unsupervised Cross-Lingual Representation Learning For Speech Recognition	https://arxiv.org/abs/2006.13979
templates	https://github.com/codeboxldd/transformers/blob/master/templates
contributing guidelines	https://github.com/codeboxldd/transformers/blob/master/CONTRIBUTING.md
this table	https://huggingface.co/transformers/index.html#supported-frameworks
documentation	https://huggingface.co/transformers/examples.html
	https://github.com/codeboxldd/transformers#learn-more
Documentation	https://huggingface.co/transformers/
Task summary	https://huggingface.co/transformers/task_summary.html
Preprocessing tutorial	https://huggingface.co/transformers/preprocessing.html
Training and fine-tuning	https://huggingface.co/transformers/training.html
Quick tour: Fine-tuning/usage scripts	https://github.com/huggingface/transformers/tree/master/examples
Model sharing and uploading	https://huggingface.co/transformers/model_sharing.html
Migration	https://huggingface.co/transformers/migration.html
	https://github.com/codeboxldd/transformers#citation
paper	https://www.aclweb.org/anthology/2020.emnlp-demos.6/
huggingface.co/transformers	https://huggingface.co/transformers
Readme	https://github.com/codeboxldd/transformers#readme-ov-file
Apache-2.0 license	https://github.com/codeboxldd/transformers#Apache-2.0-1-ov-file
Code of conduct	https://github.com/codeboxldd/transformers#coc-ov-file
Contributing	https://github.com/codeboxldd/transformers#contributing-ov-file
Please reload this page	https://github.com/codeboxldd/transformers
Activity	https://github.com/codeboxldd/transformers/activity
0 forks	https://github.com/codeboxldd/transformers/forks
Report repository	https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Fcodeboxldd%2Ftransformers&report=codeboxldd+%28user%29
Releases	https://github.com/codeboxldd/transformers/releases
84 tags	https://github.com/codeboxldd/transformers/tags
Packages 0	https://github.com/users/codeboxldd/packages?repo_name=transformers
Please reload this page	https://github.com/codeboxldd/transformers
Contributors	https://github.com/codeboxldd/transformers/graphs/contributors
Please reload this page	https://github.com/codeboxldd/transformers
	https://github.com
Terms	https://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacy	https://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Security	https://github.com/security
Status	https://www.githubstatus.com/
Community	https://github.community/
Docs	https://docs.github.com/
Contact	https://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.