René's URL Explorer Experiment

Title: GitHub - pituim/transformers: 🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.

Open Graph Title: GitHub - pituim/transformers: 🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.

X Title: GitHub - pituim/transformers: 🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.

Description: 🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0. - pituim/transformers

Open Graph Description: 🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0. - pituim/transformers

X Description: 🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0. - pituim/transformers

Opengraph URL: https://github.com/pituim/transformers

X: @github

direct link

Domain: patch-diff.githubusercontent.com

route-pattern	/:user_id/:repository
route-controller	files
route-action	disambiguate
fetch-nonce	v2:63ea66f8-82c2-9fb0-766c-5b73d99a6684
current-catalog-service-hash	f3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-id	AA88:185AE2:EADE20:126B896:697ECB5A
html-safe-nonce	2fa383179310dbae9c55f56ae9974170a7a697432264febcd3263256b581ee9e
visitor-payload	eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJBQTg4OjE4NUFFMjpFQURFMjA6MTI2Qjg5Njo2OTdFQ0I1QSIsInZpc2l0b3JfaWQiOiI0NTIzMjg5Nzk1MDM5Nzc1NTc4IiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0=
visitor-hmac	1627355ff3763ee9cb63b0ac397e6da3eb91fe0bb7658d76f45ca6020bb7db59
hovercard-subject-tag	repository:325059726
github-keyboard-shortcuts	repository,copilot
google-site-verification	Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-url	https://collector.github.com/github/collect
analytics-location	//
fb:app_id	1401488693436528
apple-itunes-app	app-id=1477376905, app-argument=https://github.com/pituim/transformers
twitter:image	https://opengraph.githubassets.com/5d1f94b506ab50058c631acab51760df555eb811697bb697364e243dd91043ef/pituim/transformers
twitter:card	summary_large_image
og:image	https://opengraph.githubassets.com/5d1f94b506ab50058c631acab51760df555eb811697bb697364e243dd91043ef/pituim/transformers
og:image:alt	🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0. - pituim/transformers
og:image:width	1200
og:image:height	600
og:site_name	GitHub
og:type	object
hostname	github.com
expected-hostname	github.com
None	60279d4097367e16897439d16d6bbe4180663db828c666eeed2656988ffe59f6
turbo-cache-control	no-preview
go-import	github.com/pituim/transformers git https://github.com/pituim/transformers.git
octolytics-dimension-user_id	71114537
octolytics-dimension-user_login	pituim
octolytics-dimension-repository_id	325059726
octolytics-dimension-repository_nwo	pituim/transformers
octolytics-dimension-repository_public	true
octolytics-dimension-repository_is_fork	true
octolytics-dimension-repository_parent_id	155220641
octolytics-dimension-repository_parent_nwo	huggingface/transformers
octolytics-dimension-repository_network_root_id	155220641
octolytics-dimension-repository_network_root_nwo	huggingface/transformers
turbo-body-classes	logged-out env-production page-responsive
disable-turbo	false
browser-stats-url	https://api.github.com/_private/browser/stats
browser-errors-url	https://api.github.com/_private/browser/errors
release	7c85641c598ad130c74f7bcc27f58575cac69551
ui-target	canary-2
theme-color	#1e2327
color-scheme	light dark

Links:

Skip to content	https://patch-diff.githubusercontent.com/pituim/transformers#start-of-content
	https://patch-diff.githubusercontent.com/
Sign in	https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Fpituim%2Ftransformers
GitHub CopilotWrite better code with AI	https://github.com/features/copilot
GitHub SparkBuild and deploy intelligent apps	https://github.com/features/spark
GitHub ModelsManage and compare prompts	https://github.com/features/models
MCP RegistryNewIntegrate external tools	https://github.com/mcp
ActionsAutomate any workflow	https://github.com/features/actions
CodespacesInstant dev environments	https://github.com/features/codespaces
IssuesPlan and track work	https://github.com/features/issues
Code ReviewManage code changes	https://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilities	https://github.com/security/advanced-security
Code securitySecure your code as you build	https://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they start	https://github.com/security/advanced-security/secret-protection
Why GitHub	https://github.com/why-github
Documentation	https://docs.github.com
Blog	https://github.blog
Changelog	https://github.blog/changelog
Marketplace	https://github.com/marketplace
View all features	https://github.com/features
Enterprises	https://github.com/enterprise
Small and medium teams	https://github.com/team
Startups	https://github.com/enterprise/startups
Nonprofits	https://github.com/solutions/industry/nonprofits
App Modernization	https://github.com/solutions/use-case/app-modernization
DevSecOps	https://github.com/solutions/use-case/devsecops
DevOps	https://github.com/solutions/use-case/devops
CI/CD	https://github.com/solutions/use-case/ci-cd
View all use cases	https://github.com/solutions/use-case
Healthcare	https://github.com/solutions/industry/healthcare
Financial services	https://github.com/solutions/industry/financial-services
Manufacturing	https://github.com/solutions/industry/manufacturing
Government	https://github.com/solutions/industry/government
View all industries	https://github.com/solutions/industry
View all solutions	https://github.com/solutions
AI	https://github.com/resources/articles?topic=ai
Software Development	https://github.com/resources/articles?topic=software-development
DevOps	https://github.com/resources/articles?topic=devops
Security	https://github.com/resources/articles?topic=security
View all topics	https://github.com/resources/articles
Customer stories	https://github.com/customer-stories
Events & webinars	https://github.com/resources/events
Ebooks & reports	https://github.com/resources/whitepapers
Business insights	https://github.com/solutions/executive-insights
GitHub Skills	https://skills.github.com
Documentation	https://docs.github.com
Customer support	https://support.github.com
Community forum	https://github.com/orgs/community/discussions
Trust center	https://github.com/trust-center
Partners	https://github.com/partners
GitHub SponsorsFund open source developers	https://github.com/sponsors
Security Lab	https://securitylab.github.com
Maintainer Community	https://maintainers.github.com
Accelerator	https://github.com/accelerator
Archive Program	https://archiveprogram.github.com
Topics	https://github.com/topics
Trending	https://github.com/trending
Collections	https://github.com/collections
Enterprise platformAI-powered developer platform	https://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security features	https://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI features	https://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 support	https://github.com/premium-support
Pricing	https://github.com/pricing
Search syntax tips	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentation	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in	https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Fpituim%2Ftransformers
Sign up	https://patch-diff.githubusercontent.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=pituim%2Ftransformers
Reload	https://patch-diff.githubusercontent.com/pituim/transformers
Reload	https://patch-diff.githubusercontent.com/pituim/transformers
Reload	https://patch-diff.githubusercontent.com/pituim/transformers
pituim	https://patch-diff.githubusercontent.com/pituim
transformers	https://patch-diff.githubusercontent.com/pituim/transformers
huggingface/transformers	https://patch-diff.githubusercontent.com/huggingface/transformers
Notifications	https://patch-diff.githubusercontent.com/login?return_to=%2Fpituim%2Ftransformers
Fork 0	https://patch-diff.githubusercontent.com/login?return_to=%2Fpituim%2Ftransformers
Star 0	https://patch-diff.githubusercontent.com/login?return_to=%2Fpituim%2Ftransformers
huggingface.co/transformers	https://huggingface.co/transformers
Apache-2.0 license	https://patch-diff.githubusercontent.com/pituim/transformers/blob/master/LICENSE
0 stars	https://patch-diff.githubusercontent.com/pituim/transformers/stargazers
31.9k forks	https://patch-diff.githubusercontent.com/pituim/transformers/forks
Branches	https://patch-diff.githubusercontent.com/pituim/transformers/branches
Tags	https://patch-diff.githubusercontent.com/pituim/transformers/tags
Activity	https://patch-diff.githubusercontent.com/pituim/transformers/activity
Star	https://patch-diff.githubusercontent.com/login?return_to=%2Fpituim%2Ftransformers
Notifications	https://patch-diff.githubusercontent.com/login?return_to=%2Fpituim%2Ftransformers
Code	https://patch-diff.githubusercontent.com/pituim/transformers
Pull requests 0	https://patch-diff.githubusercontent.com/pituim/transformers/pulls
Actions	https://patch-diff.githubusercontent.com/pituim/transformers/actions
Projects 0	https://patch-diff.githubusercontent.com/pituim/transformers/projects
Security 0	https://patch-diff.githubusercontent.com/pituim/transformers/security
Insights	https://patch-diff.githubusercontent.com/pituim/transformers/pulse
Code	https://patch-diff.githubusercontent.com/pituim/transformers
Pull requests	https://patch-diff.githubusercontent.com/pituim/transformers/pulls
Actions	https://patch-diff.githubusercontent.com/pituim/transformers/actions
Projects	https://patch-diff.githubusercontent.com/pituim/transformers/projects
Security	https://patch-diff.githubusercontent.com/pituim/transformers/security
Insights	https://patch-diff.githubusercontent.com/pituim/transformers/pulse
Branches	https://patch-diff.githubusercontent.com/pituim/transformers/branches
Tags	https://patch-diff.githubusercontent.com/pituim/transformers/tags
	https://patch-diff.githubusercontent.com/pituim/transformers/branches
	https://patch-diff.githubusercontent.com/pituim/transformers/tags
6,197 Commits	https://patch-diff.githubusercontent.com/pituim/transformers/commits/master/
	https://patch-diff.githubusercontent.com/pituim/transformers/commits/master/
.circleci	https://patch-diff.githubusercontent.com/pituim/transformers/tree/master/.circleci
.circleci	https://patch-diff.githubusercontent.com/pituim/transformers/tree/master/.circleci
.github	https://patch-diff.githubusercontent.com/pituim/transformers/tree/master/.github
.github	https://patch-diff.githubusercontent.com/pituim/transformers/tree/master/.github
docker	https://patch-diff.githubusercontent.com/pituim/transformers/tree/master/docker
docker	https://patch-diff.githubusercontent.com/pituim/transformers/tree/master/docker
docs	https://patch-diff.githubusercontent.com/pituim/transformers/tree/master/docs
docs	https://patch-diff.githubusercontent.com/pituim/transformers/tree/master/docs
examples	https://patch-diff.githubusercontent.com/pituim/transformers/tree/master/examples
examples	https://patch-diff.githubusercontent.com/pituim/transformers/tree/master/examples
model_cards	https://patch-diff.githubusercontent.com/pituim/transformers/tree/master/model_cards
model_cards	https://patch-diff.githubusercontent.com/pituim/transformers/tree/master/model_cards
notebooks	https://patch-diff.githubusercontent.com/pituim/transformers/tree/master/notebooks
notebooks	https://patch-diff.githubusercontent.com/pituim/transformers/tree/master/notebooks
scripts	https://patch-diff.githubusercontent.com/pituim/transformers/tree/master/scripts
scripts	https://patch-diff.githubusercontent.com/pituim/transformers/tree/master/scripts
src/transformers	https://patch-diff.githubusercontent.com/pituim/transformers/tree/master/src/transformers
src/transformers	https://patch-diff.githubusercontent.com/pituim/transformers/tree/master/src/transformers
templates	https://patch-diff.githubusercontent.com/pituim/transformers/tree/master/templates
templates	https://patch-diff.githubusercontent.com/pituim/transformers/tree/master/templates
tests	https://patch-diff.githubusercontent.com/pituim/transformers/tree/master/tests
tests	https://patch-diff.githubusercontent.com/pituim/transformers/tree/master/tests
utils	https://patch-diff.githubusercontent.com/pituim/transformers/tree/master/utils
utils	https://patch-diff.githubusercontent.com/pituim/transformers/tree/master/utils
.coveragerc	https://patch-diff.githubusercontent.com/pituim/transformers/blob/master/.coveragerc
.coveragerc	https://patch-diff.githubusercontent.com/pituim/transformers/blob/master/.coveragerc
.gitignore	https://patch-diff.githubusercontent.com/pituim/transformers/blob/master/.gitignore
.gitignore	https://patch-diff.githubusercontent.com/pituim/transformers/blob/master/.gitignore
CODE_OF_CONDUCT.md	https://patch-diff.githubusercontent.com/pituim/transformers/blob/master/CODE_OF_CONDUCT.md
CODE_OF_CONDUCT.md	https://patch-diff.githubusercontent.com/pituim/transformers/blob/master/CODE_OF_CONDUCT.md
CONTRIBUTING.md	https://patch-diff.githubusercontent.com/pituim/transformers/blob/master/CONTRIBUTING.md
CONTRIBUTING.md	https://patch-diff.githubusercontent.com/pituim/transformers/blob/master/CONTRIBUTING.md
LICENSE	https://patch-diff.githubusercontent.com/pituim/transformers/blob/master/LICENSE
LICENSE	https://patch-diff.githubusercontent.com/pituim/transformers/blob/master/LICENSE
MANIFEST.in	https://patch-diff.githubusercontent.com/pituim/transformers/blob/master/MANIFEST.in
MANIFEST.in	https://patch-diff.githubusercontent.com/pituim/transformers/blob/master/MANIFEST.in
Makefile	https://patch-diff.githubusercontent.com/pituim/transformers/blob/master/Makefile
Makefile	https://patch-diff.githubusercontent.com/pituim/transformers/blob/master/Makefile
README.md	https://patch-diff.githubusercontent.com/pituim/transformers/blob/master/README.md
README.md	https://patch-diff.githubusercontent.com/pituim/transformers/blob/master/README.md
hubconf.py	https://patch-diff.githubusercontent.com/pituim/transformers/blob/master/hubconf.py
hubconf.py	https://patch-diff.githubusercontent.com/pituim/transformers/blob/master/hubconf.py
pyproject.toml	https://patch-diff.githubusercontent.com/pituim/transformers/blob/master/pyproject.toml
pyproject.toml	https://patch-diff.githubusercontent.com/pituim/transformers/blob/master/pyproject.toml
setup.cfg	https://patch-diff.githubusercontent.com/pituim/transformers/blob/master/setup.cfg
setup.cfg	https://patch-diff.githubusercontent.com/pituim/transformers/blob/master/setup.cfg
setup.py	https://patch-diff.githubusercontent.com/pituim/transformers/blob/master/setup.py
setup.py	https://patch-diff.githubusercontent.com/pituim/transformers/blob/master/setup.py
valohai.yaml	https://patch-diff.githubusercontent.com/pituim/transformers/blob/master/valohai.yaml
valohai.yaml	https://patch-diff.githubusercontent.com/pituim/transformers/blob/master/valohai.yaml
README	https://patch-diff.githubusercontent.com/pituim/transformers
Code of conduct	https://patch-diff.githubusercontent.com/pituim/transformers
Contributing	https://patch-diff.githubusercontent.com/pituim/transformers
Apache-2.0 license	https://patch-diff.githubusercontent.com/pituim/transformers
	https://raw.githubusercontent.com/huggingface/transformers/master/docs/source/imgs/transformers_logo_name.png
	https://circleci.com/gh/huggingface/transformers
	https://github.com/huggingface/transformers/blob/master/LICENSE
	https://huggingface.co/transformers/index.html
	https://github.com/huggingface/transformers/releases
	https://github.com/huggingface/transformers/blob/master/CODE_OF_CONDUCT.md
	https://patch-diff.githubusercontent.com/pituim/transformers#state-of-the-art-natural-language-processing-for-pytorch-and-tensorflow-20
model hub	https://huggingface.co/models
PyTorch	https://pytorch.org/
TensorFlow	https://www.tensorflow.org/
	https://patch-diff.githubusercontent.com/pituim/transformers#online-demos
model hub	https://huggingface.co/models
inference API	https://huggingface.co/pricing
Masked word completion with BERT	https://huggingface.co/bert-base-uncased?text=Paris+is+the+%5BMASK%5D+of+France
Name Entity Recognition with Electra	https://huggingface.co/dbmdz/electra-large-discriminator-finetuned-conll03-english?text=My+name+is+Sarah+and+I+live+in+London+city
Text generation with GPT-2	https://huggingface.co/gpt2?text=A+long+time+ago%2C+
Natural Langugage Inference with RoBERTa	https://huggingface.co/roberta-large-mnli?text=The+dog+was+lost.+Nobody+lost+any+animal
Summarization with BART	https://huggingface.co/facebook/bart-large-cnn?text=The+tower+is+324+metres+%281%2C063+ft%29+tall%2C+about+the+same+height+as+an+81-storey+building%2C+and+the+tallest+structure+in+Paris.+Its+base+is+square%2C+measuring+125+metres+%28410+ft%29+on+each+side.+During+its+construction%2C+the+Eiffel+Tower+surpassed+the+Washington+Monument+to+become+the+tallest+man-made+structure+in+the+world%2C+a+title+it+held+for+41+years+until+the+Chrysler+Building+in+New+York+City+was+finished+in+1930.+It+was+the+first+structure+to+reach+a+height+of+300+metres.+Due+to+the+addition+of+a+broadcasting+aerial+at+the+top+of+the+tower+in+1957%2C+it+is+now+taller+than+the+Chrysler+Building+by+5.2+metres+%2817+ft%29.+Excluding+transmitters%2C+the+Eiffel+Tower+is+the+second+tallest+free-standing+structure+in+France+after+the+Millau+Viaduct
Question answering with DistilBERT	https://huggingface.co/distilbert-base-uncased-distilled-squad?text=Which+name+is+also+used+to+describe+the+Amazon+rainforest+in+English%3F&context=The+Amazon+rainforest+%28Portuguese%3A+Floresta+Amaz%C3%B4nica+or+Amaz%C3%B4nia%3B+Spanish%3A+Selva+Amaz%C3%B3nica%2C+Amazon%C3%ADa+or+usually+Amazonia%3B+French%3A+For%C3%AAt+amazonienne%3B+Dutch%3A+Amazoneregenwoud%29%2C+also+known+in+English+as+Amazonia+or+the+Amazon+Jungle%2C+is+a+moist+broadleaf+forest+that+covers+most+of+the+Amazon+basin+of+South+America.+This+basin+encompasses+7%2C000%2C000+square+kilometres+%282%2C700%2C000+sq+mi%29%2C+of+which+5%2C500%2C000+square+kilometres+%282%2C100%2C000+sq+mi%29+are+covered+by+the+rainforest.+This+region+includes+territory+belonging+to+nine+nations.+The+majority+of+the+forest+is+contained+within+Brazil%2C+with+60%25+of+the+rainforest%2C+followed+by+Peru+with+13%25%2C+Colombia+with+10%25%2C+and+with+minor+amounts+in+Venezuela%2C+Ecuador%2C+Bolivia%2C+Guyana%2C+Suriname+and+French+Guiana.+States+or+departments+in+four+nations+contain+%22Amazonas%22+in+their+names.+The+Amazon+represents+over+half+of+the+planet%27s+remaining+rainforests%2C+and+comprises+the+largest+and+most+biodiverse+tract+of+tropical+rainforest+in+the+world%2C+with+an+estimated+390+billion+individual+trees+divided+into+16%2C000+species
Translation with T5	https://huggingface.co/t5-base?text=My+name+is+Wolfgang+and+I+live+in+Berlin
Write With Transformer	https://transformer.huggingface.co
	https://patch-diff.githubusercontent.com/pituim/transformers#quick-tour
this tutorial	https://huggingface.co/transformers/task_summary.html
Pytorch nn.Module	https://pytorch.org/docs/stable/nn.html#torch.nn.Module
TensorFlow tf.keras.Model	https://www.tensorflow.org/api_docs/python/tf/keras/Model
this tutorial	https://huggingface.co/transformers/training.html
	https://patch-diff.githubusercontent.com/pituim/transformers#why-should-i-use-transformers
	https://patch-diff.githubusercontent.com/pituim/transformers#why-shouldnt-i-use-transformers
examples folder	https://github.com/huggingface/transformers/tree/master/examples
	https://patch-diff.githubusercontent.com/pituim/transformers#installation
	https://patch-diff.githubusercontent.com/pituim/transformers#with-pip
examples	https://github.com/huggingface/transformers/tree/master/examples
virtual environment	https://docs.python.org/3/library/venv.html
user guide	https://packaging.python.org/guides/installing-using-pip-and-virtual-environments/
TensorFlow installation page	https://www.tensorflow.org/install/pip#tensorflow-2.0-rc-is-available
PyTorch installation page	https://pytorch.org/get-started/locally/#start-locally
Flax installation page	https://github.com/google/flax#quick-install
install the library from source	https://huggingface.co/transformers/installation.html#installing-from-source
	https://patch-diff.githubusercontent.com/pituim/transformers#with-conda
	https://patch-diff.githubusercontent.com/pituim/transformers#models-architectures
All the model checkpoints	https://huggingface.co/models
model hub	https://huggingface.co
users	https://huggingface.co/users
organizations	https://huggingface.co/organizations
	https://camo.githubusercontent.com/f36a36c84f2ff8605938db0f71595cdfebb5ebc941833aeb2591205f220bc9d2/68747470733a2f2f696d672e736869656c64732e696f2f656e64706f696e743f75726c3d68747470733a2f2f68756767696e67666163652e636f2f6170692f736869656c64732f6d6f64656c7326636f6c6f723d627269676874677265656e
here	https://huggingface.co/transformers/model_summary.html
ALBERT	https://huggingface.co/transformers/model_doc/albert.html
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations	https://arxiv.org/abs/1909.11942
BART	https://huggingface.co/transformers/model_doc/bart.html
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension	https://arxiv.org/pdf/1910.13461.pdf
BARThez	https://huggingface.co/transformers/model_doc/barthez.html
BARThez: a Skilled Pretrained French Sequence-to-Sequence Model	https://arxiv.org/abs/2010.12321
BERT	https://huggingface.co/transformers/model_doc/bert.html
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding	https://arxiv.org/abs/1810.04805
BERT For Sequence Generation	https://huggingface.co/transformers/model_doc/bertgeneration.html
Leveraging Pre-trained Checkpoints for Sequence Generation Tasks	https://arxiv.org/abs/1907.12461
Blenderbot	https://huggingface.co/transformers/model_doc/blenderbot.html
Recipes for building an open-domain chatbot	https://arxiv.org/abs/2004.13637
CamemBERT	https://huggingface.co/transformers/model_doc/camembert.html
CamemBERT: a Tasty French Language Model	https://arxiv.org/abs/1911.03894
CTRL	https://huggingface.co/transformers/model_doc/ctrl.html
CTRL: A Conditional Transformer Language Model for Controllable Generation	https://arxiv.org/abs/1909.05858
DeBERTa	https://huggingface.co/transformers/model_doc/deberta.html
DeBERTa: Decoding-enhanced BERT with Disentangled Attention	https://arxiv.org/abs/2006.03654
DialoGPT	https://huggingface.co/transformers/model_doc/dialogpt.html
DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation	https://arxiv.org/abs/1911.00536
DistilBERT	https://huggingface.co/transformers/model_doc/distilbert.html
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter	https://arxiv.org/abs/1910.01108
DistilGPT2	https://github.com/huggingface/transformers/tree/master/examples/distillation
DistilRoBERTa	https://github.com/huggingface/transformers/tree/master/examples/distillation
DistilmBERT	https://github.com/huggingface/transformers/tree/master/examples/distillation
DPR	https://huggingface.co/transformers/model_doc/dpr.html
Dense Passage Retrieval for Open-Domain Question Answering	https://arxiv.org/abs/2004.04906
ELECTRA	https://huggingface.co/transformers/model_doc/electra.html
ELECTRA: Pre-training text encoders as discriminators rather than generators	https://arxiv.org/abs/2003.10555
FlauBERT	https://huggingface.co/transformers/model_doc/flaubert.html
FlauBERT: Unsupervised Language Model Pre-training for French	https://arxiv.org/abs/1912.05372
Funnel Transformer	https://huggingface.co/transformers/model_doc/funnel.html
Funnel-Transformer: Filtering out Sequential Redundancy for Efficient Language Processing	https://arxiv.org/abs/2006.03236
GPT	https://huggingface.co/transformers/model_doc/gpt.html
Improving Language Understanding by Generative Pre-Training	https://blog.openai.com/language-unsupervised/
GPT-2	https://huggingface.co/transformers/model_doc/gpt2.html
Language Models are Unsupervised Multitask Learners	https://blog.openai.com/better-language-models/
LayoutLM	https://huggingface.co/transformers/model_doc/layoutlm.html
LayoutLM: Pre-training of Text and Layout for Document Image Understanding	https://arxiv.org/abs/1912.13318
Longformer	https://huggingface.co/transformers/model_doc/longformer.html
Longformer: The Long-Document Transformer	https://arxiv.org/abs/2004.05150
LXMERT	https://huggingface.co/transformers/model_doc/lxmert.html
LXMERT: Learning Cross-Modality Encoder Representations from Transformers for Open-Domain Question Answering	https://arxiv.org/abs/1908.07490
MarianMT	https://huggingface.co/transformers/model_doc/marian.html
OPUS	http://opus.nlpl.eu/
Marian Framework	https://marian-nmt.github.io/
MBart	https://huggingface.co/transformers/model_doc/mbart.html
Multilingual Denoising Pre-training for Neural Machine Translation	https://arxiv.org/abs/2001.08210
MPNet	https://huggingface.co/transformers/model_doc/mpnet.html
MPNet: Masked and Permuted Pre-training for Language Understanding	https://arxiv.org/abs/2004.09297
MT5	https://huggingface.co/transformers/model_doc/mt5.html
mT5: A massively multilingual pre-trained text-to-text transformer	https://arxiv.org/abs/2010.11934
Pegasus	https://huggingface.co/transformers/model_doc/pegasus.html
PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization	https://arxiv.org/abs/1912.08777
ProphetNet	https://huggingface.co/transformers/model_doc/prophetnet.html
ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-training	https://arxiv.org/abs/2001.04063
Reformer	https://huggingface.co/transformers/model_doc/reformer.html
Reformer: The Efficient Transformer	https://arxiv.org/abs/2001.04451
RoBERTa	https://huggingface.co/transformers/model_doc/roberta.html
Robustly Optimized BERT Pretraining Approach	https://arxiv.org/abs/1907.11692
DistilmBERT	https://github.com/huggingface/transformers/tree/master/examples/distillation
SqueezeBert	https://huggingface.co/transformers/model_doc/squeezebert.html
SqueezeBERT: What can computer vision teach NLP about efficient neural networks?	https://arxiv.org/abs/2006.11316
T5	https://huggingface.co/transformers/model_doc/t5.html
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer	https://arxiv.org/abs/1910.10683
TAPAS	https://huggingface.co/transformers/master/model_doc/tapas.html
TAPAS: Weakly Supervised Table Parsing via Pre-training	https://arxiv.org/abs/2004.02349
Transformer-XL	https://huggingface.co/transformers/model_doc/transformerxl.html
Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context	https://arxiv.org/abs/1901.02860
XLM	https://huggingface.co/transformers/model_doc/xlm.html
Cross-lingual Language Model Pretraining	https://arxiv.org/abs/1901.07291
XLM-ProphetNet	https://huggingface.co/transformers/model_doc/xlmprophetnet.html
ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-training	https://arxiv.org/abs/2001.04063
XLM-RoBERTa	https://huggingface.co/transformers/model_doc/xlmroberta.html
Unsupervised Cross-lingual Representation Learning at Scale	https://arxiv.org/abs/1911.02116
XLNet	https://huggingface.co/transformers/model_doc/xlnet.html
XLNet: Generalized Autoregressive Pretraining for Language Understanding	https://arxiv.org/abs/1906.08237
templates	https://patch-diff.githubusercontent.com/pituim/transformers/blob/master/templates
contributing guidelines	https://patch-diff.githubusercontent.com/pituim/transformers/blob/master/CONTRIBUTING.md
this table	https://huggingface.co/transformers/index.html#bigtable
documentation	https://huggingface.co/transformers/examples.html
	https://patch-diff.githubusercontent.com/pituim/transformers#learn-more
Documentation	https://huggingface.co/transformers/
Task summary	https://huggingface.co/transformers/task_summary.html
Preprocessing tutorial	https://huggingface.co/transformers/preprocessing.html
Training and fine-tuning	https://huggingface.co/transformers/training.html
Quick tour: Fine-tuning/usage scripts	https://github.com/huggingface/transformers/tree/master/examples
Model sharing and uploading	https://huggingface.co/transformers/model_sharing.html
Migration	https://huggingface.co/transformers/migration.html
	https://patch-diff.githubusercontent.com/pituim/transformers#citation
paper	https://www.aclweb.org/anthology/2020.emnlp-demos.6/
huggingface.co/transformers	https://huggingface.co/transformers
Readme	https://patch-diff.githubusercontent.com/pituim/transformers#readme-ov-file
Apache-2.0 license	https://patch-diff.githubusercontent.com/pituim/transformers#Apache-2.0-1-ov-file
Code of conduct	https://patch-diff.githubusercontent.com/pituim/transformers#coc-ov-file
Contributing	https://patch-diff.githubusercontent.com/pituim/transformers#contributing-ov-file
Please reload this page	https://patch-diff.githubusercontent.com/pituim/transformers
Activity	https://patch-diff.githubusercontent.com/pituim/transformers/activity
0 stars	https://patch-diff.githubusercontent.com/pituim/transformers/stargazers
0 watching	https://patch-diff.githubusercontent.com/pituim/transformers/watchers
0 forks	https://patch-diff.githubusercontent.com/pituim/transformers/forks
Report repository	https://patch-diff.githubusercontent.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Fpituim%2Ftransformers&report=pituim+%28user%29
Releases	https://patch-diff.githubusercontent.com/pituim/transformers/releases
49 tags	https://patch-diff.githubusercontent.com/pituim/transformers/tags
Packages 0	https://patch-diff.githubusercontent.com/users/pituim/packages?repo_name=transformers
	https://github.com
Terms	https://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacy	https://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Security	https://github.com/security
Status	https://www.githubstatus.com/
Community	https://github.community/
Docs	https://docs.github.com/
Contact	https://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.