| react-profiling | 0 |
| react-import-map | react,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322 |
| route-pattern | /:user_id/:repository |
| route-controller | files |
| route-action | disambiguate |
| fetch-nonce | v2:e07cc932-806b-cd4d-1bea-05f20331458b |
| current-catalog-service-hash | f3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb |
| request-id | DEF2:1DC474:8D6B55:BB190F:6B027DC4 |
| html-safe-nonce | e146475fd0eac3b15b82ffa04af6b5895502b777067ddf5fa67213f8faadd783 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJERUYyOjFEQzQ3NDo4RDZCNTU6QkIxOTBGOjZCMDI3REM0IiwidmlzaXRvcl9pZCI6IjcwNzY3ODE4NDI2MzE5MTY5OTciLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ== |
| visitor-hmac | d7059a048fbc1702f8ec78195c719ac1ad30b6246921e3cc94b9e49fe27e74a7 |
| hovercard-subject-tag | repository:303575068 |
| github-keyboard-shortcuts | repository,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | // |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/zcoder233/transformers |
| twitter:image | https://opengraph.githubassets.com/cd300fbcf01b652b1831df79472261828ec079ff7830bd9a36384a79e611e4d7/zcoder233/transformers |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/cd300fbcf01b652b1831df79472261828ec079ff7830bd9a36384a79e611e4d7/zcoder233/transformers |
| og:image:alt | 🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0. - zcoder233/transformers |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| hostname | github.com |
| expected-hostname | github.com |
| None | 87e774ee7c6b3bee0490394e4d3e57ec9dbc956f74b87ea685dc8996c1676456 |
| turbo-cache-control | no-cache |
| go-import | github.com/zcoder233/transformers git https://github.com/zcoder233/transformers.git |
| octolytics-dimension-user_id | 71428448 |
| octolytics-dimension-user_login | zcoder233 |
| octolytics-dimension-repository_id | 303575068 |
| octolytics-dimension-repository_nwo | zcoder233/transformers |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | true |
| octolytics-dimension-repository_parent_id | 155220641 |
| octolytics-dimension-repository_parent_nwo | huggingface/transformers |
| octolytics-dimension-repository_network_root_id | 155220641 |
| octolytics-dimension-repository_network_root_nwo | huggingface/transformers |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 423dbb54c5e7bfecc838eb387c1435eb3d0e760d |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
| Skip to content | https://github.com/zcoder233/transformers#start-of-content |
| https://github.com/ |
| Sign in | https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fzcoder233%2Ftransformers |
| GitHubRepository hosting, code review, and collaboration | https://github.com/platform |
| CopilotAI coding agent for tasks, projects, and automated work | https://github.com/features/copilot |
| ActionsCI/CD and automation | https://github.com/features/actions |
| Code QualityQuality analysis, fixes, and enforcement | https://github.com/features/code-quality |
| CodespacesCloud development environments | https://github.com/features/codespaces |
| Code SecurityVulnerability detection and remediation | https://github.com/security/advanced-security/code-security |
| Secret ProtectionSecret scanning and leak prevention | https://github.com/security/advanced-security/secret-protection |
| All Features | https://github.com/features |
| Documentation | https://docs.github.com/en |
| Training | https://learn.github.com/skills |
| Certifications | https://learn.github.com/credentials |
| Build with Copilot | https://github.com/features/ai |
| Customize Copilot | https://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview |
| Integrations | https://github.com/marketplace |
| Trending repos | https://github.com/trending |
| GitHub Sponsors | https://github.com/open-source/sponsors |
| Developer articles | https://github.com/resources/articles |
| ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place. | https://github.blog/changelog/ |
| Enterprises | https://github.com/enterprise |
| Team | https://github.com/team |
| Startups | https://github.com/enterprise/startups |
| Nonprofits | https://github.com/solutions/industry/nonprofits |
| Healthcare | https://github.com/solutions/industry/healthcare |
| Financial services | https://github.com/solutions/industry/financial-services |
| Manufacturing | https://github.com/solutions/industry/manufacturing |
| Government | https://github.com/solutions/industry/government |
| See all industries | https://github.com/solutions/industry |
| Why GitHub | https://github.com/why-github |
| Customer Stories | https://github.com/customer-stories |
| Business insights | https://github.com/solutions/executive-insights |
| Trust Center | https://github.com/trust-center |
| GitHub Advanced SecurityEnterprise-grade code security | https://github.com/security/advanced-security |
| Copilot for businessEnterprise-grade AI features | https://github.com/features/copilot/copilot-business |
| Premium SupportEnterprise-grade 24/7 support | https://github.com/enterprise/premium-support |
| Documentation | https://docs.github.com/en |
| Resource center | https://github.com/resources |
| Blog | https://github.blog/ |
| Events & webinars | https://github.com/resources/events |
| Community Forum | https://github.com/orgs/community/discussions |
| Customer Stories | https://github.com/customer-stories |
| Integrations | https://github.com/marketplace |
| Customer support | https://help.github.com/ |
| Training | https://learn.github.com/skills |
| GitHub Status | https://www.githubstatus.com/ |
| About | https://github.com/about |
| Partners | https://github.com/partners |
| Changelog | https://github.blog/changelog/ |
| GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub. | https://githubuniverse.com/ |
| Pricing | https://github.com/pricing |
| Sign in | https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fzcoder233%2Ftransformers |
| Sign up | https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=zcoder233%2Ftransformers |
| Reload | https://github.com/zcoder233/transformers |
| Reload | https://github.com/zcoder233/transformers |
| Reload | https://github.com/zcoder233/transformers |
| zcoder233 | https://github.com/zcoder233 |
| transformers | https://github.com/zcoder233/transformers |
| Code | https://github.com/zcoder233/transformers |
| Pull requests | https://github.com/zcoder233/transformers/pulls |
| Actions | https://github.com/zcoder233/transformers/actions |
| Projects | https://github.com/zcoder233/transformers/projects |
| Security and quality | https://github.com/zcoder233/transformers/security |
| Insights | https://github.com/zcoder233/transformers/pulse |
| https://github.com/zcoder233/transformers |
| transformers | https://github.com/zcoder233/transformers |
| huggingface/transformers | https://github.com/huggingface/transformers |
| Notifications | https://github.com/login?return_to=%2Fzcoder233%2Ftransformers |
| Fork0 (0) | https://github.com/login?return_to=%2Fzcoder233%2Ftransformers |
| Star0 (0) | https://github.com/login?return_to=%2Fzcoder233%2Ftransformers |
| huggingface.co/transformers | https://huggingface.co/transformers |
| Readme | https://github.com/zcoder233/transformers#readme-ov-file |
| Apache-2.0 license | https://github.com/zcoder233/transformers#Apache-2.0-1-ov-file |
| Code of conduct | https://github.com/zcoder233/transformers#coc-ov-file |
| Contributing | https://github.com/zcoder233/transformers#contributing-ov-file |
| Activity | https://github.com/zcoder233/transformers/activity |
| 0 forks | https://github.com/zcoder233/transformers/forks |
| Report repository | https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Fzcoder233%2Ftransformers&report=zcoder233+%28user%29 |
| Branches | https://github.com/zcoder233/transformers/branches |
| Tags | https://github.com/zcoder233/transformers/tags |
| https://github.com/zcoder233/transformers/branches |
| https://github.com/zcoder233/transformers/tags |
| 5,480 Commits | https://github.com/zcoder233/transformers/commits/master/ |
| https://github.com/zcoder233/transformers/commits/master/ |
| .circleci | https://github.com/zcoder233/transformers/tree/master/.circleci |
| .circleci | https://github.com/zcoder233/transformers/tree/master/.circleci |
| .github | https://github.com/zcoder233/transformers/tree/master/.github |
| .github | https://github.com/zcoder233/transformers/tree/master/.github |
| docker | https://github.com/zcoder233/transformers/tree/master/docker |
| docker | https://github.com/zcoder233/transformers/tree/master/docker |
| docs | https://github.com/zcoder233/transformers/tree/master/docs |
| docs | https://github.com/zcoder233/transformers/tree/master/docs |
| examples | https://github.com/zcoder233/transformers/tree/master/examples |
| examples | https://github.com/zcoder233/transformers/tree/master/examples |
| model_cards | https://github.com/zcoder233/transformers/tree/master/model_cards |
| model_cards | https://github.com/zcoder233/transformers/tree/master/model_cards |
| notebooks | https://github.com/zcoder233/transformers/tree/master/notebooks |
| notebooks | https://github.com/zcoder233/transformers/tree/master/notebooks |
| scripts | https://github.com/zcoder233/transformers/tree/master/scripts |
| scripts | https://github.com/zcoder233/transformers/tree/master/scripts |
| src/transformers | https://github.com/zcoder233/transformers/tree/master/src/transformers |
| src/transformers | https://github.com/zcoder233/transformers/tree/master/src/transformers |
| templates | https://github.com/zcoder233/transformers/tree/master/templates |
| templates | https://github.com/zcoder233/transformers/tree/master/templates |
| tests | https://github.com/zcoder233/transformers/tree/master/tests |
| tests | https://github.com/zcoder233/transformers/tree/master/tests |
| utils | https://github.com/zcoder233/transformers/tree/master/utils |
| utils | https://github.com/zcoder233/transformers/tree/master/utils |
| .coveragerc | https://github.com/zcoder233/transformers/blob/master/.coveragerc |
| .coveragerc | https://github.com/zcoder233/transformers/blob/master/.coveragerc |
| .gitignore | https://github.com/zcoder233/transformers/blob/master/.gitignore |
| .gitignore | https://github.com/zcoder233/transformers/blob/master/.gitignore |
| CODE_OF_CONDUCT.md | https://github.com/zcoder233/transformers/blob/master/CODE_OF_CONDUCT.md |
| CODE_OF_CONDUCT.md | https://github.com/zcoder233/transformers/blob/master/CODE_OF_CONDUCT.md |
| CONTRIBUTING.md | https://github.com/zcoder233/transformers/blob/master/CONTRIBUTING.md |
| CONTRIBUTING.md | https://github.com/zcoder233/transformers/blob/master/CONTRIBUTING.md |
| LICENSE | https://github.com/zcoder233/transformers/blob/master/LICENSE |
| LICENSE | https://github.com/zcoder233/transformers/blob/master/LICENSE |
| MANIFEST.in | https://github.com/zcoder233/transformers/blob/master/MANIFEST.in |
| MANIFEST.in | https://github.com/zcoder233/transformers/blob/master/MANIFEST.in |
| Makefile | https://github.com/zcoder233/transformers/blob/master/Makefile |
| Makefile | https://github.com/zcoder233/transformers/blob/master/Makefile |
| README.md | https://github.com/zcoder233/transformers/blob/master/README.md |
| README.md | https://github.com/zcoder233/transformers/blob/master/README.md |
| codecov.yml | https://github.com/zcoder233/transformers/blob/master/codecov.yml |
| codecov.yml | https://github.com/zcoder233/transformers/blob/master/codecov.yml |
| hubconf.py | https://github.com/zcoder233/transformers/blob/master/hubconf.py |
| hubconf.py | https://github.com/zcoder233/transformers/blob/master/hubconf.py |
| pyproject.toml | https://github.com/zcoder233/transformers/blob/master/pyproject.toml |
| pyproject.toml | https://github.com/zcoder233/transformers/blob/master/pyproject.toml |
| setup.cfg | https://github.com/zcoder233/transformers/blob/master/setup.cfg |
| setup.cfg | https://github.com/zcoder233/transformers/blob/master/setup.cfg |
| setup.py | https://github.com/zcoder233/transformers/blob/master/setup.py |
| setup.py | https://github.com/zcoder233/transformers/blob/master/setup.py |
| valohai.yaml | https://github.com/zcoder233/transformers/blob/master/valohai.yaml |
| valohai.yaml | https://github.com/zcoder233/transformers/blob/master/valohai.yaml |
| README | https://github.com/zcoder233/transformers |
| Code of conduct | https://github.com/zcoder233/transformers |
| Contributing | https://github.com/zcoder233/transformers |
| Apache-2.0 license | https://github.com/zcoder233/transformers |
| https://raw.githubusercontent.com/huggingface/transformers/master/docs/source/imgs/transformers_logo_name.png |
|
| https://circleci.com/gh/huggingface/transformers |
|
| https://github.com/huggingface/transformers/blob/master/LICENSE |
|
| https://huggingface.co/transformers/index.html |
|
| https://github.com/huggingface/transformers/releases |
|
| https://github.com/huggingface/transformers/blob/master/CODE_OF_CONDUCT.md |
| https://github.com/zcoder233/transformers#state-of-the-art-natural-language-processing-for-pytorch-and-tensorflow-20 |
| model hub | https://huggingface.co/models |
| PyTorch | https://pytorch.org/ |
| TensorFlow | https://www.tensorflow.org/ |
| https://github.com/zcoder233/transformers#recent-contributors |
| https://sourcerer.io/fame/clmnt/huggingface/transformers/links/0 |
| https://sourcerer.io/fame/clmnt/huggingface/transformers/links/1 |
| https://sourcerer.io/fame/clmnt/huggingface/transformers/links/2 |
| https://sourcerer.io/fame/clmnt/huggingface/transformers/links/3 |
| https://sourcerer.io/fame/clmnt/huggingface/transformers/links/4 |
| https://sourcerer.io/fame/clmnt/huggingface/transformers/links/5 |
| https://sourcerer.io/fame/clmnt/huggingface/transformers/links/6 |
| https://sourcerer.io/fame/clmnt/huggingface/transformers/links/7 |
| https://github.com/zcoder233/transformers#online-demos |
| model hub | https://huggingface.co/models |
| inference API | https://huggingface.co/pricing |
| Masked word completion with BERT | https://huggingface.co/bert-base-uncased?text=Paris+is+the+%5BMASK%5D+of+France |
| Name Entity Recognition with Electra | https://huggingface.co/dbmdz/electra-large-discriminator-finetuned-conll03-english?text=My+name+is+Sarah+and+I+live+in+London+city |
| Text generation with GPT-2 | https://huggingface.co/gpt2?text=A+long+time+ago%2C+ |
| Natural Langugage Inference with RoBERTa | https://huggingface.co/roberta-large-mnli?text=The+dog+was+lost.+Nobody+lost+any+animal |
| Summarization with BART | https://huggingface.co/facebook/bart-large-cnn?text=The+tower+is+324+metres+%281%2C063+ft%29+tall%2C+about+the+same+height+as+an+81-storey+building%2C+and+the+tallest+structure+in+Paris.+Its+base+is+square%2C+measuring+125+metres+%28410+ft%29+on+each+side.+During+its+construction%2C+the+Eiffel+Tower+surpassed+the+Washington+Monument+to+become+the+tallest+man-made+structure+in+the+world%2C+a+title+it+held+for+41+years+until+the+Chrysler+Building+in+New+York+City+was+finished+in+1930.+It+was+the+first+structure+to+reach+a+height+of+300+metres.+Due+to+the+addition+of+a+broadcasting+aerial+at+the+top+of+the+tower+in+1957%2C+it+is+now+taller+than+the+Chrysler+Building+by+5.2+metres+%2817+ft%29.+Excluding+transmitters%2C+the+Eiffel+Tower+is+the+second+tallest+free-standing+structure+in+France+after+the+Millau+Viaduct |
| Question answering with DistilBERT | https://huggingface.co/distilbert-base-uncased-distilled-squad?text=Which+name+is+also+used+to+describe+the+Amazon+rainforest+in+English%3F&context=The+Amazon+rainforest+%28Portuguese%3A+Floresta+Amaz%C3%B4nica+or+Amaz%C3%B4nia%3B+Spanish%3A+Selva+Amaz%C3%B3nica%2C+Amazon%C3%ADa+or+usually+Amazonia%3B+French%3A+For%C3%AAt+amazonienne%3B+Dutch%3A+Amazoneregenwoud%29%2C+also+known+in+English+as+Amazonia+or+the+Amazon+Jungle%2C+is+a+moist+broadleaf+forest+that+covers+most+of+the+Amazon+basin+of+South+America.+This+basin+encompasses+7%2C000%2C000+square+kilometres+%282%2C700%2C000+sq+mi%29%2C+of+which+5%2C500%2C000+square+kilometres+%282%2C100%2C000+sq+mi%29+are+covered+by+the+rainforest.+This+region+includes+territory+belonging+to+nine+nations.+The+majority+of+the+forest+is+contained+within+Brazil%2C+with+60%25+of+the+rainforest%2C+followed+by+Peru+with+13%25%2C+Colombia+with+10%25%2C+and+with+minor+amounts+in+Venezuela%2C+Ecuador%2C+Bolivia%2C+Guyana%2C+Suriname+and+French+Guiana.+States+or+departments+in+four+nations+contain+%22Amazonas%22+in+their+names.+The+Amazon+represents+over+half+of+the+planet%27s+remaining+rainforests%2C+and+comprises+the+largest+and+most+biodiverse+tract+of+tropical+rainforest+in+the+world%2C+with+an+estimated+390+billion+individual+trees+divided+into+16%2C000+species |
| Translation with T5 | https://huggingface.co/t5-base?text=My+name+is+Wolfgang+and+I+live+in+Berlin |
| Write With Transformer | https://transformer.huggingface.co |
| https://github.com/zcoder233/transformers#quick-tour |
| this tutorial | https://huggingface.co/transformers/task_summary.html |
| Pytorch nn.Module | https://pytorch.org/docs/stable/nn.html#torch.nn.Module |
| TensorFlow tf.keras.Model | https://www.tensorflow.org/api_docs/python/tf/keras/Model |
| this tutorial | https://huggingface.co/transformers/training.html |
| https://github.com/zcoder233/transformers#why-should-i-use-transformers |
| https://github.com/zcoder233/transformers#why-shouldnt-i-use-transformers |
| examples folder | https://github.com/huggingface/transformers/tree/master/examples |
| https://github.com/zcoder233/transformers#installation |
| examples | https://github.com/huggingface/transformers/tree/master/examples |
| virtual environment | https://docs.python.org/3/library/venv.html |
| user guide | https://packaging.python.org/guides/installing-using-pip-and-virtual-environments/ |
| TensorFlow installation page | https://www.tensorflow.org/install/pip#tensorflow-2.0-rc-is-available |
| PyTorch installation page | https://pytorch.org/get-started/locally/#start-locally |
| install the library from source | https://huggingface.co/transformers/installation.html#installing-from-source |
| https://github.com/zcoder233/transformers#models-architectures |
| here | https://huggingface.co/transformers/model_summary.html |
| ALBERT | https://huggingface.co/transformers/model_doc/albert.html |
| ALBERT: A Lite BERT for Self-supervised Learning of Language Representations | https://arxiv.org/abs/1909.11942 |
| BART | https://huggingface.co/transformers/model_doc/bart.html |
| BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension | https://arxiv.org/pdf/1910.13461.pdf |
| BERT | https://huggingface.co/transformers/model_doc/bert.html |
| BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding | https://arxiv.org/abs/1810.04805 |
| BERT For Sequence Generation | https://huggingface.co/transformers/model_doc/bertgeneration.html |
| Leveraging Pre-trained Checkpoints for Sequence Generation Tasks | https://arxiv.org/abs/1907.12461 |
| Blenderbot | https://huggingface.co/transformers/master/model_doc/blenderbot.html |
| Recipes for building an open-domain chatbot | https://arxiv.org/abs/2004.13637 |
| CamemBERT | https://huggingface.co/transformers/model_doc/camembert.html |
| CamemBERT: a Tasty French Language Model | https://arxiv.org/abs/1911.03894 |
| CTRL | https://huggingface.co/transformers/model_doc/ctrl.html |
| CTRL: A Conditional Transformer Language Model for Controllable Generation | https://arxiv.org/abs/1909.05858 |
| DeBERTa | https://huggingface.co/transformers/master/model_doc/deberta.html |
| DeBERTa: Decoding-enhanced BERT with Disentangled Attention | https://arxiv.org/abs/2006.03654 |
| DialoGPT | https://huggingface.co/transformers/model_doc/dialogpt.html |
| DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation | https://arxiv.org/abs/1911.00536 |
| DistilBERT | https://huggingface.co/transformers/model_doc/distilbert.html |
| DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter | https://arxiv.org/abs/1910.01108 |
| DistilGPT2 | https://github.com/huggingface/transformers/tree/master/examples/distillation |
| DistilRoBERTa | https://github.com/huggingface/transformers/tree/master/examples/distillation |
| DistilmBERT | https://github.com/huggingface/transformers/tree/master/examples/distillation |
| DPR | https://huggingface.co/transformers/model_doc/dpr.html |
| Dense Passage Retrieval
for Open-Domain Question Answering | https://arxiv.org/abs/2004.04906 |
| ELECTRA | https://huggingface.co/transformers/model_doc/electra.html |
| ELECTRA: Pre-training text encoders as discriminators rather than generators | https://arxiv.org/abs/2003.10555 |
| FlauBERT | https://huggingface.co/transformers/model_doc/flaubert.html |
| FlauBERT: Unsupervised Language Model Pre-training for French | https://arxiv.org/abs/1912.05372 |
| Funnel Transformer | https://huggingface.co/transformers/model_doc/funnel.html |
| Funnel-Transformer: Filtering out Sequential Redundancy for Efficient Language Processing | https://arxiv.org/abs/2006.03236 |
| GPT | https://huggingface.co/transformers/model_doc/gpt.html |
| Improving Language Understanding by Generative Pre-Training | https://blog.openai.com/language-unsupervised/ |
| GPT-2 | https://huggingface.co/transformers/model_doc/gpt2.html |
| Language Models are Unsupervised Multitask Learners | https://blog.openai.com/better-language-models/ |
| LayoutLM | https://huggingface.co/transformers/model_doc/layoutlm.html |
| LayoutLM: Pre-training of Text and Layout for Document Image Understanding | https://arxiv.org/abs/1912.13318 |
| Longformer | https://huggingface.co/transformers/model_doc/longformer.html |
| Longformer: The Long-Document Transformer | https://arxiv.org/abs/2004.05150 |
| LXMERT | https://huggingface.co/transformers/model_doc/lxmert.html |
| LXMERT: Learning Cross-Modality Encoder Representations from Transformers for Open-Domain Question Answering | https://arxiv.org/abs/1908.07490 |
| MarianMT | https://huggingface.co/transformers/model_doc/marian.html |
| OPUS | http://opus.nlpl.eu/ |
| Marian Framework | https://marian-nmt.github.io/ |
| MBart | https://huggingface.co/transformers/model_doc/mbart.html |
| Multilingual Denoising Pre-training for Neural Machine Translation | https://arxiv.org/abs/2001.08210 |
| Pegasus | https://huggingface.co/transformers/model_doc/pegasus.html |
| PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization | https://arxiv.org/abs/1912.08777 |
| Reformer | https://huggingface.co/transformers/model_doc/reformer.html |
| Reformer: The Efficient Transformer | https://arxiv.org/abs/2001.04451 |
| RoBERTa | https://huggingface.co/transformers/model_doc/roberta.html |
| Robustly Optimized BERT Pretraining Approach | https://arxiv.org/abs/1907.11692 |
| DistilmBERT | https://github.com/huggingface/transformers/tree/master/examples/distillation |
| SqueezeBert | https://huggingface.co/transformers/master/model_doc/squeezebert.html |
| SqueezeBERT: What can computer vision teach NLP about efficient neural networks? | https://arxiv.org/abs/2006.11316 |
| T5 | https://huggingface.co/transformers/model_doc/t5.html |
| Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer | https://arxiv.org/abs/1910.10683 |
| Transformer-XL | https://huggingface.co/transformers/model_doc/transformerxl.html |
| Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context | https://arxiv.org/abs/1901.02860 |
| XLM | https://huggingface.co/transformers/model_doc/xlm.html |
| Cross-lingual Language Model Pretraining | https://arxiv.org/abs/1901.07291 |
| XLM-RoBERTa | https://huggingface.co/transformers/model_doc/xlmroberta.html |
| Unsupervised Cross-lingual Representation Learning at Scale | https://arxiv.org/abs/1911.02116 |
| XLNet | https://huggingface.co/transformers/model_doc/xlnet.html |
| XLNet: Generalized Autoregressive Pretraining for Language Understanding | https://arxiv.org/abs/1906.08237 |
| Other community models | https://huggingface.co/models |
| community | https://huggingface.co/users |
| templates | https://github.com/zcoder233/transformers/blob/master/templates |
| contributing guidelines | https://github.com/zcoder233/transformers/blob/master/CONTRIBUTING.md |
| documentation | https://huggingface.co/transformers/examples.html |
| https://github.com/zcoder233/transformers#learn-more |
| Documentation | https://huggingface.co/transformers/ |
| Task summary | https://huggingface.co/transformers/task_summary.html |
| Preprocessing tutorial | https://huggingface.co/transformers/preprocessing.html |
| Training and fine-tuning | https://huggingface.co/transformers/training.html |
| Quick tour: Fine-tuning/usage scripts | https://github.com/huggingface/transformers/tree/master/examples |
| Model sharing and uploading | https://huggingface.co/transformers/model_sharing.html |
| Migration | https://huggingface.co/transformers/migration.html |
| https://github.com/zcoder233/transformers#citation |
| paper | https://arxiv.org/abs/1910.03771 |
| huggingface.co/transformers | https://huggingface.co/transformers |
| Readme | https://github.com/zcoder233/transformers#readme-ov-file |
| Apache-2.0 license | https://github.com/zcoder233/transformers#Apache-2.0-1-ov-file |
| Code of conduct | https://github.com/zcoder233/transformers#coc-ov-file |
| Contributing | https://github.com/zcoder233/transformers#contributing-ov-file |
| Activity | https://github.com/zcoder233/transformers/activity |
| 0 forks | https://github.com/zcoder233/transformers/forks |
| Report repository | https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Fzcoder233%2Ftransformers&report=zcoder233+%28user%29 |
|
| https://github.com |
| Terms | https://docs.github.com/site-policy/github-terms/github-terms-of-service |
| Privacy | https://docs.github.com/site-policy/privacy-policies/github-privacy-statement |
| Security | https://github.com/security |
| Status | https://www.githubstatus.com/ |
| Community | https://github.community/ |
| Docs | https://docs.github.com/ |
| Contact | https://support.github.com?tags=dotcom-footer |