| route-pattern | /:user_id/:repository |
| route-controller | files |
| route-action | disambiguate |
| fetch-nonce | v2:30b9aec8-59ef-0713-5020-374fa45b6411 |
| current-catalog-service-hash | f3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb |
| request-id | 8E86:27E99F:174A45F:1E18B9B:69645406 |
| html-safe-nonce | 0d8e7840a3c95cabdeb595ab3c5f7a7947d0e6a93be0a4d39353d837cea11909 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI4RTg2OjI3RTk5RjoxNzRBNDVGOjFFMThCOUI6Njk2NDU0MDYiLCJ2aXNpdG9yX2lkIjoiNjA0ODExNjAyNjc5MzgwODkwMiIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9 |
| visitor-hmac | 1c62edf9dc58833f5441d7e8af0798daa58e62b70ba3fa609b16533cdecc2d8a |
| hovercard-subject-tag | repository:154747577 |
| github-keyboard-shortcuts | repository,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | // |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/google-research/bert |
| twitter:image | https://opengraph.githubassets.com/0f4a5873d7ab7314b1547468f3ce12fa3b7cb78033aa8038ed7c62c1122d16e4/google-research/bert |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/0f4a5873d7ab7314b1547468f3ce12fa3b7cb78033aa8038ed7c62c1122d16e4/google-research/bert |
| og:image:alt | TensorFlow code and pre-trained models for BERT. Contribute to google-research/bert development by creating an account on GitHub. |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| hostname | github.com |
| expected-hostname | github.com |
| None | baa7d9900fdf7b27d604f36887af878d569cfbdcf97126832a5f4f0caf0c6ba5 |
| turbo-cache-control | no-preview |
| go-import | github.com/google-research/bert git https://github.com/google-research/bert.git |
| octolytics-dimension-user_id | 43830688 |
| octolytics-dimension-user_login | google-research |
| octolytics-dimension-repository_id | 154747577 |
| octolytics-dimension-repository_nwo | google-research/bert |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 154747577 |
| octolytics-dimension-repository_network_root_nwo | google-research/bert |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 842eff1d11f899d02b6b3b98fa3ea4860e64b34e |
| ui-target | canary-2 |
| theme-color | #1e2327 |
| color-scheme | light dark |
| Skip to content | https://github.com/google-research/bert#start-of-content |
|
| https://github.com/ |
|
Sign in
| https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fgoogle-research%2Fbert |
| GitHub CopilotWrite better code with AI | https://github.com/features/copilot |
| GitHub SparkBuild and deploy intelligent apps | https://github.com/features/spark |
| GitHub ModelsManage and compare prompts | https://github.com/features/models |
| MCP RegistryNewIntegrate external tools | https://github.com/mcp |
| ActionsAutomate any workflow | https://github.com/features/actions |
| CodespacesInstant dev environments | https://github.com/features/codespaces |
| IssuesPlan and track work | https://github.com/features/issues |
| Code ReviewManage code changes | https://github.com/features/code-review |
| GitHub Advanced SecurityFind and fix vulnerabilities | https://github.com/security/advanced-security |
| Code securitySecure your code as you build | https://github.com/security/advanced-security/code-security |
| Secret protectionStop leaks before they start | https://github.com/security/advanced-security/secret-protection |
| Why GitHub | https://github.com/why-github |
| Documentation | https://docs.github.com |
| Blog | https://github.blog |
| Changelog | https://github.blog/changelog |
| Marketplace | https://github.com/marketplace |
| View all features | https://github.com/features |
| Enterprises | https://github.com/enterprise |
| Small and medium teams | https://github.com/team |
| Startups | https://github.com/enterprise/startups |
| Nonprofits | https://github.com/solutions/industry/nonprofits |
| App Modernization | https://github.com/solutions/use-case/app-modernization |
| DevSecOps | https://github.com/solutions/use-case/devsecops |
| DevOps | https://github.com/solutions/use-case/devops |
| CI/CD | https://github.com/solutions/use-case/ci-cd |
| View all use cases | https://github.com/solutions/use-case |
| Healthcare | https://github.com/solutions/industry/healthcare |
| Financial services | https://github.com/solutions/industry/financial-services |
| Manufacturing | https://github.com/solutions/industry/manufacturing |
| Government | https://github.com/solutions/industry/government |
| View all industries | https://github.com/solutions/industry |
| View all solutions | https://github.com/solutions |
| AI | https://github.com/resources/articles?topic=ai |
| Software Development | https://github.com/resources/articles?topic=software-development |
| DevOps | https://github.com/resources/articles?topic=devops |
| Security | https://github.com/resources/articles?topic=security |
| View all topics | https://github.com/resources/articles |
| Customer stories | https://github.com/customer-stories |
| Events & webinars | https://github.com/resources/events |
| Ebooks & reports | https://github.com/resources/whitepapers |
| Business insights | https://github.com/solutions/executive-insights |
| GitHub Skills | https://skills.github.com |
| Documentation | https://docs.github.com |
| Customer support | https://support.github.com |
| Community forum | https://github.com/orgs/community/discussions |
| Trust center | https://github.com/trust-center |
| Partners | https://github.com/partners |
| GitHub SponsorsFund open source developers | https://github.com/sponsors |
| Security Lab | https://securitylab.github.com |
| Maintainer Community | https://maintainers.github.com |
| Accelerator | https://github.com/accelerator |
| Archive Program | https://archiveprogram.github.com |
| Topics | https://github.com/topics |
| Trending | https://github.com/trending |
| Collections | https://github.com/collections |
| Enterprise platformAI-powered developer platform | https://github.com/enterprise |
| GitHub Advanced SecurityEnterprise-grade security features | https://github.com/security/advanced-security |
| Copilot for BusinessEnterprise-grade AI features | https://github.com/features/copilot/copilot-business |
| Premium SupportEnterprise-grade 24/7 support | https://github.com/premium-support |
| Pricing | https://github.com/pricing |
| Search syntax tips | https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax |
| documentation | https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax |
|
Sign in
| https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fgoogle-research%2Fbert |
|
Sign up
| https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=google-research%2Fbert |
| Reload | https://github.com/google-research/bert |
| Reload | https://github.com/google-research/bert |
| Reload | https://github.com/google-research/bert |
|
google-research
| https://github.com/google-research |
| bert | https://github.com/google-research/bert |
|
Notifications
| https://github.com/login?return_to=%2Fgoogle-research%2Fbert |
|
Fork
9.7k
| https://github.com/login?return_to=%2Fgoogle-research%2Fbert |
|
Star
39.8k
| https://github.com/login?return_to=%2Fgoogle-research%2Fbert |
| arxiv.org/abs/1810.04805 | https://arxiv.org/abs/1810.04805 |
|
Apache-2.0 license
| https://github.com/google-research/bert/blob/master/LICENSE |
|
39.8k
stars
| https://github.com/google-research/bert/stargazers |
|
9.7k
forks
| https://github.com/google-research/bert/forks |
|
Branches
| https://github.com/google-research/bert/branches |
|
Tags
| https://github.com/google-research/bert/tags |
|
Activity
| https://github.com/google-research/bert/activity |
|
Star
| https://github.com/login?return_to=%2Fgoogle-research%2Fbert |
|
Notifications
| https://github.com/login?return_to=%2Fgoogle-research%2Fbert |
|
Code
| https://github.com/google-research/bert |
|
Issues
791
| https://github.com/google-research/bert/issues |
|
Pull requests
93
| https://github.com/google-research/bert/pulls |
|
Actions
| https://github.com/google-research/bert/actions |
|
Security
Uh oh!
There was an error while loading. Please reload this page.
| https://github.com/google-research/bert/security |
| Please reload this page | https://github.com/google-research/bert |
|
Insights
| https://github.com/google-research/bert/pulse |
|
Code
| https://github.com/google-research/bert |
|
Issues
| https://github.com/google-research/bert/issues |
|
Pull requests
| https://github.com/google-research/bert/pulls |
|
Actions
| https://github.com/google-research/bert/actions |
|
Security
| https://github.com/google-research/bert/security |
|
Insights
| https://github.com/google-research/bert/pulse |
| Branches | https://github.com/google-research/bert/branches |
| Tags | https://github.com/google-research/bert/tags |
| https://github.com/google-research/bert/branches |
| https://github.com/google-research/bert/tags |
| 111 Commits | https://github.com/google-research/bert/commits/master/ |
| https://github.com/google-research/bert/commits/master/ |
| .gitignore | https://github.com/google-research/bert/blob/master/.gitignore |
| .gitignore | https://github.com/google-research/bert/blob/master/.gitignore |
| CONTRIBUTING.md | https://github.com/google-research/bert/blob/master/CONTRIBUTING.md |
| CONTRIBUTING.md | https://github.com/google-research/bert/blob/master/CONTRIBUTING.md |
| LICENSE | https://github.com/google-research/bert/blob/master/LICENSE |
| LICENSE | https://github.com/google-research/bert/blob/master/LICENSE |
| README.md | https://github.com/google-research/bert/blob/master/README.md |
| README.md | https://github.com/google-research/bert/blob/master/README.md |
| __init__.py | https://github.com/google-research/bert/blob/master/__init__.py |
| __init__.py | https://github.com/google-research/bert/blob/master/__init__.py |
| create_pretraining_data.py | https://github.com/google-research/bert/blob/master/create_pretraining_data.py |
| create_pretraining_data.py | https://github.com/google-research/bert/blob/master/create_pretraining_data.py |
| extract_features.py | https://github.com/google-research/bert/blob/master/extract_features.py |
| extract_features.py | https://github.com/google-research/bert/blob/master/extract_features.py |
| modeling.py | https://github.com/google-research/bert/blob/master/modeling.py |
| modeling.py | https://github.com/google-research/bert/blob/master/modeling.py |
| modeling_test.py | https://github.com/google-research/bert/blob/master/modeling_test.py |
| modeling_test.py | https://github.com/google-research/bert/blob/master/modeling_test.py |
| multilingual.md | https://github.com/google-research/bert/blob/master/multilingual.md |
| multilingual.md | https://github.com/google-research/bert/blob/master/multilingual.md |
| optimization.py | https://github.com/google-research/bert/blob/master/optimization.py |
| optimization.py | https://github.com/google-research/bert/blob/master/optimization.py |
| optimization_test.py | https://github.com/google-research/bert/blob/master/optimization_test.py |
| optimization_test.py | https://github.com/google-research/bert/blob/master/optimization_test.py |
| predicting_movie_reviews_with_bert_on_tf_hub.ipynb | https://github.com/google-research/bert/blob/master/predicting_movie_reviews_with_bert_on_tf_hub.ipynb |
| predicting_movie_reviews_with_bert_on_tf_hub.ipynb | https://github.com/google-research/bert/blob/master/predicting_movie_reviews_with_bert_on_tf_hub.ipynb |
| requirements.txt | https://github.com/google-research/bert/blob/master/requirements.txt |
| requirements.txt | https://github.com/google-research/bert/blob/master/requirements.txt |
| run_classifier.py | https://github.com/google-research/bert/blob/master/run_classifier.py |
| run_classifier.py | https://github.com/google-research/bert/blob/master/run_classifier.py |
| run_classifier_with_tfhub.py | https://github.com/google-research/bert/blob/master/run_classifier_with_tfhub.py |
| run_classifier_with_tfhub.py | https://github.com/google-research/bert/blob/master/run_classifier_with_tfhub.py |
| run_pretraining.py | https://github.com/google-research/bert/blob/master/run_pretraining.py |
| run_pretraining.py | https://github.com/google-research/bert/blob/master/run_pretraining.py |
| run_squad.py | https://github.com/google-research/bert/blob/master/run_squad.py |
| run_squad.py | https://github.com/google-research/bert/blob/master/run_squad.py |
| sample_text.txt | https://github.com/google-research/bert/blob/master/sample_text.txt |
| sample_text.txt | https://github.com/google-research/bert/blob/master/sample_text.txt |
| tokenization.py | https://github.com/google-research/bert/blob/master/tokenization.py |
| tokenization.py | https://github.com/google-research/bert/blob/master/tokenization.py |
| tokenization_test.py | https://github.com/google-research/bert/blob/master/tokenization_test.py |
| tokenization_test.py | https://github.com/google-research/bert/blob/master/tokenization_test.py |
| README | https://github.com/google-research/bert |
| Contributing | https://github.com/google-research/bert |
| Apache-2.0 license | https://github.com/google-research/bert |
| https://github.com/google-research/bert#bert |
| Well-Read Students Learn Better: On the Importance of Pre-training Compact Models | https://arxiv.org/abs/1908.08962 |
| here | https://storage.googleapis.com/bert_models/2020_02_20/all_bert_models.zip |
| 2/128 (BERT-Tiny) | https://storage.googleapis.com/bert_models/2020_02_20/uncased_L-2_H-128_A-2.zip |
| 2/256 | https://storage.googleapis.com/bert_models/2020_02_20/uncased_L-2_H-256_A-4.zip |
| 2/512 | https://storage.googleapis.com/bert_models/2020_02_20/uncased_L-2_H-512_A-8.zip |
| 2/768 | https://storage.googleapis.com/bert_models/2020_02_20/uncased_L-2_H-768_A-12.zip |
| 4/128 | https://storage.googleapis.com/bert_models/2020_02_20/uncased_L-4_H-128_A-2.zip |
| 4/256 (BERT-Mini) | https://storage.googleapis.com/bert_models/2020_02_20/uncased_L-4_H-256_A-4.zip |
| 4/512 (BERT-Small) | https://storage.googleapis.com/bert_models/2020_02_20/uncased_L-4_H-512_A-8.zip |
| 4/768 | https://storage.googleapis.com/bert_models/2020_02_20/uncased_L-4_H-768_A-12.zip |
| 6/128 | https://storage.googleapis.com/bert_models/2020_02_20/uncased_L-6_H-128_A-2.zip |
| 6/256 | https://storage.googleapis.com/bert_models/2020_02_20/uncased_L-6_H-256_A-4.zip |
| 6/512 | https://storage.googleapis.com/bert_models/2020_02_20/uncased_L-6_H-512_A-8.zip |
| 6/768 | https://storage.googleapis.com/bert_models/2020_02_20/uncased_L-6_H-768_A-12.zip |
| 8/128 | https://storage.googleapis.com/bert_models/2020_02_20/uncased_L-8_H-128_A-2.zip |
| 8/256 | https://storage.googleapis.com/bert_models/2020_02_20/uncased_L-8_H-256_A-4.zip |
| 8/512 (BERT-Medium) | https://storage.googleapis.com/bert_models/2020_02_20/uncased_L-8_H-512_A-8.zip |
| 8/768 | https://storage.googleapis.com/bert_models/2020_02_20/uncased_L-8_H-768_A-12.zip |
| 10/128 | https://storage.googleapis.com/bert_models/2020_02_20/uncased_L-10_H-128_A-2.zip |
| 10/256 | https://storage.googleapis.com/bert_models/2020_02_20/uncased_L-10_H-256_A-4.zip |
| 10/512 | https://storage.googleapis.com/bert_models/2020_02_20/uncased_L-10_H-512_A-8.zip |
| 10/768 | https://storage.googleapis.com/bert_models/2020_02_20/uncased_L-10_H-768_A-12.zip |
| 12/128 | https://storage.googleapis.com/bert_models/2020_02_20/uncased_L-12_H-128_A-2.zip |
| 12/256 | https://storage.googleapis.com/bert_models/2020_02_20/uncased_L-12_H-256_A-4.zip |
| 12/512 | https://storage.googleapis.com/bert_models/2020_02_20/uncased_L-12_H-512_A-8.zip |
| 12/768 (BERT-Base) | https://storage.googleapis.com/bert_models/2020_02_20/uncased_L-12_H-768_A-12.zip |
| BERT-Large, Uncased (Whole Word Masking) | https://storage.googleapis.com/bert_models/2019_05_30/wwm_uncased_L-24_H-1024_A-16.zip |
| BERT-Large, Cased (Whole Word Masking) | https://storage.googleapis.com/bert_models/2019_05_30/wwm_cased_L-24_H-1024_A-16.zip |
| TensorFlow Hub | https://tfhub.dev |
| Colab | https://colab.sandbox.google.com/github/google-research/bert/blob/master/predicting_movie_reviews_with_bert_on_tf_hub.ipynb |
| BERT-Base, Multilingual Cased | https://storage.googleapis.com/bert_models/2018_11_23/multi_cased_L-12_H-768_A-12.zip |
| PyTorch version of BERT available | https://github.com/huggingface/pytorch-pretrained-BERT |
| Chainer version of BERT available | https://github.com/soskek/bert-chainer |
| BERT-Base, Multilingual | https://storage.googleapis.com/bert_models/2018_11_03/multilingual_L-12_H-768_A-12.zip |
| BERT-Base, Chinese | https://storage.googleapis.com/bert_models/2018_11_03/chinese_L-12_H-768_A-12.zip |
| Multilingual README | https://github.com/google-research/bert/blob/master/multilingual.md |
| https://github.com/google-research/bert#introduction |
| https://arxiv.org/abs/1810.04805 | https://arxiv.org/abs/1810.04805 |
| SQuAD v1.1 | https://rajpurkar.github.io/SQuAD-explorer/ |
| download the pre-trained models | https://github.com/google-research/bert#pre-trained-models |
| run a state-of-the-art fine-tuning | https://github.com/google-research/bert#fine-tuning-with-bert |
| https://github.com/google-research/bert#what-is-bert |
| word2vec | https://www.tensorflow.org/tutorials/representation/word2vec |
| GloVe | https://nlp.stanford.edu/projects/glove/ |
| Semi-supervised Sequence Learning | https://arxiv.org/abs/1511.01432 |
| Generative Pre-Training | https://blog.openai.com/language-unsupervised/ |
| ELMo | https://allennlp.org/elmo |
| ULMFit | http://nlp.fast.ai/classification/2018/05/15/introducting-ulmfit.html |
| Transformer | https://arxiv.org/abs/1706.03762 |
| BookCorpus | http://yknzhu.wixsite.com/mbweb |
| https://github.com/google-research/bert#what-has-been-released-in-this-repository |
| Transformer | https://arxiv.org/abs/1706.03762 |
| https://github.com/google-research/bert#pre-trained-models |
| Multilingual README | https://github.com/google-research/bert/blob/master/multilingual.md |
| BERT-Large, Uncased (Whole Word Masking) | https://storage.googleapis.com/bert_models/2019_05_30/wwm_uncased_L-24_H-1024_A-16.zip |
| BERT-Large, Cased (Whole Word Masking) | https://storage.googleapis.com/bert_models/2019_05_30/wwm_cased_L-24_H-1024_A-16.zip |
| BERT-Base, Uncased | https://storage.googleapis.com/bert_models/2018_10_18/uncased_L-12_H-768_A-12.zip |
| BERT-Large, Uncased | https://storage.googleapis.com/bert_models/2018_10_18/uncased_L-24_H-1024_A-16.zip |
| BERT-Base, Cased | https://storage.googleapis.com/bert_models/2018_10_18/cased_L-12_H-768_A-12.zip |
| BERT-Large, Cased | https://storage.googleapis.com/bert_models/2018_10_18/cased_L-24_H-1024_A-16.zip |
| BERT-Base, Multilingual Cased (New, recommended) | https://storage.googleapis.com/bert_models/2018_11_23/multi_cased_L-12_H-768_A-12.zip |
| BERT-Base, Multilingual Uncased (Orig, not recommended) | https://storage.googleapis.com/bert_models/2018_11_03/multilingual_L-12_H-768_A-12.zip |
| BERT-Base, Chinese | https://storage.googleapis.com/bert_models/2018_11_03/chinese_L-12_H-768_A-12.zip |
| https://github.com/google-research/bert#fine-tuning-with-bert |
| out-of-memory issues | https://github.com/google-research/bert#out-of-memory-issues |
| https://github.com/google-research/bert#fine-tuning-with-cloud-tpus |
| Google Cloud TPU tutorial | https://cloud.google.com/tpu/docs/tutorials/mnist |
| BERT FineTuning with Cloud TPUs | https://colab.research.google.com/github/tensorflow/tpu/blob/master/tools/colab/bert_finetuning_with_cloud_tpus.ipynb |
| https://github.com/google-research/bert#sentence-and-sentence-pair-classification-tasks |
| GLUE data | https://gluebenchmark.com/tasks |
| this script | https://gist.github.com/W4ngatang/60c2bdb54d156a41194446737ce03e2e |
| https://github.com/google-research/bert#prediction-from-classifier |
| https://github.com/google-research/bert#squad-11 |
| SQuAD website | https://rajpurkar.github.io/SQuAD-explorer/ |
| train-v1.1.json | https://rajpurkar.github.io/SQuAD-explorer/dataset/train-v1.1.json |
| dev-v1.1.json | https://rajpurkar.github.io/SQuAD-explorer/dataset/dev-v1.1.json |
| evaluate-v1.1.py | https://github.com/allenai/bi-att-flow/blob/master/squad/evaluate-v1.1.py |
| TriviaQA | http://nlp.cs.washington.edu/triviaqa/ |
| https://github.com/google-research/bert#squad-20 |
| train-v2.0.json | https://rajpurkar.github.io/SQuAD-explorer/dataset/train-v2.0.json |
| dev-v2.0.json | https://rajpurkar.github.io/SQuAD-explorer/dataset/dev-v2.0.json |
| evaluate-v2.0.py | https://worksheets.codalab.org/rest/bundles/0x6b567e1cf2e041ec80d7098f031c5c9e/contents/blob/ |
| https://github.com/google-research/bert#out-of-memory-issues |
| Gradient checkpointing | https://github.com/openai/gradient-checkpointing |
| https://github.com/google-research/bert#using-bert-to-extract-fixed-feature-vectors-like-elmo |
| Tokenization | https://github.com/google-research/bert#tokenization |
| https://github.com/google-research/bert#tokenization |
| WordPiece | https://github.com/tensorflow/tensor2tensor/blob/master/tensor2tensor/data_generators/text_encoder.py |
| https://github.com/google-research/bert#pre-training-with-bert |
| spaCy | https://spacy.io/ |
| https://github.com/google-research/bert#pre-training-tips-and-caveats |
| preemptible Cloud TPU v2 | https://cloud.google.com/tpu/docs/pricing |
| https://github.com/google-research/bert#pre-training-data |
| the latest dump | https://dumps.wikimedia.org/enwiki/latest/enwiki-latest-pages-articles.xml.bz2 |
| WikiExtractor.py | https://github.com/attardi/wikiextractor |
| BookCorpus | http://yknzhu.wixsite.com/mbweb |
| Project Guttenberg Dataset | https://web.eecs.umich.edu/~lahiri/gutenberg_dataset.html |
| Common Crawl | http://commoncrawl.org/ |
| https://github.com/google-research/bert#learning-a-new-wordpiece-vocabulary |
| Google's SentencePiece library | https://github.com/google/sentencepiece |
| tensor2tensor's WordPiece generation script | https://github.com/tensorflow/tensor2tensor/blob/master/tensor2tensor/data_generators/text_encoder_build_subword.py |
| Rico Sennrich's Byte Pair Encoding library | https://github.com/rsennrich/subword-nmt |
| https://github.com/google-research/bert#using-bert-in-colab |
| Colab | https://colab.research.google.com |
| BERT FineTuning with Cloud TPUs | https://colab.research.google.com/github/tensorflow/tpu/blob/master/tools/colab/bert_finetuning_with_cloud_tpus.ipynb |
| https://github.com/google-research/bert#faq |
| https://github.com/google-research/bert#is-this-code-compatible-with-cloud-tpus-what-about-gpus |
| https://github.com/google-research/bert#i-am-getting-out-of-memory-errors-what-is-wrong |
| out-of-memory issues | https://github.com/google-research/bert#out-of-memory-issues |
| https://github.com/google-research/bert#is-there-a-pytorch-version-available |
| PyTorch version of BERT available | https://github.com/huggingface/pytorch-pretrained-BERT |
| https://github.com/google-research/bert#is-there-a-chainer-version-available |
| Chainer version of BERT available | https://github.com/soskek/bert-chainer |
| https://github.com/google-research/bert#will-models-in-other-languages-be-released |
| https://github.com/google-research/bert#will-models-larger-than-bert-large-be-released |
| https://github.com/google-research/bert#what-license-is-this-library-released-under |
| https://github.com/google-research/bert#how-do-i-cite-bert |
| the Arxiv paper | https://arxiv.org/abs/1810.04805 |
| https://github.com/google-research/bert#disclaimer |
| https://github.com/google-research/bert#contact-information |
| arxiv.org/abs/1810.04805 | https://arxiv.org/abs/1810.04805 |
|
nlp
| https://github.com/topics/nlp |
|
natural-language-processing
| https://github.com/topics/natural-language-processing |
|
google
| https://github.com/topics/google |
|
tensorflow
| https://github.com/topics/tensorflow |
|
natural-language-understanding
| https://github.com/topics/natural-language-understanding |
|
Readme
| https://github.com/google-research/bert#readme-ov-file |
|
Apache-2.0 license
| https://github.com/google-research/bert#Apache-2.0-1-ov-file |
|
Contributing
| https://github.com/google-research/bert#contributing-ov-file |
| Please reload this page | https://github.com/google-research/bert |
|
Activity | https://github.com/google-research/bert/activity |
|
Custom properties | https://github.com/google-research/bert/custom-properties |
|
39.8k
stars | https://github.com/google-research/bert/stargazers |
|
993
watching | https://github.com/google-research/bert/watchers |
|
9.7k
forks | https://github.com/google-research/bert/forks |
|
Report repository
| https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Fgoogle-research%2Fbert&report=google-research+%28user%29 |
| Releases | https://github.com/google-research/bert/releases |
| Packages
0 | https://github.com/orgs/google-research/packages?repo_name=bert |
| Please reload this page | https://github.com/google-research/bert |
| Contributors
28 | https://github.com/google-research/bert/graphs/contributors |
|
| https://github.com/jacobdevlin-google |
|
| https://github.com/abhishekraok |
|
| https://github.com/dalequark |
|
| https://github.com/cbockman |
|
| https://github.com/slavpetrov |
|
| https://github.com/eric-haibin-lin |
|
| https://github.com/artemisart |
|
| https://github.com/BogdanDidenko |
|
| https://github.com/craigcitro |
|
| https://github.com/ywkim |
|
| https://github.com/imcaspar |
|
| https://github.com/hsm207 |
|
| https://github.com/aijunbai |
|
| https://github.com/pengli09 |
| + 14 contributors | https://github.com/google-research/bert/graphs/contributors |
|
Python
76.3%
| https://github.com/google-research/bert/search?l=python |
|
Jupyter Notebook
23.7%
| https://github.com/google-research/bert/search?l=jupyter-notebook |
|
| https://github.com |
| Terms | https://docs.github.com/site-policy/github-terms/github-terms-of-service |
| Privacy | https://docs.github.com/site-policy/privacy-policies/github-privacy-statement |
| Security | https://github.com/security |
| Status | https://www.githubstatus.com/ |
| Community | https://github.community/ |
| Docs | https://docs.github.com/ |
| Contact | https://support.github.com?tags=dotcom-footer |