René's URL Explorer Experiment


Title: GitHub - G-Wang/pytorch-pretrained-BERT: PyTorch version of Google AI's BERT model with script to load Google's pre-trained models · GitHub

Open Graph Title: GitHub - G-Wang/pytorch-pretrained-BERT: PyTorch version of Google AI's BERT model with script to load Google's pre-trained models

X Title: GitHub - G-Wang/pytorch-pretrained-BERT: PyTorch version of Google AI's BERT model with script to load Google's pre-trained models

Description: PyTorch version of Google AI's BERT model with script to load Google's pre-trained models - G-Wang/pytorch-pretrained-BERT

Open Graph Description: PyTorch version of Google AI's BERT model with script to load Google's pre-trained models - G-Wang/pytorch-pretrained-BERT

X Description: PyTorch version of Google AI's BERT model with script to load Google's pre-trained models - G-Wang/pytorch-pretrained-BERT

Opengraph URL: https://github.com/G-Wang/pytorch-pretrained-BERT

X: @github

direct link

Domain: github.com

route-pattern/:user_id/:repository
route-controllerfiles
route-actiondisambiguate
fetch-noncev2:2a4ead79-7db6-641b-5490-ce77f417d5b9
current-catalog-service-hashf3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-idE47E:37941:1DC0B11:28493F4:6A654DE5
html-safe-nonceb834a9908ee30d29af2c1dab12511e83d534f8d841d7db99091c64b66a0a5b5f
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJFNDdFOjM3OTQxOjFEQzBCMTE6Mjg0OTNGNDo2QTY1NERFNSIsInZpc2l0b3JfaWQiOiI3NjEyNzI0MzkzMTQ1NjE3ODkzIiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0=
visitor-hmacf9ae36e8e6acaa39610ba58ccc982fe50cbed93b5e501bda5fb8c57ac4a1109b
hovercard-subject-tagrepository:156260029
github-keyboard-shortcutsrepository,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location//
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/G-Wang/pytorch-pretrained-BERT
twitter:imagehttps://opengraph.githubassets.com/3902c9bc902b60d777bb0c42aea249401f5ca0a9f02e845284de72f0c80968f5/G-Wang/pytorch-pretrained-BERT
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/3902c9bc902b60d777bb0c42aea249401f5ca0a9f02e845284de72f0c80968f5/G-Wang/pytorch-pretrained-BERT
og:image:altPyTorch version of Google AI's BERT model with script to load Google's pre-trained models - G-Wang/pytorch-pretrained-BERT
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None52c76df668885aaff23b50bdca1fa1ea44ac9c1553e888ebc70ff1e4daa4625b
turbo-cache-controlno-cache
go-importgithub.com/G-Wang/pytorch-pretrained-BERT git https://github.com/G-Wang/pytorch-pretrained-BERT.git
octolytics-dimension-user_id14854468
octolytics-dimension-user_loginG-Wang
octolytics-dimension-repository_id156260029
octolytics-dimension-repository_nwoG-Wang/pytorch-pretrained-BERT
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forktrue
octolytics-dimension-repository_parent_id155220641
octolytics-dimension-repository_parent_nwohuggingface/transformers
octolytics-dimension-repository_network_root_id155220641
octolytics-dimension-repository_network_root_nwohuggingface/transformers
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release309153364422b3c499922d1a2a6404910a58ed8e
ui-targetcanary-1
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/G-Wang/pytorch-pretrained-BERT#start-of-content
https://github.com/
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FG-Wang%2Fpytorch-pretrained-BERT
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub Copilot appDirect agents from issue to mergehttps://github.com/features/ai/github-app
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
Code QualityEnforce quality at mergehttps://github.com/features/code-quality
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
View all resourceshttps://github.com/resources
GitHub SponsorsFund open source developershttps://github.com/open-source/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/open-source/accelerator
GitHub Starshttps://stars.github.com
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FG-Wang%2Fpytorch-pretrained-BERT
Sign up https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=G-Wang%2Fpytorch-pretrained-BERT
Reloadhttps://github.com/G-Wang/pytorch-pretrained-BERT
Reloadhttps://github.com/G-Wang/pytorch-pretrained-BERT
Reloadhttps://github.com/G-Wang/pytorch-pretrained-BERT
G-Wang https://github.com/G-Wang
pytorch-pretrained-BERThttps://github.com/G-Wang/pytorch-pretrained-BERT
huggingface/transformershttps://github.com/huggingface/transformers
Notifications https://github.com/login?return_to=%2FG-Wang%2Fpytorch-pretrained-BERT
Fork 1 https://github.com/login?return_to=%2FG-Wang%2Fpytorch-pretrained-BERT
Star 0 https://github.com/login?return_to=%2FG-Wang%2Fpytorch-pretrained-BERT
Code https://github.com/G-Wang/pytorch-pretrained-BERT
Pull requests 0 https://github.com/G-Wang/pytorch-pretrained-BERT/pulls
Actions https://github.com/G-Wang/pytorch-pretrained-BERT/actions
Projects https://github.com/G-Wang/pytorch-pretrained-BERT/projects
Wiki https://github.com/G-Wang/pytorch-pretrained-BERT/wiki
Security and quality 0 https://github.com/G-Wang/pytorch-pretrained-BERT/security
Insights https://github.com/G-Wang/pytorch-pretrained-BERT/pulse
Code https://github.com/G-Wang/pytorch-pretrained-BERT
Pull requests https://github.com/G-Wang/pytorch-pretrained-BERT/pulls
Actions https://github.com/G-Wang/pytorch-pretrained-BERT/actions
Projects https://github.com/G-Wang/pytorch-pretrained-BERT/projects
Wiki https://github.com/G-Wang/pytorch-pretrained-BERT/wiki
Security and quality https://github.com/G-Wang/pytorch-pretrained-BERT/security
Insights https://github.com/G-Wang/pytorch-pretrained-BERT/pulse
https://github.com/G-Wang/pytorch-pretrained-BERT
Brancheshttps://github.com/G-Wang/pytorch-pretrained-BERT/branches
Tagshttps://github.com/G-Wang/pytorch-pretrained-BERT/tags
https://github.com/G-Wang/pytorch-pretrained-BERT/branches
https://github.com/G-Wang/pytorch-pretrained-BERT/tags
139 Commitshttps://github.com/G-Wang/pytorch-pretrained-BERT/commits/master/
https://github.com/G-Wang/pytorch-pretrained-BERT/commits/master/
notebookshttps://github.com/G-Wang/pytorch-pretrained-BERT/tree/master/notebooks
notebookshttps://github.com/G-Wang/pytorch-pretrained-BERT/tree/master/notebooks
sampleshttps://github.com/G-Wang/pytorch-pretrained-BERT/tree/master/samples
sampleshttps://github.com/G-Wang/pytorch-pretrained-BERT/tree/master/samples
testshttps://github.com/G-Wang/pytorch-pretrained-BERT/tree/master/tests
testshttps://github.com/G-Wang/pytorch-pretrained-BERT/tree/master/tests
.gitignorehttps://github.com/G-Wang/pytorch-pretrained-BERT/blob/master/.gitignore
.gitignorehttps://github.com/G-Wang/pytorch-pretrained-BERT/blob/master/.gitignore
CONTRIBUTING.mdhttps://github.com/G-Wang/pytorch-pretrained-BERT/blob/master/CONTRIBUTING.md
CONTRIBUTING.mdhttps://github.com/G-Wang/pytorch-pretrained-BERT/blob/master/CONTRIBUTING.md
LICENSEhttps://github.com/G-Wang/pytorch-pretrained-BERT/blob/master/LICENSE
LICENSEhttps://github.com/G-Wang/pytorch-pretrained-BERT/blob/master/LICENSE
README.mdhttps://github.com/G-Wang/pytorch-pretrained-BERT/blob/master/README.md
README.mdhttps://github.com/G-Wang/pytorch-pretrained-BERT/blob/master/README.md
__init__.pyhttps://github.com/G-Wang/pytorch-pretrained-BERT/blob/master/__init__.py
__init__.pyhttps://github.com/G-Wang/pytorch-pretrained-BERT/blob/master/__init__.py
convert_tf_checkpoint_to_pytorch.pyhttps://github.com/G-Wang/pytorch-pretrained-BERT/blob/master/convert_tf_checkpoint_to_pytorch.py
convert_tf_checkpoint_to_pytorch.pyhttps://github.com/G-Wang/pytorch-pretrained-BERT/blob/master/convert_tf_checkpoint_to_pytorch.py
extract_features.pyhttps://github.com/G-Wang/pytorch-pretrained-BERT/blob/master/extract_features.py
extract_features.pyhttps://github.com/G-Wang/pytorch-pretrained-BERT/blob/master/extract_features.py
modeling.pyhttps://github.com/G-Wang/pytorch-pretrained-BERT/blob/master/modeling.py
modeling.pyhttps://github.com/G-Wang/pytorch-pretrained-BERT/blob/master/modeling.py
optimization.pyhttps://github.com/G-Wang/pytorch-pretrained-BERT/blob/master/optimization.py
optimization.pyhttps://github.com/G-Wang/pytorch-pretrained-BERT/blob/master/optimization.py
requirements.txthttps://github.com/G-Wang/pytorch-pretrained-BERT/blob/master/requirements.txt
requirements.txthttps://github.com/G-Wang/pytorch-pretrained-BERT/blob/master/requirements.txt
run_classifier.pyhttps://github.com/G-Wang/pytorch-pretrained-BERT/blob/master/run_classifier.py
run_classifier.pyhttps://github.com/G-Wang/pytorch-pretrained-BERT/blob/master/run_classifier.py
run_squad.pyhttps://github.com/G-Wang/pytorch-pretrained-BERT/blob/master/run_squad.py
run_squad.pyhttps://github.com/G-Wang/pytorch-pretrained-BERT/blob/master/run_squad.py
tokenization.pyhttps://github.com/G-Wang/pytorch-pretrained-BERT/blob/master/tokenization.py
tokenization.pyhttps://github.com/G-Wang/pytorch-pretrained-BERT/blob/master/tokenization.py
READMEhttps://github.com/G-Wang/pytorch-pretrained-BERT
Contributinghttps://github.com/G-Wang/pytorch-pretrained-BERT
Apache-2.0 licensehttps://github.com/G-Wang/pytorch-pretrained-BERT
https://github.com/G-Wang/pytorch-pretrained-BERT#pytorch-implementation-of-google-ais-bert-model-with-a-script-to-load-googles-pre-trained-models
https://github.com/G-Wang/pytorch-pretrained-BERT#introduction
Google's TensorFlow repository for the BERT modelhttps://github.com/google-research/bert
BERT: Pre-training of Deep Bidirectional Transformers for Language Understandinghttps://arxiv.org/abs/1810.04805
Google's pre-trained modelshttps://github.com/google-research/bert
the Multilingual and Chinese modelshttps://github.com/google-research/bert/blob/master/multilingual.md
Google's pre-trained modelshttps://github.com/google-research/bert#pre-trained-models
https://github.com/G-Wang/pytorch-pretrained-BERT#loading-a-tensorflow-checkpoint-eg-googles-pre-trained-models
the pre-trained models released by Googlehttps://github.com/google-research/bert#pre-trained-models
convert_tf_checkpoint_to_pytorch.pyhttps://github.com/G-Wang/pytorch-pretrained-BERT/blob/master/convert_tf_checkpoint_to_pytorch.py
herehttps://github.com/google-research/bert#pre-trained-models
https://github.com/G-Wang/pytorch-pretrained-BERT#pytorch-models-for-bert
modeling.pyhttps://github.com/G-Wang/pytorch-pretrained-BERT/blob/master/modeling.py
https://github.com/G-Wang/pytorch-pretrained-BERT#1-bertmodel
https://github.com/G-Wang/pytorch-pretrained-BERT#2-bertforsequenceclassification
https://github.com/G-Wang/pytorch-pretrained-BERT#3-bertforquestionanswering
https://github.com/G-Wang/pytorch-pretrained-BERT#installation-requirements-test
test folderhttps://github.com/G-Wang/pytorch-pretrained-BERT/blob/master/test
https://github.com/G-Wang/pytorch-pretrained-BERT#training-on-large-batches-gradient-accumulation-multi-gpu-and-distributed-training
the tips on training large batches in PyTorchhttps://medium.com/huggingface/training-larger-batches-practical-tips-on-1-gpu-multi-gpu-distributed-setups-ec88c3e51255
https://github.com/G-Wang/pytorch-pretrained-BERT#tpu-support-and-pretraining-scripts
official announcementhttps://cloud.google.com/blog/products/ai-machine-learning/introducing-pytorch-across-google-cloud
create_pretraining_data.pyhttps://github.com/google-research/bert/blob/master/create_pretraining_data.py
run_pretraining.pyhttps://github.com/google-research/bert/blob/master/run_pretraining.py
herehttps://github.com/google-research/bert#pre-training-with-bert
https://github.com/G-Wang/pytorch-pretrained-BERT#comparing-the-pytorch-model-and-the-tensorflow-model-predictions
two Jupyter Notebookshttps://github.com/huggingface/pytorch-pretrained-BERT/tree/master/notebooks
Comparing TF and PT models.ipynbhttps://github.com/huggingface/pytorch-pretrained-BERT/blob/master/notebooks/Comparing%20TF%20and%20PT%20models.ipynb
Comparing TF and PT models SQuAD predictions.ipynbhttps://github.com/huggingface/pytorch-pretrained-BERT/blob/master/notebooks/Comparing%20TF%20and%20PT%20models%20SQuAD%20predictions.ipynb
https://github.com/G-Wang/pytorch-pretrained-BERT#fine-tuning-with-bert-running-the-examples
the original implementationhttps://github.com/google-research/bert/
GLUE datahttps://gluebenchmark.com/tasks
this scripthttps://gist.github.com/W4ngatang/60c2bdb54d156a41194446737ce03e2e
the original implementation hyper-parametershttps://github.com/google-research/bert#squad
train-v1.1.jsonhttps://rajpurkar.github.io/SQuAD-explorer/dataset/train-v1.1.json
dev-v1.1.jsonhttps://rajpurkar.github.io/SQuAD-explorer/dataset/dev-v1.1.json
evaluate-v1.1.pyhttps://github.com/allenai/bi-att-flow/blob/master/squad/evaluate-v1.1.py
Readmehttps://github.com/G-Wang/pytorch-pretrained-BERT#readme-ov-file
Apache-2.0 licensehttps://github.com/G-Wang/pytorch-pretrained-BERT#Apache-2.0-1-ov-file
Contributinghttps://github.com/G-Wang/pytorch-pretrained-BERT#contributing-ov-file
Activityhttps://github.com/G-Wang/pytorch-pretrained-BERT/activity
0 starshttps://github.com/G-Wang/pytorch-pretrained-BERT/stargazers
1 watchinghttps://github.com/G-Wang/pytorch-pretrained-BERT/watchers
1 forkhttps://github.com/G-Wang/pytorch-pretrained-BERT/forks
Report repositoryhttps://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2FG-Wang%2Fpytorch-pretrained-BERT&report=G-Wang+%28user%29
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.