René's URL Explorer Experiment

Title: byte-pair-encoding · GitHub Topics · GitHub

Open Graph Title: Build software better, together

X Title: GitHub

Description: GitHub is where people build software. More than 150 million people use GitHub to discover, fork, and contribute to over 420 million projects.

Open Graph Description: GitHub is where people build software. More than 150 million people use GitHub to discover, fork, and contribute to over 420 million projects.

X Description: GitHub is where people build software. More than 150 million people use GitHub to discover, fork, and contribute to over 420 million projects.

Opengraph URL: https://github.com

X: github

direct link

Domain: patch-diff.githubusercontent.com

route-pattern	/topics/:topic_name(.:format)
route-controller	topics
route-action	show
fetch-nonce	v2:6964ca75-c818-8784-097d-69f4f31b55c9
current-catalog-service-hash	82c569b93da5c18ed649ebd4c2c79437db4611a6a1373e805a3cb001c64130b7
request-id	CADC:288A6B:46B2B6:5D2A97:698D413E
html-safe-nonce	7e4e6546b1b4dddb5086a17ff84baf6649a3f90bf62958a462172b22b3598aa6
visitor-payload	eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJDQURDOjI4OEE2Qjo0NkIyQjY6NUQyQTk3OjY5OEQ0MTNFIiwidmlzaXRvcl9pZCI6IjU4MDI1MjM5NTk5NTA2NTU4MDYiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmac	c731f793a34aaefaa31e6cfebb4385c01775641b446d78e7b0b6b39ada507c65
github-keyboard-shortcuts	copilot
google-site-verification	Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-url	https://collector.github.com/github/collect
fb:app_id	1401488693436528
apple-itunes-app	app-id=1477376905, app-argument=https://github.com/topics/byte-pair-encoding
og:site_name	GitHub
og:image	https://github.githubassets.com/assets/github-octocat-13c86b8b336d.png
og:image:type	image/png
og:image:width	1200
og:image:height	620
twitter:site:id	13334762
twitter:creator	github
twitter:creator:id	13334762
twitter:card	summary_large_image
twitter:image	https://github.githubassets.com/assets/github-logo-55c5b9a1fe52.png
twitter:image:width	1200
twitter:image:height	1200
hostname	github.com
expected-hostname	github.com
None	c0818105fa276287e9369cfdefa0a0fa7953719791ceff9b94d69623c0a4fe8a
turbo-cache-control	no-preview
turbo-body-classes	logged-out env-production page-responsive
disable-turbo	false
browser-stats-url	https://api.github.com/_private/browser/stats
browser-errors-url	https://api.github.com/_private/browser/errors
release	bc912d4349851e5f32c76bbb213754e40947d7a6
ui-target	full
theme-color	#1e2327
color-scheme	light dark

Links:

Skip to content	https://patch-diff.githubusercontent.com/topics/byte-pair-encoding#start-of-content
	https://patch-diff.githubusercontent.com/
Sign in	https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Ftopics%2Fbyte-pair-encoding
GitHub CopilotWrite better code with AI	https://github.com/features/copilot
GitHub SparkBuild and deploy intelligent apps	https://github.com/features/spark
GitHub ModelsManage and compare prompts	https://github.com/features/models
MCP RegistryNewIntegrate external tools	https://github.com/mcp
ActionsAutomate any workflow	https://github.com/features/actions
CodespacesInstant dev environments	https://github.com/features/codespaces
IssuesPlan and track work	https://github.com/features/issues
Code ReviewManage code changes	https://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilities	https://github.com/security/advanced-security
Code securitySecure your code as you build	https://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they start	https://github.com/security/advanced-security/secret-protection
Why GitHub	https://github.com/why-github
Documentation	https://docs.github.com
Blog	https://github.blog
Changelog	https://github.blog/changelog
Marketplace	https://github.com/marketplace
View all features	https://github.com/features
Enterprises	https://github.com/enterprise
Small and medium teams	https://github.com/team
Startups	https://github.com/enterprise/startups
Nonprofits	https://github.com/solutions/industry/nonprofits
App Modernization	https://github.com/solutions/use-case/app-modernization
DevSecOps	https://github.com/solutions/use-case/devsecops
DevOps	https://github.com/solutions/use-case/devops
CI/CD	https://github.com/solutions/use-case/ci-cd
View all use cases	https://github.com/solutions/use-case
Healthcare	https://github.com/solutions/industry/healthcare
Financial services	https://github.com/solutions/industry/financial-services
Manufacturing	https://github.com/solutions/industry/manufacturing
Government	https://github.com/solutions/industry/government
View all industries	https://github.com/solutions/industry
View all solutions	https://github.com/solutions
AI	https://github.com/resources/articles?topic=ai
Software Development	https://github.com/resources/articles?topic=software-development
DevOps	https://github.com/resources/articles?topic=devops
Security	https://github.com/resources/articles?topic=security
View all topics	https://github.com/resources/articles
Customer stories	https://github.com/customer-stories
Events & webinars	https://github.com/resources/events
Ebooks & reports	https://github.com/resources/whitepapers
Business insights	https://github.com/solutions/executive-insights
GitHub Skills	https://skills.github.com
Documentation	https://docs.github.com
Customer support	https://support.github.com
Community forum	https://github.com/orgs/community/discussions
Trust center	https://github.com/trust-center
Partners	https://github.com/partners
GitHub SponsorsFund open source developers	https://github.com/sponsors
Security Lab	https://securitylab.github.com
Maintainer Community	https://maintainers.github.com
Accelerator	https://github.com/accelerator
Archive Program	https://archiveprogram.github.com
Topics	https://github.com/topics
Trending	https://github.com/trending
Collections	https://github.com/collections
Enterprise platformAI-powered developer platform	https://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security features	https://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI features	https://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 support	https://github.com/premium-support
Pricing	https://github.com/pricing
Search syntax tips	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentation	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in	https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Ftopics%2Fbyte-pair-encoding
Sign up	https://patch-diff.githubusercontent.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2Ftopics%2Fbyte-pair-encoding&source=header
Reload	https://patch-diff.githubusercontent.com/topics/byte-pair-encoding
Reload	https://patch-diff.githubusercontent.com/topics/byte-pair-encoding
Reload	https://patch-diff.githubusercontent.com/topics/byte-pair-encoding
Explore	https://patch-diff.githubusercontent.com/explore
Topics	https://patch-diff.githubusercontent.com/topics
Trending	https://patch-diff.githubusercontent.com/trending
Collections	https://patch-diff.githubusercontent.com/collections
Events	https://patch-diff.githubusercontent.com/events
GitHub Sponsors	https://patch-diff.githubusercontent.com/sponsors/explore
Star	https://patch-diff.githubusercontent.com/login?return_to=%2Ftopic.byte-pair-encoding
All 66	https://github.com/topics/byte-pair-encoding
Python 32	https://github.com/topics/byte-pair-encoding?l=python
Jupyter Notebook 11	https://github.com/topics/byte-pair-encoding?l=jupyter+notebook
C++ 9	https://github.com/topics/byte-pair-encoding?l=c%2B%2B
Rust 4	https://github.com/topics/byte-pair-encoding?l=rust
Go 2	https://github.com/topics/byte-pair-encoding?l=go
Elixir 1	https://github.com/topics/byte-pair-encoding?l=elixir
HTML 1	https://github.com/topics/byte-pair-encoding?l=html
Haskell 1	https://github.com/topics/byte-pair-encoding?l=haskell
JavaScript 1	https://github.com/topics/byte-pair-encoding?l=javascript
Kotlin 1	https://github.com/topics/byte-pair-encoding?l=kotlin
Most stars	https://patch-diff.githubusercontent.com/topics/byte-pair-encoding?o=desc&s=stars
Fewest stars	https://patch-diff.githubusercontent.com/topics/byte-pair-encoding?o=asc&s=stars
Most forks	https://patch-diff.githubusercontent.com/topics/byte-pair-encoding?o=desc&s=forks
Fewest forks	https://patch-diff.githubusercontent.com/topics/byte-pair-encoding?o=asc&s=forks
Recently updated	https://patch-diff.githubusercontent.com/topics/byte-pair-encoding?o=desc&s=updated
Least recently updated	https://patch-diff.githubusercontent.com/topics/byte-pair-encoding?o=asc&s=updated
samber	https://patch-diff.githubusercontent.com/samber
go-gpt-3-encoder	https://patch-diff.githubusercontent.com/samber/go-gpt-3-encoder
Sponsor	https://patch-diff.githubusercontent.com/sponsors/samber
Star 83	https://patch-diff.githubusercontent.com/login?return_to=%2Fsamber%2Fgo-gpt-3-encoder
Code	https://patch-diff.githubusercontent.com/samber/go-gpt-3-encoder
Issues	https://patch-diff.githubusercontent.com/samber/go-gpt-3-encoder/issues
Pull requests	https://patch-diff.githubusercontent.com/samber/go-gpt-3-encoder/pulls
go	https://patch-diff.githubusercontent.com/topics/go
encoder	https://patch-diff.githubusercontent.com/topics/encoder
decoder	https://patch-diff.githubusercontent.com/topics/decoder
tokenizer	https://patch-diff.githubusercontent.com/topics/tokenizer
transformer	https://patch-diff.githubusercontent.com/topics/transformer
openai	https://patch-diff.githubusercontent.com/topics/openai
token	https://patch-diff.githubusercontent.com/topics/token
codex	https://patch-diff.githubusercontent.com/topics/codex
bpe	https://patch-diff.githubusercontent.com/topics/bpe
byte-pair-encoding	https://patch-diff.githubusercontent.com/topics/byte-pair-encoding
gpt-2	https://patch-diff.githubusercontent.com/topics/gpt-2
gpt-3	https://patch-diff.githubusercontent.com/topics/gpt-3
aallam	https://patch-diff.githubusercontent.com/aallam
ktoken	https://patch-diff.githubusercontent.com/aallam/ktoken
Star 41	https://patch-diff.githubusercontent.com/login?return_to=%2Faallam%2Fktoken
Code	https://patch-diff.githubusercontent.com/aallam/ktoken
Issues	https://patch-diff.githubusercontent.com/aallam/ktoken/issues
Pull requests	https://patch-diff.githubusercontent.com/aallam/ktoken/pulls
kotlin	https://patch-diff.githubusercontent.com/topics/kotlin
tokenizer	https://patch-diff.githubusercontent.com/topics/tokenizer
openai	https://patch-diff.githubusercontent.com/topics/openai
gpt	https://patch-diff.githubusercontent.com/topics/gpt
bpe	https://patch-diff.githubusercontent.com/topics/bpe
byte-pair-encoding	https://patch-diff.githubusercontent.com/topics/byte-pair-encoding
tiktoken	https://patch-diff.githubusercontent.com/topics/tiktoken
binary-p	https://patch-diff.githubusercontent.com/topics/binary-p
gweidart	https://patch-diff.githubusercontent.com/gweidart
rs-bpe	https://patch-diff.githubusercontent.com/gweidart/rs-bpe
Star 34	https://patch-diff.githubusercontent.com/login?return_to=%2Fgweidart%2Frs-bpe
Code	https://patch-diff.githubusercontent.com/gweidart/rs-bpe
Issues	https://patch-diff.githubusercontent.com/gweidart/rs-bpe/issues
Pull requests	https://patch-diff.githubusercontent.com/gweidart/rs-bpe/pulls
python	https://patch-diff.githubusercontent.com/topics/python
rust	https://patch-diff.githubusercontent.com/topics/rust
openai	https://patch-diff.githubusercontent.com/topics/openai
pypi-package	https://patch-diff.githubusercontent.com/topics/pypi-package
bpe	https://patch-diff.githubusercontent.com/topics/bpe
byte-pair-encoding	https://patch-diff.githubusercontent.com/topics/byte-pair-encoding
huggingface	https://patch-diff.githubusercontent.com/topics/huggingface
tokenizers	https://patch-diff.githubusercontent.com/topics/tokenizers
llm	https://patch-diff.githubusercontent.com/topics/llm
tiktoken	https://patch-diff.githubusercontent.com/topics/tiktoken
bpe-tokenizer	https://patch-diff.githubusercontent.com/topics/bpe-tokenizer
byte-pair-tokenizer	https://patch-diff.githubusercontent.com/topics/byte-pair-tokenizer
ankane	https://patch-diff.githubusercontent.com/ankane
youtokentome-ruby	https://patch-diff.githubusercontent.com/ankane/youtokentome-ruby
Star 21	https://patch-diff.githubusercontent.com/login?return_to=%2Fankane%2Fyoutokentome-ruby
Code	https://patch-diff.githubusercontent.com/ankane/youtokentome-ruby
Issues	https://patch-diff.githubusercontent.com/ankane/youtokentome-ruby/issues
Pull requests	https://patch-diff.githubusercontent.com/ankane/youtokentome-ruby/pulls
unsupervised-learning	https://patch-diff.githubusercontent.com/topics/unsupervised-learning
word-segmentation	https://patch-diff.githubusercontent.com/topics/word-segmentation
tokenization	https://patch-diff.githubusercontent.com/topics/tokenization
npl	https://patch-diff.githubusercontent.com/topics/npl
bpe	https://patch-diff.githubusercontent.com/topics/bpe
byte-pair-encoding	https://patch-diff.githubusercontent.com/topics/byte-pair-encoding
DolbyUUU	https://patch-diff.githubusercontent.com/DolbyUUU
byte_pair_encoding_BPE_subword_tokenization_implementation_python	https://patch-diff.githubusercontent.com/DolbyUUU/byte_pair_encoding_BPE_subword_tokenization_implementation_python
Star 18	https://patch-diff.githubusercontent.com/login?return_to=%2FDolbyUUU%2Fbyte_pair_encoding_BPE_subword_tokenization_implementation_python
Code	https://patch-diff.githubusercontent.com/DolbyUUU/byte_pair_encoding_BPE_subword_tokenization_implementation_python
Issues	https://patch-diff.githubusercontent.com/DolbyUUU/byte_pair_encoding_BPE_subword_tokenization_implementation_python/issues
Pull requests	https://patch-diff.githubusercontent.com/DolbyUUU/byte_pair_encoding_BPE_subword_tokenization_implementation_python/pulls
python	https://patch-diff.githubusercontent.com/topics/python
nlp	https://patch-diff.githubusercontent.com/topics/nlp
natural-language-processing	https://patch-diff.githubusercontent.com/topics/natural-language-processing
tokenizer	https://patch-diff.githubusercontent.com/topics/tokenizer
data-preprocessing	https://patch-diff.githubusercontent.com/topics/data-preprocessing
data-cleaning	https://patch-diff.githubusercontent.com/topics/data-cleaning
bpe	https://patch-diff.githubusercontent.com/topics/bpe
byte-pair-encoding	https://patch-diff.githubusercontent.com/topics/byte-pair-encoding
subword-tokenization	https://patch-diff.githubusercontent.com/topics/subword-tokenization
BobMcDear	https://patch-diff.githubusercontent.com/BobMcDear
minbpe-hs	https://patch-diff.githubusercontent.com/BobMcDear/minbpe-hs
Star 17	https://patch-diff.githubusercontent.com/login?return_to=%2FBobMcDear%2Fminbpe-hs
Code	https://patch-diff.githubusercontent.com/BobMcDear/minbpe-hs
Issues	https://patch-diff.githubusercontent.com/BobMcDear/minbpe-hs/issues
Pull requests	https://patch-diff.githubusercontent.com/BobMcDear/minbpe-hs/pulls
haskell	https://patch-diff.githubusercontent.com/topics/haskell
tokenizer	https://patch-diff.githubusercontent.com/topics/tokenizer
bpe	https://patch-diff.githubusercontent.com/topics/bpe
byte-pair-encoding	https://patch-diff.githubusercontent.com/topics/byte-pair-encoding
llm	https://patch-diff.githubusercontent.com/topics/llm
bnosac	https://patch-diff.githubusercontent.com/bnosac
tokenizers.bpe	https://patch-diff.githubusercontent.com/bnosac/tokenizers.bpe
Star 16	https://patch-diff.githubusercontent.com/login?return_to=%2Fbnosac%2Ftokenizers.bpe
Code	https://patch-diff.githubusercontent.com/bnosac/tokenizers.bpe
Issues	https://patch-diff.githubusercontent.com/bnosac/tokenizers.bpe/issues
Pull requests	https://patch-diff.githubusercontent.com/bnosac/tokenizers.bpe/pulls
text-mining	https://patch-diff.githubusercontent.com/topics/text-mining
tokenization	https://patch-diff.githubusercontent.com/topics/tokenization
bpe	https://patch-diff.githubusercontent.com/topics/bpe
byte-pair-encoding	https://patch-diff.githubusercontent.com/topics/byte-pair-encoding
akhvorov	https://patch-diff.githubusercontent.com/akhvorov
vgram	https://patch-diff.githubusercontent.com/akhvorov/vgram
Star 7	https://patch-diff.githubusercontent.com/login?return_to=%2Fakhvorov%2Fvgram
Code	https://patch-diff.githubusercontent.com/akhvorov/vgram
Issues	https://patch-diff.githubusercontent.com/akhvorov/vgram/issues
Pull requests	https://patch-diff.githubusercontent.com/akhvorov/vgram/pulls
natural-language-processing	https://patch-diff.githubusercontent.com/topics/natural-language-processing
text-classification	https://patch-diff.githubusercontent.com/topics/text-classification
feature-extraction	https://patch-diff.githubusercontent.com/topics/feature-extraction
word-segmentation	https://patch-diff.githubusercontent.com/topics/word-segmentation
sequential-data	https://patch-diff.githubusercontent.com/topics/sequential-data
vgram	https://patch-diff.githubusercontent.com/topics/vgram
byte-pair-encoding	https://patch-diff.githubusercontent.com/topics/byte-pair-encoding
	https://patch-diff.githubusercontent.com/theskyinflames/word2png
theskyinflames	https://patch-diff.githubusercontent.com/theskyinflames
word2png	https://patch-diff.githubusercontent.com/theskyinflames/word2png
Star 7	https://patch-diff.githubusercontent.com/login?return_to=%2Ftheskyinflames%2Fword2png
Code	https://patch-diff.githubusercontent.com/theskyinflames/word2png
Issues	https://patch-diff.githubusercontent.com/theskyinflames/word2png/issues
Pull requests	https://patch-diff.githubusercontent.com/theskyinflames/word2png/pulls
go	https://patch-diff.githubusercontent.com/topics/go
golang	https://patch-diff.githubusercontent.com/topics/golang
encryption	https://patch-diff.githubusercontent.com/topics/encryption
tdd	https://patch-diff.githubusercontent.com/topics/tdd
clean-code	https://patch-diff.githubusercontent.com/topics/clean-code
wasm	https://patch-diff.githubusercontent.com/topics/wasm
image-processing	https://patch-diff.githubusercontent.com/topics/image-processing
bit-manipulation	https://patch-diff.githubusercontent.com/topics/bit-manipulation
aes-256	https://patch-diff.githubusercontent.com/topics/aes-256
hexagonal-architecture	https://patch-diff.githubusercontent.com/topics/hexagonal-architecture
byte-array	https://patch-diff.githubusercontent.com/topics/byte-array
bip39	https://patch-diff.githubusercontent.com/topics/bip39
png-decoder	https://patch-diff.githubusercontent.com/topics/png-decoder
solid-principles	https://patch-diff.githubusercontent.com/topics/solid-principles
encryption-decryption	https://patch-diff.githubusercontent.com/topics/encryption-decryption
cold-wallet	https://patch-diff.githubusercontent.com/topics/cold-wallet
golang-wasm	https://patch-diff.githubusercontent.com/topics/golang-wasm
byte-pair-encoding	https://patch-diff.githubusercontent.com/topics/byte-pair-encoding
pterm	https://patch-diff.githubusercontent.com/topics/pterm
go-aes-256	https://patch-diff.githubusercontent.com/topics/go-aes-256
Ascend-Research	https://patch-diff.githubusercontent.com/Ascend-Research
AutoGO	https://patch-diff.githubusercontent.com/Ascend-Research/AutoGO
Star 6	https://patch-diff.githubusercontent.com/login?return_to=%2FAscend-Research%2FAutoGO
Code	https://patch-diff.githubusercontent.com/Ascend-Research/AutoGO
Issues	https://patch-diff.githubusercontent.com/Ascend-Research/AutoGO/issues
Pull requests	https://patch-diff.githubusercontent.com/Ascend-Research/AutoGO/pulls
deep-neural-networks	https://patch-diff.githubusercontent.com/topics/deep-neural-networks
deep-learning	https://patch-diff.githubusercontent.com/topics/deep-learning
tensorflow	https://patch-diff.githubusercontent.com/topics/tensorflow
tokenizer	https://patch-diff.githubusercontent.com/topics/tokenizer
pytorch	https://patch-diff.githubusercontent.com/topics/pytorch
classification	https://patch-diff.githubusercontent.com/topics/classification
human-pose-estimation	https://patch-diff.githubusercontent.com/topics/human-pose-estimation
super-resolution	https://patch-diff.githubusercontent.com/topics/super-resolution
semantic-segmentation	https://patch-diff.githubusercontent.com/topics/semantic-segmentation
neural-architecture-search	https://patch-diff.githubusercontent.com/topics/neural-architecture-search
pytorch-geometric	https://patch-diff.githubusercontent.com/topics/pytorch-geometric
byte-pair-encoding	https://patch-diff.githubusercontent.com/topics/byte-pair-encoding
neurips-2023	https://patch-diff.githubusercontent.com/topics/neurips-2023
jmaczan	https://patch-diff.githubusercontent.com/jmaczan
bpe-tokenizer	https://patch-diff.githubusercontent.com/jmaczan/bpe-tokenizer
Star 6	https://patch-diff.githubusercontent.com/login?return_to=%2Fjmaczan%2Fbpe-tokenizer
Code	https://patch-diff.githubusercontent.com/jmaczan/bpe-tokenizer
Issues	https://patch-diff.githubusercontent.com/jmaczan/bpe-tokenizer/issues
Pull requests	https://patch-diff.githubusercontent.com/jmaczan/bpe-tokenizer/pulls
python	https://patch-diff.githubusercontent.com/topics/python
machine-learning	https://patch-diff.githubusercontent.com/topics/machine-learning
deep-learning	https://patch-diff.githubusercontent.com/topics/deep-learning
tokenizer	https://patch-diff.githubusercontent.com/topics/tokenizer
chunking	https://patch-diff.githubusercontent.com/topics/chunking
from-scratch	https://patch-diff.githubusercontent.com/topics/from-scratch
bpe	https://patch-diff.githubusercontent.com/topics/bpe
byte-pair-encoding	https://patch-diff.githubusercontent.com/topics/byte-pair-encoding
large-language-models	https://patch-diff.githubusercontent.com/topics/large-language-models
llm	https://patch-diff.githubusercontent.com/topics/llm
bpe-tokenizer	https://patch-diff.githubusercontent.com/topics/bpe-tokenizer
AndreyKolomiets	https://patch-diff.githubusercontent.com/AndreyKolomiets
News_Headline_Generation	https://patch-diff.githubusercontent.com/AndreyKolomiets/News_Headline_Generation
Star 5	https://patch-diff.githubusercontent.com/login?return_to=%2FAndreyKolomiets%2FNews_Headline_Generation
Code	https://patch-diff.githubusercontent.com/AndreyKolomiets/News_Headline_Generation
Issues	https://patch-diff.githubusercontent.com/AndreyKolomiets/News_Headline_Generation/issues
Pull requests	https://patch-diff.githubusercontent.com/AndreyKolomiets/News_Headline_Generation/pulls
pytorch	https://patch-diff.githubusercontent.com/topics/pytorch
summarization	https://patch-diff.githubusercontent.com/topics/summarization
reinforce	https://patch-diff.githubusercontent.com/topics/reinforce
abstractive-summarization	https://patch-diff.githubusercontent.com/topics/abstractive-summarization
pointer-generator	https://patch-diff.githubusercontent.com/topics/pointer-generator
byte-pair-encoding	https://patch-diff.githubusercontent.com/topics/byte-pair-encoding
summatization	https://patch-diff.githubusercontent.com/topics/summatization
SeonbeomKim	https://patch-diff.githubusercontent.com/SeonbeomKim
Python-Byte_Pair_Encoding	https://patch-diff.githubusercontent.com/SeonbeomKim/Python-Byte_Pair_Encoding
Star 5	https://patch-diff.githubusercontent.com/login?return_to=%2FSeonbeomKim%2FPython-Byte_Pair_Encoding
Code	https://patch-diff.githubusercontent.com/SeonbeomKim/Python-Byte_Pair_Encoding
Issues	https://patch-diff.githubusercontent.com/SeonbeomKim/Python-Byte_Pair_Encoding/issues
Pull requests	https://patch-diff.githubusercontent.com/SeonbeomKim/Python-Byte_Pair_Encoding/pulls
multiprocessing	https://patch-diff.githubusercontent.com/topics/multiprocessing
bpe	https://patch-diff.githubusercontent.com/topics/bpe
byte-pair-encoding	https://patch-diff.githubusercontent.com/topics/byte-pair-encoding
wordpiece	https://patch-diff.githubusercontent.com/topics/wordpiece
zouharvi	https://patch-diff.githubusercontent.com/zouharvi
tokenization-principle	https://patch-diff.githubusercontent.com/zouharvi/tokenization-principle
Star 5	https://patch-diff.githubusercontent.com/login?return_to=%2Fzouharvi%2Ftokenization-principle
Code	https://patch-diff.githubusercontent.com/zouharvi/tokenization-principle
Issues	https://patch-diff.githubusercontent.com/zouharvi/tokenization-principle/issues
Pull requests	https://patch-diff.githubusercontent.com/zouharvi/tokenization-principle/pulls
tokenization	https://patch-diff.githubusercontent.com/topics/tokenization
bpe	https://patch-diff.githubusercontent.com/topics/bpe
byte-pair-encoding	https://patch-diff.githubusercontent.com/topics/byte-pair-encoding
rraghavkaushik	https://patch-diff.githubusercontent.com/rraghavkaushik
smol-bpe-tokenizer	https://patch-diff.githubusercontent.com/rraghavkaushik/smol-bpe-tokenizer
Star 4	https://patch-diff.githubusercontent.com/login?return_to=%2Frraghavkaushik%2Fsmol-bpe-tokenizer
Code	https://patch-diff.githubusercontent.com/rraghavkaushik/smol-bpe-tokenizer
Issues	https://patch-diff.githubusercontent.com/rraghavkaushik/smol-bpe-tokenizer/issues
Pull requests	https://patch-diff.githubusercontent.com/rraghavkaushik/smol-bpe-tokenizer/pulls
natural-language-processing	https://patch-diff.githubusercontent.com/topics/natural-language-processing
tokenizer	https://patch-diff.githubusercontent.com/topics/tokenizer
bpe	https://patch-diff.githubusercontent.com/topics/bpe
byte-pair-encoding	https://patch-diff.githubusercontent.com/topics/byte-pair-encoding
bytepairencoding	https://patch-diff.githubusercontent.com/topics/bytepairencoding
llms	https://patch-diff.githubusercontent.com/topics/llms
Mecanik	https://patch-diff.githubusercontent.com/Mecanik
Tiny-BPE-Trainer	https://patch-diff.githubusercontent.com/Mecanik/Tiny-BPE-Trainer
Sponsor	https://patch-diff.githubusercontent.com/sponsors/Mecanik
Star 4	https://patch-diff.githubusercontent.com/login?return_to=%2FMecanik%2FTiny-BPE-Trainer
Code	https://patch-diff.githubusercontent.com/Mecanik/Tiny-BPE-Trainer
Issues	https://patch-diff.githubusercontent.com/Mecanik/Tiny-BPE-Trainer/issues
Pull requests	https://patch-diff.githubusercontent.com/Mecanik/Tiny-BPE-Trainer/pulls
nlp	https://patch-diff.githubusercontent.com/topics/nlp
machine-learning	https://patch-diff.githubusercontent.com/topics/machine-learning
natural-language-processing	https://patch-diff.githubusercontent.com/topics/natural-language-processing
deep-learning	https://patch-diff.githubusercontent.com/topics/deep-learning
tokenizer	https://patch-diff.githubusercontent.com/topics/tokenizer
modern-cpp	https://patch-diff.githubusercontent.com/topics/modern-cpp
vocabulary	https://patch-diff.githubusercontent.com/topics/vocabulary
transformers	https://patch-diff.githubusercontent.com/topics/transformers
header-only	https://patch-diff.githubusercontent.com/topics/header-only
text-processing	https://patch-diff.githubusercontent.com/topics/text-processing
no-dependencies	https://patch-diff.githubusercontent.com/topics/no-dependencies
tokenization	https://patch-diff.githubusercontent.com/topics/tokenization
c17	https://patch-diff.githubusercontent.com/topics/c17
bpe	https://patch-diff.githubusercontent.com/topics/bpe
byte-pair-encoding	https://patch-diff.githubusercontent.com/topics/byte-pair-encoding
huggingface	https://patch-diff.githubusercontent.com/topics/huggingface
mdabir1203	https://patch-diff.githubusercontent.com/mdabir1203
BPE_Tokenizer_Visualizer	https://patch-diff.githubusercontent.com/mdabir1203/BPE_Tokenizer_Visualizer
Star 3	https://patch-diff.githubusercontent.com/login?return_to=%2Fmdabir1203%2FBPE_Tokenizer_Visualizer
Code	https://patch-diff.githubusercontent.com/mdabir1203/BPE_Tokenizer_Visualizer
Issues	https://patch-diff.githubusercontent.com/mdabir1203/BPE_Tokenizer_Visualizer/issues
Pull requests	https://patch-diff.githubusercontent.com/mdabir1203/BPE_Tokenizer_Visualizer/pulls
react	https://patch-diff.githubusercontent.com/topics/react
javascript	https://patch-diff.githubusercontent.com/topics/javascript
ai	https://patch-diff.githubusercontent.com/topics/ai
byte-pair-encoding	https://patch-diff.githubusercontent.com/topics/byte-pair-encoding
tokenizer-nlp	https://patch-diff.githubusercontent.com/topics/tokenizer-nlp
42wolfsburg	https://patch-diff.githubusercontent.com/topics/42wolfsburg
llm	https://patch-diff.githubusercontent.com/topics/llm
ai-club	https://patch-diff.githubusercontent.com/topics/ai-club
crodriguez1a	https://patch-diff.githubusercontent.com/crodriguez1a
bpe-summarizer	https://patch-diff.githubusercontent.com/crodriguez1a/bpe-summarizer
Star 3	https://patch-diff.githubusercontent.com/login?return_to=%2Fcrodriguez1a%2Fbpe-summarizer
Code	https://patch-diff.githubusercontent.com/crodriguez1a/bpe-summarizer
Issues	https://patch-diff.githubusercontent.com/crodriguez1a/bpe-summarizer/issues
Pull requests	https://patch-diff.githubusercontent.com/crodriguez1a/bpe-summarizer/pulls
python	https://patch-diff.githubusercontent.com/topics/python
nlu	https://patch-diff.githubusercontent.com/topics/nlu
bart	https://patch-diff.githubusercontent.com/topics/bart
summarization	https://patch-diff.githubusercontent.com/topics/summarization
bpe	https://patch-diff.githubusercontent.com/topics/bpe
byte-pair-encoding	https://patch-diff.githubusercontent.com/topics/byte-pair-encoding
huggingface	https://patch-diff.githubusercontent.com/topics/huggingface
gpt2tokenizer	https://patch-diff.githubusercontent.com/topics/gpt2tokenizer
iamlxb3	https://patch-diff.githubusercontent.com/iamlxb3
PMTC	https://patch-diff.githubusercontent.com/iamlxb3/PMTC
Star 2	https://patch-diff.githubusercontent.com/login?return_to=%2Fiamlxb3%2FPMTC
Code	https://patch-diff.githubusercontent.com/iamlxb3/PMTC
Issues	https://patch-diff.githubusercontent.com/iamlxb3/PMTC/issues
Pull requests	https://patch-diff.githubusercontent.com/iamlxb3/PMTC/pulls
mmorpg	https://patch-diff.githubusercontent.com/topics/mmorpg
representation-learning	https://patch-diff.githubusercontent.com/topics/representation-learning
byte-pair-encoding	https://patch-diff.githubusercontent.com/topics/byte-pair-encoding
player-behavioral-sequences	https://patch-diff.githubusercontent.com/topics/player-behavioral-sequences
user-behavioral-sequences	https://patch-diff.githubusercontent.com/topics/user-behavioral-sequences
masked-language-modeling	https://patch-diff.githubusercontent.com/topics/masked-language-modeling
AndreiMoraru123	https://patch-diff.githubusercontent.com/AndreiMoraru123
Neural-Machine-Translation	https://patch-diff.githubusercontent.com/AndreiMoraru123/Neural-Machine-Translation
Star 2	https://patch-diff.githubusercontent.com/login?return_to=%2FAndreiMoraru123%2FNeural-Machine-Translation
Code	https://patch-diff.githubusercontent.com/AndreiMoraru123/Neural-Machine-Translation
Issues	https://patch-diff.githubusercontent.com/AndreiMoraru123/Neural-Machine-Translation/issues
Pull requests	https://patch-diff.githubusercontent.com/AndreiMoraru123/Neural-Machine-Translation/pulls
nlp	https://patch-diff.githubusercontent.com/topics/nlp
language	https://patch-diff.githubusercontent.com/topics/language
translation	https://patch-diff.githubusercontent.com/topics/translation
deep-learning	https://patch-diff.githubusercontent.com/topics/deep-learning
tensorflow	https://patch-diff.githubusercontent.com/topics/tensorflow
keras	https://patch-diff.githubusercontent.com/topics/keras
transformers	https://patch-diff.githubusercontent.com/topics/transformers
embeddings	https://patch-diff.githubusercontent.com/topics/embeddings
attention	https://patch-diff.githubusercontent.com/topics/attention
beam-search	https://patch-diff.githubusercontent.com/topics/beam-search
language-model	https://patch-diff.githubusercontent.com/topics/language-model
tokenization	https://patch-diff.githubusercontent.com/topics/tokenization
bleu-score	https://patch-diff.githubusercontent.com/topics/bleu-score
encoder-decoder	https://patch-diff.githubusercontent.com/topics/encoder-decoder
label-smoothing	https://patch-diff.githubusercontent.com/topics/label-smoothing
self-attention	https://patch-diff.githubusercontent.com/topics/self-attention
embedding-projector	https://patch-diff.githubusercontent.com/topics/embedding-projector
byte-pair-encoding	https://patch-diff.githubusercontent.com/topics/byte-pair-encoding
dot-product-attention	https://patch-diff.githubusercontent.com/topics/dot-product-attention
einops	https://patch-diff.githubusercontent.com/topics/einops
Curate this topic	https://github.com/github/explore/tree/master/CONTRIBUTING.md?source=add-description-byte-pair-encoding
Learn more	https://docs.github.com/en/articles/classifying-your-repository-with-topics
	https://github.com
Terms	https://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacy	https://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Security	https://github.com/security
Status	https://www.githubstatus.com/
Community	https://github.community/
Docs	https://docs.github.com/
Contact	https://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.