René's URL Explorer Experiment

Title: GitHub - Modalities/modalities: Modalities, a PyTorch-native framework for distributed and reproducible foundation model training.

Open Graph Title: GitHub - Modalities/modalities: Modalities, a PyTorch-native framework for distributed and reproducible foundation model training.

X Title: GitHub - Modalities/modalities: Modalities, a PyTorch-native framework for distributed and reproducible foundation model training.

Description: Modalities, a PyTorch-native framework for distributed and reproducible foundation model training. - Modalities/modalities

Open Graph Description: Modalities, a PyTorch-native framework for distributed and reproducible foundation model training. - Modalities/modalities

X Description: Modalities, a PyTorch-native framework for distributed and reproducible foundation model training. - Modalities/modalities

Opengraph URL: https://github.com/Modalities/modalities

X: @github

direct link

Domain: patch-diff.githubusercontent.com

route-pattern	/:user_id/:repository
route-controller	files
route-action	disambiguate
fetch-nonce	v2:d951e2f1-70a7-6f9c-48b9-377ab67ee677
current-catalog-service-hash	f3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-id	ED5A:1D2DA5:92DA1:C875A:698E181D
html-safe-nonce	2e9eb9b1e4b373760f16e8f57d7646be22b616004a593bc3e713012c5d3d230d
visitor-payload	eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJFRDVBOjFEMkRBNTo5MkRBMTpDODc1QTo2OThFMTgxRCIsInZpc2l0b3JfaWQiOiI1OTU0MDE5ODY0NjQxMTQ4OTU3IiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0=
visitor-hmac	ca6cc2c08a4fa613383f5f3bd405ecb349ec97f3f486c6ef94e1338cf04f7274
hovercard-subject-tag	repository:742078854
github-keyboard-shortcuts	repository,copilot
google-site-verification	Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-url	https://collector.github.com/github/collect
analytics-location	//
fb:app_id	1401488693436528
apple-itunes-app	app-id=1477376905, app-argument=https://github.com/Modalities/modalities
twitter:image	https://opengraph.githubassets.com/c3b2a1d5abe631345d1c0e034a8fc9b15585317ca56c6c8388cfa8739af72990/Modalities/modalities
twitter:card	summary_large_image
og:image	https://opengraph.githubassets.com/c3b2a1d5abe631345d1c0e034a8fc9b15585317ca56c6c8388cfa8739af72990/Modalities/modalities
og:image:alt	Modalities, a PyTorch-native framework for distributed and reproducible foundation model training. - Modalities/modalities
og:image:width	1200
og:image:height	600
og:site_name	GitHub
og:type	object
hostname	github.com
expected-hostname	github.com
None	52130a026bd9a3f98228b6aa6af91acdab5d18de411e2c1e67e6253493561296
turbo-cache-control	no-preview
go-import	github.com/Modalities/modalities git https://github.com/Modalities/modalities.git
octolytics-dimension-user_id	153828696
octolytics-dimension-user_login	Modalities
octolytics-dimension-repository_id	742078854
octolytics-dimension-repository_nwo	Modalities/modalities
octolytics-dimension-repository_public	true
octolytics-dimension-repository_is_fork	false
octolytics-dimension-repository_network_root_id	742078854
octolytics-dimension-repository_network_root_nwo	Modalities/modalities
turbo-body-classes	logged-out env-production page-responsive
disable-turbo	false
browser-stats-url	https://api.github.com/_private/browser/stats
browser-errors-url	https://api.github.com/_private/browser/errors
release	301a1d7743177dcb7528b1322117cdafeda8ff08
ui-target	full
theme-color	#1e2327
color-scheme	light dark

Links:

Skip to content	https://patch-diff.githubusercontent.com/Modalities/modalities#start-of-content
	https://patch-diff.githubusercontent.com/
Sign in	https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2FModalities%2Fmodalities
GitHub CopilotWrite better code with AI	https://github.com/features/copilot
GitHub SparkBuild and deploy intelligent apps	https://github.com/features/spark
GitHub ModelsManage and compare prompts	https://github.com/features/models
MCP RegistryNewIntegrate external tools	https://github.com/mcp
ActionsAutomate any workflow	https://github.com/features/actions
CodespacesInstant dev environments	https://github.com/features/codespaces
IssuesPlan and track work	https://github.com/features/issues
Code ReviewManage code changes	https://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilities	https://github.com/security/advanced-security
Code securitySecure your code as you build	https://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they start	https://github.com/security/advanced-security/secret-protection
Why GitHub	https://github.com/why-github
Documentation	https://docs.github.com
Blog	https://github.blog
Changelog	https://github.blog/changelog
Marketplace	https://github.com/marketplace
View all features	https://github.com/features
Enterprises	https://github.com/enterprise
Small and medium teams	https://github.com/team
Startups	https://github.com/enterprise/startups
Nonprofits	https://github.com/solutions/industry/nonprofits
App Modernization	https://github.com/solutions/use-case/app-modernization
DevSecOps	https://github.com/solutions/use-case/devsecops
DevOps	https://github.com/solutions/use-case/devops
CI/CD	https://github.com/solutions/use-case/ci-cd
View all use cases	https://github.com/solutions/use-case
Healthcare	https://github.com/solutions/industry/healthcare
Financial services	https://github.com/solutions/industry/financial-services
Manufacturing	https://github.com/solutions/industry/manufacturing
Government	https://github.com/solutions/industry/government
View all industries	https://github.com/solutions/industry
View all solutions	https://github.com/solutions
AI	https://github.com/resources/articles?topic=ai
Software Development	https://github.com/resources/articles?topic=software-development
DevOps	https://github.com/resources/articles?topic=devops
Security	https://github.com/resources/articles?topic=security
View all topics	https://github.com/resources/articles
Customer stories	https://github.com/customer-stories
Events & webinars	https://github.com/resources/events
Ebooks & reports	https://github.com/resources/whitepapers
Business insights	https://github.com/solutions/executive-insights
GitHub Skills	https://skills.github.com
Documentation	https://docs.github.com
Customer support	https://support.github.com
Community forum	https://github.com/orgs/community/discussions
Trust center	https://github.com/trust-center
Partners	https://github.com/partners
GitHub SponsorsFund open source developers	https://github.com/sponsors
Security Lab	https://securitylab.github.com
Maintainer Community	https://maintainers.github.com
Accelerator	https://github.com/accelerator
Archive Program	https://archiveprogram.github.com
Topics	https://github.com/topics
Trending	https://github.com/trending
Collections	https://github.com/collections
Enterprise platformAI-powered developer platform	https://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security features	https://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI features	https://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 support	https://github.com/premium-support
Pricing	https://github.com/pricing
Search syntax tips	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentation	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in	https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2FModalities%2Fmodalities
Sign up	https://patch-diff.githubusercontent.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=Modalities%2Fmodalities
Reload	https://patch-diff.githubusercontent.com/Modalities/modalities
Reload	https://patch-diff.githubusercontent.com/Modalities/modalities
Reload	https://patch-diff.githubusercontent.com/Modalities/modalities
Modalities	https://patch-diff.githubusercontent.com/Modalities
modalities	https://patch-diff.githubusercontent.com/Modalities/modalities
Notifications	https://patch-diff.githubusercontent.com/login?return_to=%2FModalities%2Fmodalities
Fork 14	https://patch-diff.githubusercontent.com/login?return_to=%2FModalities%2Fmodalities
Star 100	https://patch-diff.githubusercontent.com/login?return_to=%2FModalities%2Fmodalities
MIT license	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/LICENSE
100 stars	https://patch-diff.githubusercontent.com/Modalities/modalities/stargazers
14 forks	https://patch-diff.githubusercontent.com/Modalities/modalities/forks
Branches	https://patch-diff.githubusercontent.com/Modalities/modalities/branches
Tags	https://patch-diff.githubusercontent.com/Modalities/modalities/tags
Activity	https://patch-diff.githubusercontent.com/Modalities/modalities/activity
Star	https://patch-diff.githubusercontent.com/login?return_to=%2FModalities%2Fmodalities
Notifications	https://patch-diff.githubusercontent.com/login?return_to=%2FModalities%2Fmodalities
Code	https://patch-diff.githubusercontent.com/Modalities/modalities
Issues 70	https://patch-diff.githubusercontent.com/Modalities/modalities/issues
Pull requests 10	https://patch-diff.githubusercontent.com/Modalities/modalities/pulls
Actions	https://patch-diff.githubusercontent.com/Modalities/modalities/actions
Projects 0	https://patch-diff.githubusercontent.com/Modalities/modalities/projects
Security 0	https://patch-diff.githubusercontent.com/Modalities/modalities/security
Insights	https://patch-diff.githubusercontent.com/Modalities/modalities/pulse
Code	https://patch-diff.githubusercontent.com/Modalities/modalities
Issues	https://patch-diff.githubusercontent.com/Modalities/modalities/issues
Pull requests	https://patch-diff.githubusercontent.com/Modalities/modalities/pulls
Actions	https://patch-diff.githubusercontent.com/Modalities/modalities/actions
Projects	https://patch-diff.githubusercontent.com/Modalities/modalities/projects
Security	https://patch-diff.githubusercontent.com/Modalities/modalities/security
Insights	https://patch-diff.githubusercontent.com/Modalities/modalities/pulse
Branches	https://patch-diff.githubusercontent.com/Modalities/modalities/branches
Tags	https://patch-diff.githubusercontent.com/Modalities/modalities/tags
	https://patch-diff.githubusercontent.com/Modalities/modalities/branches
	https://patch-diff.githubusercontent.com/Modalities/modalities/tags
2,969 Commits	https://patch-diff.githubusercontent.com/Modalities/modalities/commits/main/
	https://patch-diff.githubusercontent.com/Modalities/modalities/commits/main/
.github	https://patch-diff.githubusercontent.com/Modalities/modalities/tree/main/.github
.github	https://patch-diff.githubusercontent.com/Modalities/modalities/tree/main/.github
config_files	https://patch-diff.githubusercontent.com/Modalities/modalities/tree/main/config_files
config_files	https://patch-diff.githubusercontent.com/Modalities/modalities/tree/main/config_files
container	https://patch-diff.githubusercontent.com/Modalities/modalities/tree/main/container
container	https://patch-diff.githubusercontent.com/Modalities/modalities/tree/main/container
data	https://patch-diff.githubusercontent.com/Modalities/modalities/tree/main/data
data	https://patch-diff.githubusercontent.com/Modalities/modalities/tree/main/data
docs	https://patch-diff.githubusercontent.com/Modalities/modalities/tree/main/docs
docs	https://patch-diff.githubusercontent.com/Modalities/modalities/tree/main/docs
notebooks	https://patch-diff.githubusercontent.com/Modalities/modalities/tree/main/notebooks
notebooks	https://patch-diff.githubusercontent.com/Modalities/modalities/tree/main/notebooks
scripts	https://patch-diff.githubusercontent.com/Modalities/modalities/tree/main/scripts
scripts	https://patch-diff.githubusercontent.com/Modalities/modalities/tree/main/scripts
src/modalities	https://patch-diff.githubusercontent.com/Modalities/modalities/tree/main/src/modalities
src/modalities	https://patch-diff.githubusercontent.com/Modalities/modalities/tree/main/src/modalities
tests	https://patch-diff.githubusercontent.com/Modalities/modalities/tree/main/tests
tests	https://patch-diff.githubusercontent.com/Modalities/modalities/tree/main/tests
tutorials	https://patch-diff.githubusercontent.com/Modalities/modalities/tree/main/tutorials
tutorials	https://patch-diff.githubusercontent.com/Modalities/modalities/tree/main/tutorials
.coveragerc	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/.coveragerc
.coveragerc	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/.coveragerc
.gitignore	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/.gitignore
.gitignore	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/.gitignore
.pre-commit-config.yaml	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/.pre-commit-config.yaml
.pre-commit-config.yaml	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/.pre-commit-config.yaml
.readthedocs.yaml	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/.readthedocs.yaml
.readthedocs.yaml	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/.readthedocs.yaml
CHANGELOG_DEV.md	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/CHANGELOG_DEV.md
CHANGELOG_DEV.md	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/CHANGELOG_DEV.md
CITATION.cff	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/CITATION.cff
CITATION.cff	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/CITATION.cff
CONTRIBUTING.md	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/CONTRIBUTING.md
CONTRIBUTING.md	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/CONTRIBUTING.md
Dataset.md	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/Dataset.md
Dataset.md	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/Dataset.md
LICENSE	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/LICENSE
LICENSE	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/LICENSE
MMAP_DATASET_README.md	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/MMAP_DATASET_README.md
MMAP_DATASET_README.md	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/MMAP_DATASET_README.md
README.md	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/README.md
README.md	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/README.md
pyproject.toml	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/pyproject.toml
pyproject.toml	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/pyproject.toml
README	https://patch-diff.githubusercontent.com/Modalities/modalities
Contributing	https://patch-diff.githubusercontent.com/Modalities/modalities
MIT license	https://patch-diff.githubusercontent.com/Modalities/modalities
	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/docs/source/banner.jpg
	https://camo.githubusercontent.com/e4f8e198efb5dde74c10dff07226ec6756d33d26186ca713e8de79e79a81e1e7/68747470733a2f2f696d672e736869656c64732e696f2f62616467652f507974686f6e2d332e3130253230253743253230332e31312d626c7565
	https://pytorch.org/
	https://coveralls.io/github/Modalities/modalities
	https://camo.githubusercontent.com/dfcc13d70345d519d53ce37f17c808654a9d9204936c883c185d70f258213a86/68747470733a2f2f696d672e736869656c64732e696f2f707970692f762f6d6f64616c6974696573
	https://opensource.org/licenses/MIT
Modalities pre-print	https://arxiv.org/abs/2602.08387
Leonardo Booster	https://leonardo-supercomputer.cineca.eu/hpc-system/
MareNostrum 5	https://www.bsc.es/ca/marenostrum/marenostrum-5
here	https://patch-diff.githubusercontent.com/Modalities/modalities#scaling-experiments
	https://patch-diff.githubusercontent.com/Modalities/modalities#getting-started
this	https://github.com/Modalities/modalities/blob/main/tutorials/getting_started/README.md
	https://patch-diff.githubusercontent.com/Modalities/modalities#installation
	https://patch-diff.githubusercontent.com/Modalities/modalities#option-1-installation-from-source
	https://patch-diff.githubusercontent.com/Modalities/modalities#option-2-installation-via-pip
	https://patch-diff.githubusercontent.com/Modalities/modalities#option-3-feature-complete-via-uv
	https://patch-diff.githubusercontent.com/Modalities/modalities#option-4-containerized-setup-via-singularity--apptainer
	https://patch-diff.githubusercontent.com/Modalities/modalities#1-build-the-image
	https://patch-diff.githubusercontent.com/Modalities/modalities#2-run-the-built-in-smoke-test
	https://patch-diff.githubusercontent.com/Modalities/modalities#3-launch-training-inside-the-container
	https://patch-diff.githubusercontent.com/Modalities/modalities#usage
	https://patch-diff.githubusercontent.com/Modalities/modalities#model-training
here	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/tutorials/getting_started/example_config.yaml
here	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/docs/components/components.md
	https://patch-diff.githubusercontent.com/Modalities/modalities#raw-training-dataset-indexation
	https://patch-diff.githubusercontent.com/Modalities/modalities#raw-training-dataset-tokenization
here	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/tutorials/getting_started/example_dataset_config_train.yaml
	https://patch-diff.githubusercontent.com/Modalities/modalities#inference
here	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/tutorials/getting_started/example_text_generation_config.yaml
	https://patch-diff.githubusercontent.com/Modalities/modalities#tutorials
Modalities in 15mins	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/tutorials/modalities_in_15_mins/README.md
Getting Started	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/tutorials/getting_started/README.md
Warmstart	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/tutorials/warmstart/README.md
Library Usage	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/tutorials/library_usage/README.md
Instruction Tuning	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/tutorials/instruction_tuning/README.md
Scaling Up	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/tutorials/scaling_up/README.md
	https://patch-diff.githubusercontent.com/Modalities/modalities#supported-features
	https://patch-diff.githubusercontent.com/Modalities/modalities#throughput-features
	https://patch-diff.githubusercontent.com/Modalities/modalities#downstream-performance-features
	https://patch-diff.githubusercontent.com/Modalities/modalities#reproducibility--extensibility-features
	https://patch-diff.githubusercontent.com/Modalities/modalities#scaling-experiments
Leonardo Booster	https://leonardo-supercomputer.cineca.eu/hpc-system/
MareNostrum 5	https://www.bsc.es/ca/marenostrum/marenostrum-5
	https://patch-diff.githubusercontent.com/Modalities/modalities#leonardo-booster----nvidia-a100-64gb
Leonardo Booster Scaling Experiments	https://github.com/Modalities/modalities/blob/scaling_experiments/docs/scaling_experiments/scaling_leonardo.md
	https://patch-diff.githubusercontent.com/Modalities/modalities#marenostrum-5---nvidia-h100-64gb
MareNostrum5 Scaling Experiments	https://github.com/Modalities/modalities/blob/scaling_experiments/docs/scaling_experiments/scaling_mn5.md
	https://github.com/Modalities/modalities/blob/scaling_experiments/docs/scaling_experiments/scaling_28B_mbs_1_ac_True.png
	https://patch-diff.githubusercontent.com/Modalities/modalities#contributing
contributing	https://patch-diff.githubusercontent.com/Modalities/modalities/blob/main/CONTRIBUTING.md
	https://github.com/modalities/modalities/graphs/contributors
	https://patch-diff.githubusercontent.com/Modalities/modalities#citation
Readme	https://patch-diff.githubusercontent.com/Modalities/modalities#readme-ov-file
MIT license	https://patch-diff.githubusercontent.com/Modalities/modalities#MIT-1-ov-file
Contributing	https://patch-diff.githubusercontent.com/Modalities/modalities#contributing-ov-file
Please reload this page	https://patch-diff.githubusercontent.com/Modalities/modalities
Activity	https://patch-diff.githubusercontent.com/Modalities/modalities/activity
Custom properties	https://patch-diff.githubusercontent.com/Modalities/modalities/custom-properties
100 stars	https://patch-diff.githubusercontent.com/Modalities/modalities/stargazers
9 watching	https://patch-diff.githubusercontent.com/Modalities/modalities/watchers
14 forks	https://patch-diff.githubusercontent.com/Modalities/modalities/forks
Report repository	https://patch-diff.githubusercontent.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2FModalities%2Fmodalities&report=Modalities+%28user%29
Releases 5	https://patch-diff.githubusercontent.com/Modalities/modalities/releases
v0.5.0 Latest Feb 12, 2026	https://patch-diff.githubusercontent.com/Modalities/modalities/releases/tag/v0.5.0
+ 4 releases	https://patch-diff.githubusercontent.com/Modalities/modalities/releases
Packages 0	https://patch-diff.githubusercontent.com/orgs/Modalities/packages?repo_name=modalities
Please reload this page	https://patch-diff.githubusercontent.com/Modalities/modalities
Contributors 21	https://patch-diff.githubusercontent.com/Modalities/modalities/graphs/contributors
Please reload this page	https://patch-diff.githubusercontent.com/Modalities/modalities
+ 7 contributors	https://patch-diff.githubusercontent.com/Modalities/modalities/graphs/contributors
Python 53.1%	https://patch-diff.githubusercontent.com/Modalities/modalities/search?l=python
Jupyter Notebook 46.0%	https://patch-diff.githubusercontent.com/Modalities/modalities/search?l=jupyter-notebook
Shell 0.9%	https://patch-diff.githubusercontent.com/Modalities/modalities/search?l=shell
	https://github.com
Terms	https://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacy	https://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Security	https://github.com/security
Status	https://www.githubstatus.com/
Community	https://github.community/
Docs	https://docs.github.com/
Contact	https://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.