René's URL Explorer Experiment

Title: GitHub - instructlab/training: InstructLab Training Library - Efficient Fine-Tuning with Message-Format Data

Open Graph Title: GitHub - instructlab/training: InstructLab Training Library - Efficient Fine-Tuning with Message-Format Data

X Title: GitHub - instructlab/training: InstructLab Training Library - Efficient Fine-Tuning with Message-Format Data

Description: InstructLab Training Library - Efficient Fine-Tuning with Message-Format Data - instructlab/training

Open Graph Description: InstructLab Training Library - Efficient Fine-Tuning with Message-Format Data - instructlab/training

X Description: InstructLab Training Library - Efficient Fine-Tuning with Message-Format Data - instructlab/training

Opengraph URL: https://github.com/instructlab/training

X: @github

direct link

Domain: github.com

route-pattern	/:user_id/:repository
route-controller	files
route-action	disambiguate
fetch-nonce	v2:ac59b563-c726-9f52-0e44-8fe1b6fcfe60
current-catalog-service-hash	f3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-id	E50A:FB3A6:127CAEC:19A343B:6969FFA9
html-safe-nonce	37b72d7157dd5fb537af400eecf9210c0b3022fc6f933cb752457e22478f41d9
visitor-payload	eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJFNTBBOkZCM0E2OjEyN0NBRUM6MTlBMzQzQjo2OTY5RkZBOSIsInZpc2l0b3JfaWQiOiIxMDgzMTc5NTU2ODQwMDEzNzM3IiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0=
visitor-hmac	f3fb981163eb80156738e3659b1b1a5b74d8c7cf344efd9cfb94a252052f3c4b
hovercard-subject-tag	repository:792037482
github-keyboard-shortcuts	repository,copilot
google-site-verification	Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-url	https://collector.github.com/github/collect
analytics-location	//
fb:app_id	1401488693436528
apple-itunes-app	app-id=1477376905, app-argument=https://github.com/instructlab/training
twitter:image	https://opengraph.githubassets.com/d3d64557aa6b46e1c585bcbaf41e1da404281cde00dfbd30d680d75e069b7f83/instructlab/training
twitter:card	summary_large_image
og:image	https://opengraph.githubassets.com/d3d64557aa6b46e1c585bcbaf41e1da404281cde00dfbd30d680d75e069b7f83/instructlab/training
og:image:alt	InstructLab Training Library - Efficient Fine-Tuning with Message-Format Data - instructlab/training
og:image:width	1200
og:image:height	600
og:site_name	GitHub
og:type	object
hostname	github.com
expected-hostname	github.com
None	7b32f1c7c4549428ee399213e8345494fc55b5637195d3fc5f493657579235e8
turbo-cache-control	no-preview
go-import	github.com/instructlab/training git https://github.com/instructlab/training.git
octolytics-dimension-user_id	160199024
octolytics-dimension-user_login	instructlab
octolytics-dimension-repository_id	792037482
octolytics-dimension-repository_nwo	instructlab/training
octolytics-dimension-repository_public	true
octolytics-dimension-repository_is_fork	false
octolytics-dimension-repository_network_root_id	792037482
octolytics-dimension-repository_network_root_nwo	instructlab/training
turbo-body-classes	logged-out env-production page-responsive
disable-turbo	false
browser-stats-url	https://api.github.com/_private/browser/stats
browser-errors-url	https://api.github.com/_private/browser/errors
release	bdde15ad1b403e23b08bbd89b53fbe6bdf688cad
ui-target	canary-2
theme-color	#1e2327
color-scheme	light dark

Links:

Skip to content	https://github.com/instructlab/training#start-of-content
	https://github.com/
Sign in	https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Finstructlab%2Ftraining
GitHub CopilotWrite better code with AI	https://github.com/features/copilot
GitHub SparkBuild and deploy intelligent apps	https://github.com/features/spark
GitHub ModelsManage and compare prompts	https://github.com/features/models
MCP RegistryNewIntegrate external tools	https://github.com/mcp
ActionsAutomate any workflow	https://github.com/features/actions
CodespacesInstant dev environments	https://github.com/features/codespaces
IssuesPlan and track work	https://github.com/features/issues
Code ReviewManage code changes	https://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilities	https://github.com/security/advanced-security
Code securitySecure your code as you build	https://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they start	https://github.com/security/advanced-security/secret-protection
Why GitHub	https://github.com/why-github
Documentation	https://docs.github.com
Blog	https://github.blog
Changelog	https://github.blog/changelog
Marketplace	https://github.com/marketplace
View all features	https://github.com/features
Enterprises	https://github.com/enterprise
Small and medium teams	https://github.com/team
Startups	https://github.com/enterprise/startups
Nonprofits	https://github.com/solutions/industry/nonprofits
App Modernization	https://github.com/solutions/use-case/app-modernization
DevSecOps	https://github.com/solutions/use-case/devsecops
DevOps	https://github.com/solutions/use-case/devops
CI/CD	https://github.com/solutions/use-case/ci-cd
View all use cases	https://github.com/solutions/use-case
Healthcare	https://github.com/solutions/industry/healthcare
Financial services	https://github.com/solutions/industry/financial-services
Manufacturing	https://github.com/solutions/industry/manufacturing
Government	https://github.com/solutions/industry/government
View all industries	https://github.com/solutions/industry
View all solutions	https://github.com/solutions
AI	https://github.com/resources/articles?topic=ai
Software Development	https://github.com/resources/articles?topic=software-development
DevOps	https://github.com/resources/articles?topic=devops
Security	https://github.com/resources/articles?topic=security
View all topics	https://github.com/resources/articles
Customer stories	https://github.com/customer-stories
Events & webinars	https://github.com/resources/events
Ebooks & reports	https://github.com/resources/whitepapers
Business insights	https://github.com/solutions/executive-insights
GitHub Skills	https://skills.github.com
Documentation	https://docs.github.com
Customer support	https://support.github.com
Community forum	https://github.com/orgs/community/discussions
Trust center	https://github.com/trust-center
Partners	https://github.com/partners
GitHub SponsorsFund open source developers	https://github.com/sponsors
Security Lab	https://securitylab.github.com
Maintainer Community	https://maintainers.github.com
Accelerator	https://github.com/accelerator
Archive Program	https://archiveprogram.github.com
Topics	https://github.com/topics
Trending	https://github.com/trending
Collections	https://github.com/collections
Enterprise platformAI-powered developer platform	https://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security features	https://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI features	https://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 support	https://github.com/premium-support
Pricing	https://github.com/pricing
Search syntax tips	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentation	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in	https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Finstructlab%2Ftraining
Sign up	https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=instructlab%2Ftraining
Reload	https://github.com/instructlab/training
Reload	https://github.com/instructlab/training
Reload	https://github.com/instructlab/training
instructlab	https://github.com/instructlab
training	https://github.com/instructlab/training
Notifications	https://github.com/login?return_to=%2Finstructlab%2Ftraining
Fork 75	https://github.com/login?return_to=%2Finstructlab%2Ftraining
Star 44	https://github.com/login?return_to=%2Finstructlab%2Ftraining
pypi.org/project/instructlab-training/	https://pypi.org/project/instructlab-training/
Apache-2.0 license	https://github.com/instructlab/training/blob/main/LICENSE
44 stars	https://github.com/instructlab/training/stargazers
75 forks	https://github.com/instructlab/training/forks
Branches	https://github.com/instructlab/training/branches
Tags	https://github.com/instructlab/training/tags
Activity	https://github.com/instructlab/training/activity
Star	https://github.com/login?return_to=%2Finstructlab%2Ftraining
Notifications	https://github.com/login?return_to=%2Finstructlab%2Ftraining
Code	https://github.com/instructlab/training
Issues 30	https://github.com/instructlab/training/issues
Pull requests 16	https://github.com/instructlab/training/pulls
Actions	https://github.com/instructlab/training/actions
Projects 0	https://github.com/instructlab/training/projects
Security Uh oh! There was an error while loading. Please reload this page.	https://github.com/instructlab/training/security
Please reload this page	https://github.com/instructlab/training
Insights	https://github.com/instructlab/training/pulse
Code	https://github.com/instructlab/training
Issues	https://github.com/instructlab/training/issues
Pull requests	https://github.com/instructlab/training/pulls
Actions	https://github.com/instructlab/training/actions
Projects	https://github.com/instructlab/training/projects
Security	https://github.com/instructlab/training/security
Insights	https://github.com/instructlab/training/pulse
Branches	https://github.com/instructlab/training/branches
Tags	https://github.com/instructlab/training/tags
	https://github.com/instructlab/training/branches
	https://github.com/instructlab/training/tags
644 Commits	https://github.com/instructlab/training/commits/main/
	https://github.com/instructlab/training/commits/main/
.github	https://github.com/instructlab/training/tree/main/.github
.github	https://github.com/instructlab/training/tree/main/.github
docs	https://github.com/instructlab/training/tree/main/docs
docs	https://github.com/instructlab/training/tree/main/docs
examples	https://github.com/instructlab/training/tree/main/examples
examples	https://github.com/instructlab/training/tree/main/examples
sample-data	https://github.com/instructlab/training/tree/main/sample-data
sample-data	https://github.com/instructlab/training/tree/main/sample-data
scripts	https://github.com/instructlab/training/tree/main/scripts
scripts	https://github.com/instructlab/training/tree/main/scripts
src/instructlab	https://github.com/instructlab/training/tree/main/src/instructlab
src/instructlab	https://github.com/instructlab/training/tree/main/src/instructlab
tests	https://github.com/instructlab/training/tree/main/tests
tests	https://github.com/instructlab/training/tree/main/tests
.gitignore	https://github.com/instructlab/training/blob/main/.gitignore
.gitignore	https://github.com/instructlab/training/blob/main/.gitignore
.isort.cfg	https://github.com/instructlab/training/blob/main/.isort.cfg
.isort.cfg	https://github.com/instructlab/training/blob/main/.isort.cfg
.markdownlint-cli2.yaml	https://github.com/instructlab/training/blob/main/.markdownlint-cli2.yaml
.markdownlint-cli2.yaml	https://github.com/instructlab/training/blob/main/.markdownlint-cli2.yaml
.pre-commit-config.yaml	https://github.com/instructlab/training/blob/main/.pre-commit-config.yaml
.pre-commit-config.yaml	https://github.com/instructlab/training/blob/main/.pre-commit-config.yaml
.pylintrc	https://github.com/instructlab/training/blob/main/.pylintrc
.pylintrc	https://github.com/instructlab/training/blob/main/.pylintrc
DCO.txt	https://github.com/instructlab/training/blob/main/DCO.txt
DCO.txt	https://github.com/instructlab/training/blob/main/DCO.txt
LICENSE	https://github.com/instructlab/training/blob/main/LICENSE
LICENSE	https://github.com/instructlab/training/blob/main/LICENSE
Makefile	https://github.com/instructlab/training/blob/main/Makefile
Makefile	https://github.com/instructlab/training/blob/main/Makefile
README.md	https://github.com/instructlab/training/blob/main/README.md
README.md	https://github.com/instructlab/training/blob/main/README.md
constraints-dev.txt	https://github.com/instructlab/training/blob/main/constraints-dev.txt
constraints-dev.txt	https://github.com/instructlab/training/blob/main/constraints-dev.txt
constraints-dev.txt.in	https://github.com/instructlab/training/blob/main/constraints-dev.txt.in
constraints-dev.txt.in	https://github.com/instructlab/training/blob/main/constraints-dev.txt.in
pyproject.toml	https://github.com/instructlab/training/blob/main/pyproject.toml
pyproject.toml	https://github.com/instructlab/training/blob/main/pyproject.toml
requirements-cuda.txt	https://github.com/instructlab/training/blob/main/requirements-cuda.txt
requirements-cuda.txt	https://github.com/instructlab/training/blob/main/requirements-cuda.txt
requirements-deepspeed.txt	https://github.com/instructlab/training/blob/main/requirements-deepspeed.txt
requirements-deepspeed.txt	https://github.com/instructlab/training/blob/main/requirements-deepspeed.txt
requirements-dev.txt	https://github.com/instructlab/training/blob/main/requirements-dev.txt
requirements-dev.txt	https://github.com/instructlab/training/blob/main/requirements-dev.txt
requirements-files.in	https://github.com/instructlab/training/blob/main/requirements-files.in
requirements-files.in	https://github.com/instructlab/training/blob/main/requirements-files.in
requirements-hpu.txt	https://github.com/instructlab/training/blob/main/requirements-hpu.txt
requirements-hpu.txt	https://github.com/instructlab/training/blob/main/requirements-hpu.txt
requirements-rocm.txt	https://github.com/instructlab/training/blob/main/requirements-rocm.txt
requirements-rocm.txt	https://github.com/instructlab/training/blob/main/requirements-rocm.txt
requirements.txt	https://github.com/instructlab/training/blob/main/requirements.txt
requirements.txt	https://github.com/instructlab/training/blob/main/requirements.txt
tox.ini	https://github.com/instructlab/training/blob/main/tox.ini
tox.ini	https://github.com/instructlab/training/blob/main/tox.ini
README	https://github.com/instructlab/training
Code of conduct	https://github.com/instructlab/training
Apache-2.0 license	https://github.com/instructlab/training
Security	https://github.com/instructlab/training
	https://github.com/instructlab/training#instructlab-training-library
	https://github.com/instructlab/training/actions/workflows/lint.yml/badge.svg?branch=main
	https://github.com/instructlab/training/actions/workflows/pypi.yaml/badge.svg?branch=main
	https://camo.githubusercontent.com/e484b4f61dc55e9690ec14ebc0b10843d05bace7f1cd1a22e731fdd427012bee/68747470733a2f2f696d672e736869656c64732e696f2f6769746875622f762f72656c656173652f696e7374727563746c61622f747261696e696e67
	https://camo.githubusercontent.com/72e6894b6b2e34cf7078062d33523e1722f42899a03ef956618cfe8f946027e3/68747470733a2f2f696d672e736869656c64732e696f2f6769746875622f6c6963656e73652f696e7374727563746c61622f747261696e696e67
	https://github.com/instructlab/training/actions/workflows/e2e-nvidia-l40s-x4.yml/badge.svg?branch=main
	https://github.com/instructlab/training#about-the-library
Unveiling the Secret Recipe: A Guide For Supervised Fine-Tuning Small LLMs	https://arxiv.org/abs/2412.13337
LAB method	https://arxiv.org/abs/2403.01081
	https://github.com/instructlab/training#reasoning-content-support
	https://github.com/instructlab/training#usage-and-guidance-sections
Installing	https://github.com/instructlab/training#installing-the-library
Additional Nvidia packages	https://github.com/instructlab/training#additional-nvidia-packages
Using the library	https://github.com/instructlab/training#using-the-library
Data format	https://github.com/instructlab/training#data-format
Reasoning content support	https://github.com/instructlab/training#reasoning-content-support-1
Continual pretraining mode	https://github.com/instructlab/training#continual-pretraining-mode
Documentation	https://github.com/instructlab/training#documentation
Learning about the training arguments	https://github.com/instructlab/training#learning-about-training-arguments
TrainingArgs	https://github.com/instructlab/training#trainingargs
DeepSpeedOptions	https://github.com/instructlab/training#deepspeedoptions
FSDPOptions	https://github.com/instructlab/training#fsdpoptions
loraOptions	https://github.com/instructlab/training#loraoptions
Learning about TorchrunArgs arguments	https://github.com/instructlab/training#learning-about-torchrunargs-arguments
Example training run with arguments	https://github.com/instructlab/training#example-training-run-with-arguments
	https://github.com/instructlab/training#installing-the-library
	https://github.com/instructlab/training#additional-nvidia-packages
	https://github.com/instructlab/training#using-the-library
Learning about the training argument	https://github.com/instructlab/training#learning-about-training-arguments
Example training run with arguments	https://github.com/instructlab/training#example-training-run-with-arguments
	https://github.com/instructlab/training#data-format
	https://github.com/instructlab/training#reasoning-content-support-1
	https://github.com/instructlab/training#continual-pretraining-mode
	https://github.com/instructlab/training#important-notes
	https://github.com/instructlab/training#documentation
Reasoning Content Support	https://github.com/instructlab/training/blob/main/docs/reasoning_content.md
CI Documentation	https://github.com/instructlab/training/blob/main/docs/ci.md
Logging Documentation	https://github.com/instructlab/training/blob/main/docs/logging.md
	https://github.com/instructlab/training#learning-about-training-arguments
	https://github.com/instructlab/training#trainingargs
	https://github.com/instructlab/training#deepspeedoptions
deepspeed.ai	https://www.deepspeed.ai/
	https://github.com/instructlab/training#deepspeed-with-cpu-offloading
	https://github.com/instructlab/training#fsdpoptions
	https://github.com/instructlab/training#loraoptions
	https://github.com/instructlab/training#example-run-with-lora-options
	https://github.com/instructlab/training#learning-about-torchrunargs-arguments
torchrun accepts today	https://pytorch.org/docs/stable/elastic/run.html#definitions
torchrun documentation	https://pytorch.org/docs/stable/elastic/run.html#definitions
	https://github.com/instructlab/training#example-training-run-with-torchrunargs-arguments
	https://github.com/instructlab/training#example-training-run-with-arguments
	https://github.com/instructlab/training#example-training-with-separate-data-pre-processing
	https://github.com/instructlab/training#environment-variables
	https://github.com/instructlab/training#developer-certificate-of-origin
pypi.org/project/instructlab-training/	https://pypi.org/project/instructlab-training/
Readme	https://github.com/instructlab/training#readme-ov-file
Apache-2.0 license	https://github.com/instructlab/training#Apache-2.0-1-ov-file
Code of conduct	https://github.com/instructlab/training#coc-ov-file
Security policy	https://github.com/instructlab/training#security-ov-file
Please reload this page	https://github.com/instructlab/training
Activity	https://github.com/instructlab/training/activity
Custom properties	https://github.com/instructlab/training/custom-properties
44 stars	https://github.com/instructlab/training/stargazers
15 watching	https://github.com/instructlab/training/watchers
75 forks	https://github.com/instructlab/training/forks
Report repository	https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Finstructlab%2Ftraining&report=instructlab+%28user%29
Releases 39	https://github.com/instructlab/training/releases
v0.13.0 - Pretraining Support & Optimizer Configuration Latest Jan 8, 2026	https://github.com/instructlab/training/releases/tag/v0.13.0
+ 38 releases	https://github.com/instructlab/training/releases
Packages 0	https://github.com/orgs/instructlab/packages?repo_name=training
Please reload this page	https://github.com/instructlab/training
Contributors 37	https://github.com/instructlab/training/graphs/contributors
Please reload this page	https://github.com/instructlab/training
+ 23 contributors	https://github.com/instructlab/training/graphs/contributors
Python 97.3%	https://github.com/instructlab/training/search?l=python
Shell 2.2%	https://github.com/instructlab/training/search?l=shell
Makefile 0.5%	https://github.com/instructlab/training/search?l=makefile
	https://github.com
Terms	https://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacy	https://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Security	https://github.com/security
Status	https://www.githubstatus.com/
Community	https://github.community/
Docs	https://docs.github.com/
Contact	https://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.