René's URL Explorer Experiment

Title: GitHub - strlike/unsloth: Finetune Llama 3.3, DeepSeek-R1 & Reasoning LLMs 2x faster with 70% less memory · GitHub

Open Graph Title: GitHub - strlike/unsloth: Finetune Llama 3.3, DeepSeek-R1 & Reasoning LLMs 2x faster with 70% less memory

X Title: GitHub - strlike/unsloth: Finetune Llama 3.3, DeepSeek-R1 & Reasoning LLMs 2x faster with 70% less memory

Description: Finetune Llama 3.3, DeepSeek-R1 & Reasoning LLMs 2x faster with 70% less memory - strlike/unsloth

Open Graph Description: Finetune Llama 3.3, DeepSeek-R1 & Reasoning LLMs 2x faster with 70% less memory - strlike/unsloth

X Description: Finetune Llama 3.3, DeepSeek-R1 & Reasoning LLMs 2x faster with 70% less memory - strlike/unsloth

Opengraph URL: https://github.com/strlike/unsloth

X: @github

direct link

Domain: github.com

route-pattern	/:user_id/:repository
route-controller	files
route-action	disambiguate
fetch-nonce	v2:74f213af-b25f-3b14-5318-23f38d6c29c4
current-catalog-service-hash	f3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-id	BA66:C8AE2:1F36604:2B23E9E:6A4ECF4E
html-safe-nonce	0094111e81a58b428aa6173ea5748622058285d2f0e19d3f60c33062c8213a1a
visitor-payload	eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJCQTY2OkM4QUUyOjFGMzY2MDQ6MkIyM0U5RTo2QTRFQ0Y0RSIsInZpc2l0b3JfaWQiOiI0Mzk5OTYxMTM2MjkzNjYyNTQyIiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0=
visitor-hmac	e41fda37c4eff7f548ff7adb09228975ccebe3cd9ed6643bf87faa0758d337df
hovercard-subject-tag	repository:929849723
github-keyboard-shortcuts	repository,copilot
google-site-verification	Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-url	https://collector.github.com/github/collect
analytics-location	//
fb:app_id	1401488693436528
apple-itunes-app	app-id=1477376905, app-argument=https://github.com/strlike/unsloth
twitter:image	https://opengraph.githubassets.com/2ce54e2c45ad1151677f9311103ab5433d7b7c66e1fef104de1665331802bc60/strlike/unsloth
twitter:card	summary_large_image
og:image	https://opengraph.githubassets.com/2ce54e2c45ad1151677f9311103ab5433d7b7c66e1fef104de1665331802bc60/strlike/unsloth
og:image:alt	Finetune Llama 3.3, DeepSeek-R1 & Reasoning LLMs 2x faster with 70% less memory - strlike/unsloth
og:image:width	1200
og:image:height	600
og:site_name	GitHub
og:type	object
hostname	github.com
expected-hostname	github.com
None	41b6ab3ba6d20a71766ac245b5a4a94c6fc672a9cd4da7d44c1b33ab8bf6a21c
turbo-cache-control	no-cache
go-import	github.com/strlike/unsloth git https://github.com/strlike/unsloth.git
octolytics-dimension-user_id	16254488
octolytics-dimension-user_login	strlike
octolytics-dimension-repository_id	929849723
octolytics-dimension-repository_nwo	strlike/unsloth
octolytics-dimension-repository_public	true
octolytics-dimension-repository_is_fork	true
octolytics-dimension-repository_parent_id	725205304
octolytics-dimension-repository_parent_nwo	unslothai/unsloth
octolytics-dimension-repository_network_root_id	725205304
octolytics-dimension-repository_network_root_nwo	unslothai/unsloth
turbo-body-classes	logged-out env-production page-responsive
disable-turbo	false
browser-stats-url	https://api.github.com/_private/browser/stats
browser-errors-url	https://api.github.com/_private/browser/errors
release	e6a744804e8e70f97b4d5a18a94dcc63db22f97a
ui-target	full
theme-color	#1e2327
color-scheme	light dark

Links:

Skip to content	https://github.com/strlike/unsloth#start-of-content
	https://github.com/
Sign in	https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fstrlike%2Funsloth
GitHub CopilotWrite better code with AI	https://github.com/features/copilot
GitHub Copilot appDirect agents from issue to merge	https://github.com/features/ai/github-app
MCP RegistryNewIntegrate external tools	https://github.com/mcp
ActionsAutomate any workflow	https://github.com/features/actions
CodespacesInstant dev environments	https://github.com/features/codespaces
IssuesPlan and track work	https://github.com/features/issues
Code ReviewManage code changes	https://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilities	https://github.com/security/advanced-security
Code securitySecure your code as you build	https://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they start	https://github.com/security/advanced-security/secret-protection
Why GitHub	https://github.com/why-github
Documentation	https://docs.github.com
Blog	https://github.blog
Changelog	https://github.blog/changelog
Marketplace	https://github.com/marketplace
View all features	https://github.com/features
Enterprises	https://github.com/enterprise
Small and medium teams	https://github.com/team
Startups	https://github.com/enterprise/startups
Nonprofits	https://github.com/solutions/industry/nonprofits
App Modernization	https://github.com/solutions/use-case/app-modernization
DevSecOps	https://github.com/solutions/use-case/devsecops
DevOps	https://github.com/solutions/use-case/devops
CI/CD	https://github.com/solutions/use-case/ci-cd
View all use cases	https://github.com/solutions/use-case
Healthcare	https://github.com/solutions/industry/healthcare
Financial services	https://github.com/solutions/industry/financial-services
Manufacturing	https://github.com/solutions/industry/manufacturing
Government	https://github.com/solutions/industry/government
View all industries	https://github.com/solutions/industry
View all solutions	https://github.com/solutions
AI	https://github.com/resources/articles?topic=ai
Software Development	https://github.com/resources/articles?topic=software-development
DevOps	https://github.com/resources/articles?topic=devops
Security	https://github.com/resources/articles?topic=security
View all topics	https://github.com/resources/articles
Customer stories	https://github.com/customer-stories
Events & webinars	https://github.com/resources/events
Ebooks & reports	https://github.com/resources/whitepapers
Business insights	https://github.com/solutions/executive-insights
GitHub Skills	https://skills.github.com
Documentation	https://docs.github.com
Customer support	https://support.github.com
Community forum	https://github.com/orgs/community/discussions
Trust center	https://github.com/trust-center
Partners	https://github.com/partners
View all resources	https://github.com/resources
GitHub SponsorsFund open source developers	https://github.com/open-source/sponsors
Security Lab	https://securitylab.github.com
Maintainer Community	https://maintainers.github.com
Accelerator	https://github.com/open-source/accelerator
GitHub Stars	https://stars.github.com
Archive Program	https://archiveprogram.github.com
Topics	https://github.com/topics
Trending	https://github.com/trending
Collections	https://github.com/collections
Enterprise platformAI-powered developer platform	https://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security features	https://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI features	https://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 support	https://github.com/enterprise/premium-support
Pricing	https://github.com/pricing
Search syntax tips	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentation	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in	https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fstrlike%2Funsloth
Sign up	https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=strlike%2Funsloth
Reload	https://github.com/strlike/unsloth
Reload	https://github.com/strlike/unsloth
Reload	https://github.com/strlike/unsloth
strlike	https://github.com/strlike
unsloth	https://github.com/strlike/unsloth
unslothai/unsloth	https://github.com/unslothai/unsloth
Notifications	https://github.com/login?return_to=%2Fstrlike%2Funsloth
Fork 0	https://github.com/login?return_to=%2Fstrlike%2Funsloth
Star 0	https://github.com/login?return_to=%2Fstrlike%2Funsloth
Code	https://github.com/strlike/unsloth
Pull requests 0	https://github.com/strlike/unsloth/pulls
Actions	https://github.com/strlike/unsloth/actions
Projects	https://github.com/strlike/unsloth/projects
Security and quality 0	https://github.com/strlike/unsloth/security
Insights	https://github.com/strlike/unsloth/pulse
Code	https://github.com/strlike/unsloth
Pull requests	https://github.com/strlike/unsloth/pulls
Actions	https://github.com/strlike/unsloth/actions
Projects	https://github.com/strlike/unsloth/projects
Security and quality	https://github.com/strlike/unsloth/security
Insights	https://github.com/strlike/unsloth/pulse
	https://github.com/strlike/unsloth
Branches	https://github.com/strlike/unsloth/branches
Tags	https://github.com/strlike/unsloth/tags
	https://github.com/strlike/unsloth/branches
	https://github.com/strlike/unsloth/tags
1,073 Commits	https://github.com/strlike/unsloth/commits/main/
	https://github.com/strlike/unsloth/commits/main/
.github	https://github.com/strlike/unsloth/tree/main/.github
.github	https://github.com/strlike/unsloth/tree/main/.github
images	https://github.com/strlike/unsloth/tree/main/images
images	https://github.com/strlike/unsloth/tree/main/images
unsloth	https://github.com/strlike/unsloth/tree/main/unsloth
unsloth	https://github.com/strlike/unsloth/tree/main/unsloth
CONTRIBUTING.md	https://github.com/strlike/unsloth/blob/main/CONTRIBUTING.md
CONTRIBUTING.md	https://github.com/strlike/unsloth/blob/main/CONTRIBUTING.md
LICENSE	https://github.com/strlike/unsloth/blob/main/LICENSE
LICENSE	https://github.com/strlike/unsloth/blob/main/LICENSE
README.md	https://github.com/strlike/unsloth/blob/main/README.md
README.md	https://github.com/strlike/unsloth/blob/main/README.md
pyproject.toml	https://github.com/strlike/unsloth/blob/main/pyproject.toml
pyproject.toml	https://github.com/strlike/unsloth/blob/main/pyproject.toml
unsloth-cli.py	https://github.com/strlike/unsloth/blob/main/unsloth-cli.py
unsloth-cli.py	https://github.com/strlike/unsloth/blob/main/unsloth-cli.py
README	https://github.com/strlike/unsloth
Contributing	https://github.com/strlike/unsloth
License	https://github.com/strlike/unsloth
	https://unsloth.ai
	https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.1_(8B)-Alpaca.ipynb
	https://discord.gg/unsloth
	https://docs.unsloth.ai
	https://github.com/strlike/unsloth#finetune-llama-33-mistral-phi-4-qwen-25--gemma-2-5x-faster-with-80-less-memory
	https://camo.githubusercontent.com/438f375b4088134ece4e4efa4ad344bf5ef91f5c6dfcadf1faee4d193a8a4b29/68747470733a2f2f692e6962622e636f2f734a37526847472f696d6167652d34312e706e67
	https://github.com/strlike/unsloth#-finetune-for-free
▶️ Start for free	https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.2_(1B_and_3B)-Conversational.ipynb
▶️ Start for free	https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.1_(8B)-GRPO.ipynb
▶️ Start for free	https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Phi_4-Conversational.ipynb
▶️ Start for free	https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.2_(11B)-Vision.ipynb
▶️ Start for free	https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.1_(8B)-Alpaca.ipynb
▶️ Start for free	https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Gemma2_(9B)-Alpaca.ipynb
▶️ Start for free	https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen2.5_(7B)-Alpaca.ipynb
▶️ Start for free	https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Mistral_v0.3_(7B)-Conversational.ipynb
▶️ Start for free	https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3_(8B)-Ollama.ipynb
▶️ Start for free	https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Zephyr_(7B)-DPO.ipynb
all our notebooks	https://docs.unsloth.ai/get-started/unsloth-notebooks
all our models	https://docs.unsloth.ai/get-started/all-our-models
Llama 3.2 Kaggle notebook	https://www.kaggle.com/danielhanchen/kaggle-llama-3-2-1b-3b-unsloth-notebook
Llama 3.1 (8B)	https://www.kaggle.com/danielhanchen/kaggle-llama-3-1-8b-unsloth-notebook
Gemma 2 (9B)	https://www.kaggle.com/code/danielhanchen/kaggle-gemma-7b-unsloth-notebook/
Mistral (7B)	https://www.kaggle.com/code/danielhanchen/kaggle-mistral-7b-unsloth-notebook
Llama 3.2 conversational	https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.2_(1B_and_3B)-Conversational.ipynb
Llama 3.1 conversational	https://colab.research.google.com/drive/15OyFkGoCImV9dSsewU1wa2JuKB4-mDE_?usp=sharing
Mistral v0.3 ChatML	https://colab.research.google.com/drive/15F1xyn8497_dUbxZP4zWmPZ3PJx1Oymv?usp=sharing
text completion notebook	https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Mistral_(7B)-Text_Completion.ipynb
continued pretraining notebook	https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Mistral_v0.3_(7B)-CPT.ipynb
here	https://docs.unsloth.ai/
	https://github.com/strlike/unsloth#-unslothai-news
Reasoning	https://unsloth.ai/blog/r1-reasoning
DeepSeek-R1	https://unsloth.ai/blog/deepseek-r1
unsloth.ai/blog/deepseek-r1	https://unsloth.ai/blog/deepseek-r1
here	https://huggingface.co/collections/unsloth/deepseek-r1-all-versions-678e1c48f5d2fce87892ace5
Phi-4	https://unsloth.ai/blog/phi4
fixed bugs	https://unsloth.ai/blog/phi4
uploaded GGUFs, 4-bit	https://huggingface.co/collections/unsloth/phi-4-all-versions-677eecf93784e61afe762afa
Phi-4 Colab notebook	https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Phi_4-Conversational.ipynb
Llama 3.3 (70B)	https://huggingface.co/collections/unsloth/llama-33-all-versions-67535d7d994794b9d7cf5e9f
Cut Cross Entropy	https://arxiv.org/abs/2411.09009
Dynamic 4-bit Quantization	https://unsloth.ai/blog/dynamic-4bit
Hugging Face here.	https://huggingface.co/collections/unsloth/unsloth-4-bit-dynamic-quants-67503bb873f89e15276c44e7
Vision models	https://unsloth.ai/blog/vision
Llama 3.2 Vision (11B)	https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.2_(11B)-Vision.ipynb
Qwen 2.5 VL (7B)	https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen2_VL_(7B)-Vision.ipynb
Pixtral (12B) 2409	https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Pixtral_(12B)-Vision.ipynb
gradient accumulation bug	https://unsloth.ai/blog/gradient
Chat interface	https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Unsloth_Studio.ipynb
Coder	https://unsloth.ai/blog/qwen-coder
Qwen 2.5 conversational notebook	https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen2.5_Coder_(14B)-Conversational.ipynb
Mistral Small 22b notebook	https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Mistral_Small_(22B)-Alpaca.ipynb
pypi	https://pypi.org/project/unsloth/
notebook	https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Mistral_v0.3_(7B)-CPT.ipynb
2x faster inference	https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.1_(8B)-Inference.ipynb
further 30%	https://unsloth.ai/blog/long-context
4x longer context windows	https://unsloth.ai/blog/long-context
	https://github.com/strlike/unsloth#-links-and-resources
Read Our Docs	https://docs.unsloth.ai
	https://camo.githubusercontent.com/6bd1a70a9fe4b97ca51c4baa8ebb66d37d3d2532721a50b6b6e2959d79b2b1f6/68747470733a2f2f75706c6f61642e77696b696d656469612e6f72672f77696b6970656469612f636f6d6d6f6e732f362f36662f4c6f676f5f6f665f547769747465722e737667
Follow us on X	https://twitter.com/unslothai
unsloth/README.md	https://github.com/unslothai/unsloth/tree/main#-installation-instructions
Performance Tables	https://github.com/unslothai/unsloth/tree/main#-performance-benchmarking
Unsloth Releases	https://docs.unsloth.ai/get-started/all-our-models
Read our Blogs	https://unsloth.ai/blog
	https://camo.githubusercontent.com/425cd773f7662cf74a30d291c958315e295307b855e5966d56e67ee9f370d2e4/68747470733a2f2f726564646974696e632e636f6d2f68732d66732f68756266732f526564646974253230496e632f4272616e642f5265646469745f4c6f676f2e706e67
Join our Reddit page	https://reddit.com/r/unsloth
	https://github.com/strlike/unsloth#-key-features
OpenAI's Triton	https://openai.com/index/triton/
Check your GPU!	https://developer.nvidia.com/cuda-gpus
bitsandbytes	https://github.com/TimDettmers/bitsandbytes
Unsloth Pro	https://unsloth.ai/
	https://raw.githubusercontent.com/unslothai/unsloth/main/images/made with unsloth.png
	https://github.com/strlike/unsloth#-performance-benchmarking
Llama 3.3 Blog	https://unsloth.ai/blog/llama3-3
🤗Hugging Face	https://huggingface.co/blog/unsloth-trl
	https://camo.githubusercontent.com/438f375b4088134ece4e4efa4ad344bf5ef91f5c6dfcadf1faee4d193a8a4b29/68747470733a2f2f692e6962622e636f2f734a37526847472f696d6167652d34312e706e67
	https://github.com/strlike/unsloth#-installation-instructions
	https://github.com/strlike/unsloth#conda-installation
read here	https://docs.anaconda.com/miniconda/
	https://github.com/strlike/unsloth#pip-installation
	https://github.com/strlike/unsloth#windows-installation
https://github.com/woct0rdho/triton-windows	https://github.com/woct0rdho/triton-windows
https://pytorch.org	https://pytorch.org
https://github.com/facebookresearch/xformers	https://github.com/facebookresearch/xformers
Documentation	https://docs.unsloth.ai
	https://github.com/strlike/unsloth#-documentation
Documentation	https://docs.unsloth.ai
SFT docs	https://huggingface.co/docs/trl/main/en/sft_trainer#accelerate-fine-tuning-2x-using-unsloth
DPO docs	https://huggingface.co/docs/trl/main/en/dpo_trainer#accelerate-dpo-fine-tuning-using-unsloth
	https://github.com/strlike/unsloth#dpo-support
Llama-Factory	https://github.com/hiyouga/LLaMA-Factory
notebook	https://colab.research.google.com/drive/15vttTpzzVXv_tJwEk-hIcQ0S9FcEWvwP?usp=sharing
SFT docs	https://huggingface.co/docs/trl/main/en/sft_trainer#accelerate-fine-tuning-2x-using-unsloth
DPO docs	https://huggingface.co/docs/trl/main/en/dpo_trainer#accelerate-dpo-fine-tuning-using-unsloth
	https://github.com/strlike/unsloth#-detailed-benchmarking-tables
	https://github.com/strlike/unsloth#context-length-benchmarks
	https://github.com/strlike/unsloth#llama-31-8b-max-context-length
	https://github.com/strlike/unsloth#llama-33-70b-max-context-length
	https://camo.githubusercontent.com/438f375b4088134ece4e4efa4ad344bf5ef91f5c6dfcadf1faee4d193a8a4b29/68747470733a2f2f692e6962622e636f2f734a37526847472f696d6167652d34312e706e67
	https://github.com/strlike/unsloth#citation
	https://github.com/strlike/unsloth#thank-you-to
Erik	https://github.com/erikwijmans
Apple's ML Cross Entropy	https://github.com/apple/ml-cross-entropy
HuyNguyen-hust	https://github.com/HuyNguyen-hust
RoPE Embeddings 28% faster	https://github.com/unslothai/unsloth/pull/238
RandomInternetPreson	https://github.com/RandomInternetPreson
152334H	https://github.com/152334H
atgctg	https://github.com/atgctg
unsloth.ai	https://unsloth.ai
Readme	https://github.com/strlike/unsloth#readme-ov-file
Apache-2.0 license	https://github.com/strlike/unsloth#Apache-2.0-1-ov-file
Please reload this page	https://github.com/strlike/unsloth
Activity	https://github.com/strlike/unsloth/activity
0 forks	https://github.com/strlike/unsloth/forks
Report repository	https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Fstrlike%2Funsloth&report=strlike+%28user%29
Releases	https://github.com/strlike/unsloth/releases
Packages 0	https://github.com/users/strlike/packages?repo_name=unsloth
Please reload this page	https://github.com/strlike/unsloth
Contributors	https://github.com/strlike/unsloth/graphs/contributors
Please reload this page	https://github.com/strlike/unsloth
	https://github.com
Terms	https://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacy	https://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Security	https://github.com/security
Status	https://www.githubstatus.com/
Community	https://github.community/
Docs	https://docs.github.com/
Contact	https://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.