René's URL Explorer Experiment

Title: GitHub - Qudsystem/koboldcpp: Run GGUF models easily with a KoboldAI UI. One File. Zero Install. · GitHub

Open Graph Title: GitHub - Qudsystem/koboldcpp: Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

X Title: GitHub - Qudsystem/koboldcpp: Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Description: Run GGUF models easily with a KoboldAI UI. One File. Zero Install. - Qudsystem/koboldcpp

Open Graph Description: Run GGUF models easily with a KoboldAI UI. One File. Zero Install. - Qudsystem/koboldcpp

X Description: Run GGUF models easily with a KoboldAI UI. One File. Zero Install. - Qudsystem/koboldcpp

Opengraph URL: https://github.com/Qudsystem/koboldcpp

X: @github

direct link

Domain: github.com

route-pattern	/:user_id/:repository
route-controller	files
route-action	disambiguate
fetch-nonce	v2:16e32af2-8f6f-7701-4943-f0c61f94ffc7
current-catalog-service-hash	f3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-id	87D0:348BD7:36E51E8:4BF50E8:6A4F3AED
html-safe-nonce	e589a670c77199c69876d019d943085ef978bad4e28fc58536327e5f73659cc3
visitor-payload	eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI4N0QwOjM0OEJENzozNkU1MUU4OjRCRjUwRTg6NkE0RjNBRUQiLCJ2aXNpdG9yX2lkIjoiNjI2MDk2MDExOTA3NDI3NDAyOSIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmac	0bf480ae6d98d96720afc6caf6d48a388a99638f1a7643779c5d7d11386c1f45
hovercard-subject-tag	repository:1196818355
github-keyboard-shortcuts	repository,copilot
google-site-verification	Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-url	https://collector.github.com/github/collect
analytics-location	//
fb:app_id	1401488693436528
apple-itunes-app	app-id=1477376905, app-argument=https://github.com/Qudsystem/koboldcpp
twitter:image	https://opengraph.githubassets.com/b2494dc3ecc1ec1295a6cb75629c23ed2cbd4e1323b09a67ca7bf25941895a8c/Qudsystem/koboldcpp
twitter:card	summary_large_image
og:image	https://opengraph.githubassets.com/b2494dc3ecc1ec1295a6cb75629c23ed2cbd4e1323b09a67ca7bf25941895a8c/Qudsystem/koboldcpp
og:image:alt	Run GGUF models easily with a KoboldAI UI. One File. Zero Install. - Qudsystem/koboldcpp
og:image:width	1200
og:image:height	600
og:site_name	GitHub
og:type	object
hostname	github.com
expected-hostname	github.com
None	b92d11c0aa4a77d54ef4af1078b6a15fb5a70a215b30c4ecf28889d5a8e656d9
turbo-cache-control	no-cache
go-import	github.com/Qudsystem/koboldcpp git https://github.com/Qudsystem/koboldcpp.git
octolytics-dimension-user_id	163144520
octolytics-dimension-user_login	Qudsystem
octolytics-dimension-repository_id	1196818355
octolytics-dimension-repository_nwo	Qudsystem/koboldcpp
octolytics-dimension-repository_public	true
octolytics-dimension-repository_is_fork	true
octolytics-dimension-repository_parent_id	614637892
octolytics-dimension-repository_parent_nwo	LostRuins/koboldcpp
octolytics-dimension-repository_network_root_id	612354784
octolytics-dimension-repository_network_root_nwo	ggml-org/llama.cpp
turbo-body-classes	logged-out env-production page-responsive
disable-turbo	false
browser-stats-url	https://api.github.com/_private/browser/stats
browser-errors-url	https://api.github.com/_private/browser/errors
release	4b249b445842943ed31549e027f57a8ade9881ed
ui-target	full
theme-color	#1e2327
color-scheme	light dark

Links:

Skip to content	https://github.com/Qudsystem/koboldcpp#start-of-content
	https://github.com/
Sign in	https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FQudsystem%2Fkoboldcpp
GitHub CopilotWrite better code with AI	https://github.com/features/copilot
GitHub Copilot appDirect agents from issue to merge	https://github.com/features/ai/github-app
MCP RegistryNewIntegrate external tools	https://github.com/mcp
ActionsAutomate any workflow	https://github.com/features/actions
CodespacesInstant dev environments	https://github.com/features/codespaces
IssuesPlan and track work	https://github.com/features/issues
Code ReviewManage code changes	https://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilities	https://github.com/security/advanced-security
Code securitySecure your code as you build	https://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they start	https://github.com/security/advanced-security/secret-protection
Why GitHub	https://github.com/why-github
Documentation	https://docs.github.com
Blog	https://github.blog
Changelog	https://github.blog/changelog
Marketplace	https://github.com/marketplace
View all features	https://github.com/features
Enterprises	https://github.com/enterprise
Small and medium teams	https://github.com/team
Startups	https://github.com/enterprise/startups
Nonprofits	https://github.com/solutions/industry/nonprofits
App Modernization	https://github.com/solutions/use-case/app-modernization
DevSecOps	https://github.com/solutions/use-case/devsecops
DevOps	https://github.com/solutions/use-case/devops
CI/CD	https://github.com/solutions/use-case/ci-cd
View all use cases	https://github.com/solutions/use-case
Healthcare	https://github.com/solutions/industry/healthcare
Financial services	https://github.com/solutions/industry/financial-services
Manufacturing	https://github.com/solutions/industry/manufacturing
Government	https://github.com/solutions/industry/government
View all industries	https://github.com/solutions/industry
View all solutions	https://github.com/solutions
AI	https://github.com/resources/articles?topic=ai
Software Development	https://github.com/resources/articles?topic=software-development
DevOps	https://github.com/resources/articles?topic=devops
Security	https://github.com/resources/articles?topic=security
View all topics	https://github.com/resources/articles
Customer stories	https://github.com/customer-stories
Events & webinars	https://github.com/resources/events
Ebooks & reports	https://github.com/resources/whitepapers
Business insights	https://github.com/solutions/executive-insights
GitHub Skills	https://skills.github.com
Documentation	https://docs.github.com
Customer support	https://support.github.com
Community forum	https://github.com/orgs/community/discussions
Trust center	https://github.com/trust-center
Partners	https://github.com/partners
View all resources	https://github.com/resources
GitHub SponsorsFund open source developers	https://github.com/open-source/sponsors
Security Lab	https://securitylab.github.com
Maintainer Community	https://maintainers.github.com
Accelerator	https://github.com/open-source/accelerator
GitHub Stars	https://stars.github.com
Archive Program	https://archiveprogram.github.com
Topics	https://github.com/topics
Trending	https://github.com/trending
Collections	https://github.com/collections
Enterprise platformAI-powered developer platform	https://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security features	https://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI features	https://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 support	https://github.com/enterprise/premium-support
Pricing	https://github.com/pricing
Search syntax tips	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentation	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in	https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FQudsystem%2Fkoboldcpp
Sign up	https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=Qudsystem%2Fkoboldcpp
Reload	https://github.com/Qudsystem/koboldcpp
Reload	https://github.com/Qudsystem/koboldcpp
Reload	https://github.com/Qudsystem/koboldcpp
Please reload this page	https://github.com/Qudsystem/koboldcpp
Qudsystem	https://github.com/Qudsystem
koboldcpp	https://github.com/Qudsystem/koboldcpp
LostRuins/koboldcpp	https://github.com/LostRuins/koboldcpp
Notifications	https://github.com/login?return_to=%2FQudsystem%2Fkoboldcpp
Fork 0	https://github.com/login?return_to=%2FQudsystem%2Fkoboldcpp
Star 0	https://github.com/login?return_to=%2FQudsystem%2Fkoboldcpp
Code	https://github.com/Qudsystem/koboldcpp
Pull requests 0	https://github.com/Qudsystem/koboldcpp/pulls
Actions	https://github.com/Qudsystem/koboldcpp/actions
Projects	https://github.com/Qudsystem/koboldcpp/projects
Security and quality 0	https://github.com/Qudsystem/koboldcpp/security
Insights	https://github.com/Qudsystem/koboldcpp/pulse
Code	https://github.com/Qudsystem/koboldcpp
Pull requests	https://github.com/Qudsystem/koboldcpp/pulls
Actions	https://github.com/Qudsystem/koboldcpp/actions
Projects	https://github.com/Qudsystem/koboldcpp/projects
Security and quality	https://github.com/Qudsystem/koboldcpp/security
Insights	https://github.com/Qudsystem/koboldcpp/pulse
	https://github.com/Qudsystem/koboldcpp
Branches	https://github.com/Qudsystem/koboldcpp/branches
Tags	https://github.com/Qudsystem/koboldcpp/tags
	https://github.com/Qudsystem/koboldcpp/branches
	https://github.com/Qudsystem/koboldcpp/tags
12,252 Commits	https://github.com/Qudsystem/koboldcpp/commits/concedo/
	https://github.com/Qudsystem/koboldcpp/commits/concedo/
.devops	https://github.com/Qudsystem/koboldcpp/tree/concedo/.devops
.devops	https://github.com/Qudsystem/koboldcpp/tree/concedo/.devops
.github	https://github.com/Qudsystem/koboldcpp/tree/concedo/.github
.github	https://github.com/Qudsystem/koboldcpp/tree/concedo/.github
common	https://github.com/Qudsystem/koboldcpp/tree/concedo/common
common	https://github.com/Qudsystem/koboldcpp/tree/concedo/common
embd_res	https://github.com/Qudsystem/koboldcpp/tree/concedo/embd_res
embd_res	https://github.com/Qudsystem/koboldcpp/tree/concedo/embd_res
examples	https://github.com/Qudsystem/koboldcpp/tree/concedo/examples
examples	https://github.com/Qudsystem/koboldcpp/tree/concedo/examples
ggml	https://github.com/Qudsystem/koboldcpp/tree/concedo/ggml
ggml	https://github.com/Qudsystem/koboldcpp/tree/concedo/ggml
gguf-py	https://github.com/Qudsystem/koboldcpp/tree/concedo/gguf-py
gguf-py	https://github.com/Qudsystem/koboldcpp/tree/concedo/gguf-py
include	https://github.com/Qudsystem/koboldcpp/tree/concedo/include
include	https://github.com/Qudsystem/koboldcpp/tree/concedo/include
kcpp_adapters	https://github.com/Qudsystem/koboldcpp/tree/concedo/kcpp_adapters
kcpp_adapters	https://github.com/Qudsystem/koboldcpp/tree/concedo/kcpp_adapters
lib	https://github.com/Qudsystem/koboldcpp/tree/concedo/lib
lib	https://github.com/Qudsystem/koboldcpp/tree/concedo/lib
media	https://github.com/Qudsystem/koboldcpp/tree/concedo/media
media	https://github.com/Qudsystem/koboldcpp/tree/concedo/media
otherarch	https://github.com/Qudsystem/koboldcpp/tree/concedo/otherarch
otherarch	https://github.com/Qudsystem/koboldcpp/tree/concedo/otherarch
scripts/snapdragon/windows	https://github.com/Qudsystem/koboldcpp/tree/concedo/scripts/snapdragon/windows
scripts/snapdragon/windows	https://github.com/Qudsystem/koboldcpp/tree/concedo/scripts/snapdragon/windows
src	https://github.com/Qudsystem/koboldcpp/tree/concedo/src
src	https://github.com/Qudsystem/koboldcpp/tree/concedo/src
tests	https://github.com/Qudsystem/koboldcpp/tree/concedo/tests
tests	https://github.com/Qudsystem/koboldcpp/tree/concedo/tests
tools	https://github.com/Qudsystem/koboldcpp/tree/concedo/tools
tools	https://github.com/Qudsystem/koboldcpp/tree/concedo/tools
vendor	https://github.com/Qudsystem/koboldcpp/tree/concedo/vendor
vendor	https://github.com/Qudsystem/koboldcpp/tree/concedo/vendor
.clang-format	https://github.com/Qudsystem/koboldcpp/blob/concedo/.clang-format
.clang-format	https://github.com/Qudsystem/koboldcpp/blob/concedo/.clang-format
.editorconfig	https://github.com/Qudsystem/koboldcpp/blob/concedo/.editorconfig
.editorconfig	https://github.com/Qudsystem/koboldcpp/blob/concedo/.editorconfig
.gitignore	https://github.com/Qudsystem/koboldcpp/blob/concedo/.gitignore
.gitignore	https://github.com/Qudsystem/koboldcpp/blob/concedo/.gitignore
CMakeLists.txt	https://github.com/Qudsystem/koboldcpp/blob/concedo/CMakeLists.txt
CMakeLists.txt	https://github.com/Qudsystem/koboldcpp/blob/concedo/CMakeLists.txt
LICENSE.md	https://github.com/Qudsystem/koboldcpp/blob/concedo/LICENSE.md
LICENSE.md	https://github.com/Qudsystem/koboldcpp/blob/concedo/LICENSE.md
MIT_LICENSE_GGML_SDCPP_LLAMACPP_ONLY.md	https://github.com/Qudsystem/koboldcpp/blob/concedo/MIT_LICENSE_GGML_SDCPP_LLAMACPP_ONLY.md
MIT_LICENSE_GGML_SDCPP_LLAMACPP_ONLY.md	https://github.com/Qudsystem/koboldcpp/blob/concedo/MIT_LICENSE_GGML_SDCPP_LLAMACPP_ONLY.md
Makefile	https://github.com/Qudsystem/koboldcpp/blob/concedo/Makefile
Makefile	https://github.com/Qudsystem/koboldcpp/blob/concedo/Makefile
README.md	https://github.com/Qudsystem/koboldcpp/blob/concedo/README.md
README.md	https://github.com/Qudsystem/koboldcpp/blob/concedo/README.md
Remote-Link.cmd	https://github.com/Qudsystem/koboldcpp/blob/concedo/Remote-Link.cmd
Remote-Link.cmd	https://github.com/Qudsystem/koboldcpp/blob/concedo/Remote-Link.cmd
android_install.sh	https://github.com/Qudsystem/koboldcpp/blob/concedo/android_install.sh
android_install.sh	https://github.com/Qudsystem/koboldcpp/blob/concedo/android_install.sh
aria2c-win.exe	https://github.com/Qudsystem/koboldcpp/blob/concedo/aria2c-win.exe
aria2c-win.exe	https://github.com/Qudsystem/koboldcpp/blob/concedo/aria2c-win.exe
build-info.h	https://github.com/Qudsystem/koboldcpp/blob/concedo/build-info.h
build-info.h	https://github.com/Qudsystem/koboldcpp/blob/concedo/build-info.h
colab.ipynb	https://github.com/Qudsystem/koboldcpp/blob/concedo/colab.ipynb
colab.ipynb	https://github.com/Qudsystem/koboldcpp/blob/concedo/colab.ipynb
convert_hf_to_gguf.py	https://github.com/Qudsystem/koboldcpp/blob/concedo/convert_hf_to_gguf.py
convert_hf_to_gguf.py	https://github.com/Qudsystem/koboldcpp/blob/concedo/convert_hf_to_gguf.py
convert_hf_to_gguf_update.py	https://github.com/Qudsystem/koboldcpp/blob/concedo/convert_hf_to_gguf_update.py
convert_hf_to_gguf_update.py	https://github.com/Qudsystem/koboldcpp/blob/concedo/convert_hf_to_gguf_update.py
convert_llama_ggml_to_gguf.py	https://github.com/Qudsystem/koboldcpp/blob/concedo/convert_llama_ggml_to_gguf.py
convert_llama_ggml_to_gguf.py	https://github.com/Qudsystem/koboldcpp/blob/concedo/convert_llama_ggml_to_gguf.py
convert_lora_to_gguf.py	https://github.com/Qudsystem/koboldcpp/blob/concedo/convert_lora_to_gguf.py
convert_lora_to_gguf.py	https://github.com/Qudsystem/koboldcpp/blob/concedo/convert_lora_to_gguf.py
create_ver_file.bat	https://github.com/Qudsystem/koboldcpp/blob/concedo/create_ver_file.bat
create_ver_file.bat	https://github.com/Qudsystem/koboldcpp/blob/concedo/create_ver_file.bat
create_ver_file.sh	https://github.com/Qudsystem/koboldcpp/blob/concedo/create_ver_file.sh
create_ver_file.sh	https://github.com/Qudsystem/koboldcpp/blob/concedo/create_ver_file.sh
cudart64_110.dll	https://github.com/Qudsystem/koboldcpp/blob/concedo/cudart64_110.dll
cudart64_110.dll	https://github.com/Qudsystem/koboldcpp/blob/concedo/cudart64_110.dll
cudart64_12.dll	https://github.com/Qudsystem/koboldcpp/blob/concedo/cudart64_12.dll
cudart64_12.dll	https://github.com/Qudsystem/koboldcpp/blob/concedo/cudart64_12.dll
environment-nocuda.yaml	https://github.com/Qudsystem/koboldcpp/blob/concedo/environment-nocuda.yaml
environment-nocuda.yaml	https://github.com/Qudsystem/koboldcpp/blob/concedo/environment-nocuda.yaml
environment.yaml	https://github.com/Qudsystem/koboldcpp/blob/concedo/environment.yaml
environment.yaml	https://github.com/Qudsystem/koboldcpp/blob/concedo/environment.yaml
expose.cpp	https://github.com/Qudsystem/koboldcpp/blob/concedo/expose.cpp
expose.cpp	https://github.com/Qudsystem/koboldcpp/blob/concedo/expose.cpp
expose.h	https://github.com/Qudsystem/koboldcpp/blob/concedo/expose.h
expose.h	https://github.com/Qudsystem/koboldcpp/blob/concedo/expose.h
glslc-linux	https://github.com/Qudsystem/koboldcpp/blob/concedo/glslc-linux
glslc-linux	https://github.com/Qudsystem/koboldcpp/blob/concedo/glslc-linux
glslc.exe	https://github.com/Qudsystem/koboldcpp/blob/concedo/glslc.exe
glslc.exe	https://github.com/Qudsystem/koboldcpp/blob/concedo/glslc.exe
gpttype_adapter.cpp	https://github.com/Qudsystem/koboldcpp/blob/concedo/gpttype_adapter.cpp
gpttype_adapter.cpp	https://github.com/Qudsystem/koboldcpp/blob/concedo/gpttype_adapter.cpp
json_to_gbnf.py	https://github.com/Qudsystem/koboldcpp/blob/concedo/json_to_gbnf.py
json_to_gbnf.py	https://github.com/Qudsystem/koboldcpp/blob/concedo/json_to_gbnf.py
koboldcpp.py	https://github.com/Qudsystem/koboldcpp/blob/concedo/koboldcpp.py
koboldcpp.py	https://github.com/Qudsystem/koboldcpp/blob/concedo/koboldcpp.py
koboldcpp.sh	https://github.com/Qudsystem/koboldcpp/blob/concedo/koboldcpp.sh
koboldcpp.sh	https://github.com/Qudsystem/koboldcpp/blob/concedo/koboldcpp.sh
make_pyinstaller.bat	https://github.com/Qudsystem/koboldcpp/blob/concedo/make_pyinstaller.bat
make_pyinstaller.bat	https://github.com/Qudsystem/koboldcpp/blob/concedo/make_pyinstaller.bat
make_pyinstaller.sh	https://github.com/Qudsystem/koboldcpp/blob/concedo/make_pyinstaller.sh
make_pyinstaller.sh	https://github.com/Qudsystem/koboldcpp/blob/concedo/make_pyinstaller.sh
make_pyinstaller_cuda.bat	https://github.com/Qudsystem/koboldcpp/blob/concedo/make_pyinstaller_cuda.bat
make_pyinstaller_cuda.bat	https://github.com/Qudsystem/koboldcpp/blob/concedo/make_pyinstaller_cuda.bat
make_pyinstaller_cuda_oldpc.bat	https://github.com/Qudsystem/koboldcpp/blob/concedo/make_pyinstaller_cuda_oldpc.bat
make_pyinstaller_cuda_oldpc.bat	https://github.com/Qudsystem/koboldcpp/blob/concedo/make_pyinstaller_cuda_oldpc.bat
make_pyinstaller_oldpc.bat	https://github.com/Qudsystem/koboldcpp/blob/concedo/make_pyinstaller_oldpc.bat
make_pyinstaller_oldpc.bat	https://github.com/Qudsystem/koboldcpp/blob/concedo/make_pyinstaller_oldpc.bat
model_adapter.cpp	https://github.com/Qudsystem/koboldcpp/blob/concedo/model_adapter.cpp
model_adapter.cpp	https://github.com/Qudsystem/koboldcpp/blob/concedo/model_adapter.cpp
model_adapter.h	https://github.com/Qudsystem/koboldcpp/blob/concedo/model_adapter.h
model_adapter.h	https://github.com/Qudsystem/koboldcpp/blob/concedo/model_adapter.h
mypy.ini	https://github.com/Qudsystem/koboldcpp/blob/concedo/mypy.ini
mypy.ini	https://github.com/Qudsystem/koboldcpp/blob/concedo/mypy.ini
niko.ico	https://github.com/Qudsystem/koboldcpp/blob/concedo/niko.ico
niko.ico	https://github.com/Qudsystem/koboldcpp/blob/concedo/niko.ico
nikogreen.ico	https://github.com/Qudsystem/koboldcpp/blob/concedo/nikogreen.ico
nikogreen.ico	https://github.com/Qudsystem/koboldcpp/blob/concedo/nikogreen.ico
requirements.txt	https://github.com/Qudsystem/koboldcpp/blob/concedo/requirements.txt
requirements.txt	https://github.com/Qudsystem/koboldcpp/blob/concedo/requirements.txt
simplecpuinfo	https://github.com/Qudsystem/koboldcpp/blob/concedo/simplecpuinfo
simplecpuinfo	https://github.com/Qudsystem/koboldcpp/blob/concedo/simplecpuinfo
simplecpuinfo.cpp	https://github.com/Qudsystem/koboldcpp/blob/concedo/simplecpuinfo.cpp
simplecpuinfo.cpp	https://github.com/Qudsystem/koboldcpp/blob/concedo/simplecpuinfo.cpp
simplecpuinfo.exe	https://github.com/Qudsystem/koboldcpp/blob/concedo/simplecpuinfo.exe
simplecpuinfo.exe	https://github.com/Qudsystem/koboldcpp/blob/concedo/simplecpuinfo.exe
version.txt	https://github.com/Qudsystem/koboldcpp/blob/concedo/version.txt
version.txt	https://github.com/Qudsystem/koboldcpp/blob/concedo/version.txt
version_template.txt	https://github.com/Qudsystem/koboldcpp/blob/concedo/version_template.txt
version_template.txt	https://github.com/Qudsystem/koboldcpp/blob/concedo/version_template.txt
README	https://github.com/Qudsystem/koboldcpp
License	https://github.com/Qudsystem/koboldcpp
	https://github.com/Qudsystem/koboldcpp#koboldcpp
Download Releases Here	https://github.com/LostRuins/koboldcpp/releases/latest
	https://github.com/Qudsystem/koboldcpp/blob/concedo/media/preview.png
	https://github.com/Qudsystem/koboldcpp/blob/concedo/media/preview2.png
	https://github.com/Qudsystem/koboldcpp/blob/concedo/media/preview3.png
	https://github.com/Qudsystem/koboldcpp/blob/concedo/media/preview4.png
	https://github.com/Qudsystem/koboldcpp/blob/concedo/media/preview5.png
	https://github.com/Qudsystem/koboldcpp/blob/concedo/media/preview6.png
	https://github.com/Qudsystem/koboldcpp#features
Need help finding a model? Read this!	https://github.com/LostRuins/koboldcpp/wiki#getting-an-ai-model-file
	https://github.com/Qudsystem/koboldcpp#windows-usage-precompiled-binary-recommended
Download the latest koboldcpp.exe release here	https://github.com/LostRuins/koboldcpp/releases/latest
here	https://github.com/Qudsystem/koboldcpp#Obtaining-a-GGUF-model
http://localhost:5001	http://localhost:5001
	https://github.com/Qudsystem/koboldcpp#linux-usage-precompiled-binary-recommended
releases page	https://github.com/LostRuins/koboldcpp/releases/latest
here	https://github.com/Qudsystem/koboldcpp#Obtaining-a-GGUF-model
	https://github.com/Qudsystem/koboldcpp#macos-precompiled-binary
Simply download the MacOS binary	https://github.com/LostRuins/koboldcpp/releases/latest
Here's a video guide	https://youtube.com/watch?v=NOW5dyA_JgY
here	https://github.com/Qudsystem/koboldcpp#Obtaining-a-GGUF-model
	https://github.com/Qudsystem/koboldcpp#run-on-colab
Try it here!	https://colab.research.google.com/github/LostRuins/koboldcpp/blob/concedo/colab.ipynb
	https://github.com/Qudsystem/koboldcpp#run-on-runpod
Try our RunPod image here!	https://koboldai.org/runpodcpp
	https://github.com/Qudsystem/koboldcpp#docker
https://hub.docker.com/r/koboldai/koboldcpp	https://hub.docker.com/r/koboldai/koboldcpp
	https://github.com/Qudsystem/koboldcpp#obtaining-a-gguf-model
Bartowski's Huggingface	https://huggingface.co/bartowski
Qwen3-VL-8B	https://huggingface.co/unsloth/Qwen3-VL-8B-Instruct-GGUF/resolve/main/Qwen3-VL-8B-Instruct-Q4_K_S.gguf
L3-8B-Stheno-v3.2	https://huggingface.co/bartowski/L3-8B-Stheno-v3.2-GGUF/resolve/main/L3-8B-Stheno-v3.2-Q4_K_S.gguf
Tiefighter 13B	https://huggingface.co/KoboldAI/LLaMA2-13B-Tiefighter-GGUF/resolve/main/LLaMA2-13B-Tiefighter.Q4_K_S.gguf
Alternatively, you can download the tools to convert models to the GGUF format yourself here	https://kcpptools.concedo.workers.dev
can be found on the Wiki	https://github.com/LostRuins/koboldcpp/wiki#what-models-does-koboldcpp-support-what-architectures-are-supported
	https://github.com/Qudsystem/koboldcpp#improving-performance
check the wiki	https://github.com/LostRuins/koboldcpp/wiki
	https://github.com/Qudsystem/koboldcpp#compiling-koboldcpp-from-source-code
	https://github.com/Qudsystem/koboldcpp#compiling-on-linux-using-koboldcppsh-automated-compiler-script
	https://github.com/Qudsystem/koboldcpp#compiling-on-linux-manual-method
	https://github.com/Qudsystem/koboldcpp#compiling-on-windows
https://github.com/skeeto/w64devkit	https://github.com/skeeto/w64devkit
	https://github.com/Qudsystem/koboldcpp#compiling-on-macos
	https://github.com/Qudsystem/koboldcpp#compiling-on-openbsd
	https://github.com/Qudsystem/koboldcpp#compiling-on-android-termux-installation
First, Install and run Termux from F-Droid	https://f-droid.org/en/packages/com.termux/
	https://github.com/Qudsystem/koboldcpp#termux-quick-setup-script-easy-setup
	https://github.com/Qudsystem/koboldcpp#termux-manual-instructions-diy-setup
	https://github.com/Qudsystem/koboldcpp#amd-users
https://github.com/YellowRoseCx/koboldcpp-rocm	https://github.com/YellowRoseCx/koboldcpp-rocm
	https://github.com/Qudsystem/koboldcpp#third-party-resources
CUBLAS	https://aur.archlinux.org/packages/koboldcpp-cuda
HIPBLAS	https://aur.archlinux.org/packages/koboldcpp-hipblas
korewaChino	https://github.com/korewaChino/koboldCppDocker
noneabove1182	https://github.com/noneabove1182/koboldcpp-docker
Example Nix Setup and further information	https://github.com/Qudsystem/koboldcpp/blob/concedo/examples/nix_example.md
here	https://github.com/NixOS/nixpkgs/issues/new?assignees=&labels=0.kind%3A+bug&projects=&template=bug_report.md&title=
GPTLocalhost	https://gptlocalhost.com/demo#KoboldCpp
	https://github.com/Qudsystem/koboldcpp#questions-and-help-wiki
The KoboldCpp FAQ and Knowledgebase	https://github.com/LostRuins/koboldcpp/wiki
KoboldAI Discord	https://koboldai.org/discord
	https://github.com/Qudsystem/koboldcpp#koboldcpp-and-koboldai-api-documentation
Documentation for KoboldAI and KoboldCpp endpoints can be found here	https://lite.koboldai.net/koboldcpp_api
	https://github.com/Qudsystem/koboldcpp#koboldcpp-public-demo
A public KoboldCpp demo can be found at our Huggingface Space. Please do not abuse it.	https://koboldai-koboldcpp-tiefighter.hf.space/
	https://github.com/Qudsystem/koboldcpp#considerations
	https://github.com/Qudsystem/koboldcpp#license
https://github.com/ggml-org/llama.cpp	https://github.com/ggml-org/llama.cpp
https://github.com/leejet/stable-diffusion.cpp	https://github.com/leejet/stable-diffusion.cpp
https://github.com/mmwillet/TTS.cpp	https://github.com/mmwillet/TTS.cpp
https://github.com/predict-woo/qwen3-tts.cpp	https://github.com/predict-woo/qwen3-tts.cpp
https://github.com/ServeurpersoCom/acestep.cpp	https://github.com/ServeurpersoCom/acestep.cpp
https://github.com/LostRuins/koboldcpp	https://github.com/LostRuins/koboldcpp
https://github.com/LostRuins/lite.koboldai.net	https://github.com/LostRuins/lite.koboldai.net
	https://github.com/Qudsystem/koboldcpp#notes
https://lite.koboldai.net/koboldcpp_api	https://lite.koboldai.net/koboldcpp_api
	https://github.com/Qudsystem/koboldcpp#where-can-i-download-ai-model-files
L3-8B-Stheno-v3.2	https://huggingface.co/bartowski/L3-8B-Stheno-v3.2-GGUF/resolve/main/L3-8B-Stheno-v3.2-Q4_K_S.gguf
Tiefighter 13B	https://huggingface.co/KoboldAI/LLaMA2-13B-Tiefighter-GGUF/resolve/main/LLaMA2-13B-Tiefighter.Q4_K_S.gguf
Gemma-3-27B Abliterated	https://huggingface.co/mlabonne/gemma-3-27b-it-abliterated-GGUF/resolve/main/gemma-3-27b-it-abliterated.q4_k_m.gguf
Anything v3	https://huggingface.co/admruul/anything-v3.0/resolve/main/Anything-V3.0-pruned-fp16.safetensors
Deliberate V2	https://huggingface.co/Yntec/Deliberate2/resolve/main/Deliberate_v2.safetensors
Dreamshaper SDXL	https://huggingface.co/Lykon/dreamshaper-xl-v2-turbo/resolve/main/DreamShaperXL_Turbo_v2_1.safetensors
Pick the correct one for your model architecture here	https://huggingface.co/koboldcpp/mmproj/tree/main
Whisper models for Speech-To-Text	https://huggingface.co/koboldcpp/whisper/tree/main
TTS models for Narration	https://huggingface.co/koboldcpp/tts/tree/main
github.com/LostRuins/koboldcpp/releases/latest	https://github.com/LostRuins/koboldcpp/releases/latest
Readme	https://github.com/Qudsystem/koboldcpp#readme-ov-file
AGPL-3.0 license	https://github.com/Qudsystem/koboldcpp#AGPL-3.0-1-ov-file
Please reload this page	https://github.com/Qudsystem/koboldcpp
Activity	https://github.com/Qudsystem/koboldcpp/activity
Custom properties	https://github.com/Qudsystem/koboldcpp/custom-properties
0 forks	https://github.com/Qudsystem/koboldcpp/forks
Report repository	https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2FQudsystem%2Fkoboldcpp&report=Qudsystem+%28user%29
Releases	https://github.com/Qudsystem/koboldcpp/releases
Packages 0	https://github.com/orgs/Qudsystem/packages?repo_name=koboldcpp
Please reload this page	https://github.com/Qudsystem/koboldcpp
Contributors	https://github.com/Qudsystem/koboldcpp/graphs/contributors
Please reload this page	https://github.com/Qudsystem/koboldcpp
	https://github.com
Terms	https://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacy	https://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Security	https://github.com/security
Status	https://www.githubstatus.com/
Community	https://github.community/
Docs	https://docs.github.com/
Contact	https://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.