René's URL Explorer Experiment

Title: GitHub - SmartUser001/koboldcpp: 使用KoboldAI UI运行GGUF模型

Open Graph Title: GitHub - SmartUser001/koboldcpp: 使用KoboldAI UI运行GGUF模型

X Title: GitHub - SmartUser001/koboldcpp: 使用KoboldAI UI运行GGUF模型

Description: 使用KoboldAI UI运行GGUF模型. Contribute to SmartUser001/koboldcpp development by creating an account on GitHub.

Open Graph Description: 使用KoboldAI UI运行GGUF模型. Contribute to SmartUser001/koboldcpp development by creating an account on GitHub.

X Description: 使用KoboldAI UI运行GGUF模型. Contribute to SmartUser001/koboldcpp development by creating an account on GitHub.

Opengraph URL: https://github.com/SmartUser001/koboldcpp

X: @github

direct link

Domain: patch-diff.githubusercontent.com

route-pattern	/:user_id/:repository
route-controller	files
route-action	disambiguate
fetch-nonce	v2:7d924b9c-b2b6-c0d8-8aa8-d50b79cd9741
current-catalog-service-hash	f3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-id	E72C:242157:3030952:3F014C0:69749E98
html-safe-nonce	89adf8884940d71095ab1a3b4a7847f2356abcc1c63012d80c3689ca0080b64d
visitor-payload	eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJFNzJDOjI0MjE1NzozMDMwOTUyOjNGMDE0QzA6Njk3NDlFOTgiLCJ2aXNpdG9yX2lkIjoiNDY3NzI1NjM3NTM3MTYwMzYwOCIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmac	6fd1177e6b5b8ed0052b0b73978847c662df56a44a669641221c8521c352cbda
hovercard-subject-tag	repository:937622862
github-keyboard-shortcuts	repository,copilot
google-site-verification	Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-url	https://collector.github.com/github/collect
analytics-location	//
fb:app_id	1401488693436528
apple-itunes-app	app-id=1477376905, app-argument=https://github.com/SmartUser001/koboldcpp
twitter:image	https://opengraph.githubassets.com/aa833e86739417518c9e29db0f7466224ec001af11a4486e33bab73505160306/SmartUser001/koboldcpp
twitter:card	summary_large_image
og:image	https://opengraph.githubassets.com/aa833e86739417518c9e29db0f7466224ec001af11a4486e33bab73505160306/SmartUser001/koboldcpp
og:image:alt	使用KoboldAI UI运行GGUF模型. Contribute to SmartUser001/koboldcpp development by creating an account on GitHub.
og:image:width	1200
og:image:height	600
og:site_name	GitHub
og:type	object
hostname	github.com
expected-hostname	github.com
None	4a4bf5f4e28041a9d2e5c107d7d20b78b4294ba261cab243b28167c16a623a1f
turbo-cache-control	no-preview
go-import	github.com/SmartUser001/koboldcpp git https://github.com/SmartUser001/koboldcpp.git
octolytics-dimension-user_id	193355484
octolytics-dimension-user_login	SmartUser001
octolytics-dimension-repository_id	937622862
octolytics-dimension-repository_nwo	SmartUser001/koboldcpp
octolytics-dimension-repository_public	true
octolytics-dimension-repository_is_fork	true
octolytics-dimension-repository_parent_id	614637892
octolytics-dimension-repository_parent_nwo	LostRuins/koboldcpp
octolytics-dimension-repository_network_root_id	612354784
octolytics-dimension-repository_network_root_nwo	ggml-org/llama.cpp
turbo-body-classes	logged-out env-production page-responsive
disable-turbo	false
browser-stats-url	https://api.github.com/_private/browser/stats
browser-errors-url	https://api.github.com/_private/browser/errors
release	488b30e96dfd057fbbe44c6665ccbc030b729dde
ui-target	full
theme-color	#1e2327
color-scheme	light dark

Links:

Skip to content	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#start-of-content
	https://patch-diff.githubusercontent.com/
Sign in	https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2FSmartUser001%2Fkoboldcpp
GitHub CopilotWrite better code with AI	https://github.com/features/copilot
GitHub SparkBuild and deploy intelligent apps	https://github.com/features/spark
GitHub ModelsManage and compare prompts	https://github.com/features/models
MCP RegistryNewIntegrate external tools	https://github.com/mcp
ActionsAutomate any workflow	https://github.com/features/actions
CodespacesInstant dev environments	https://github.com/features/codespaces
IssuesPlan and track work	https://github.com/features/issues
Code ReviewManage code changes	https://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilities	https://github.com/security/advanced-security
Code securitySecure your code as you build	https://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they start	https://github.com/security/advanced-security/secret-protection
Why GitHub	https://github.com/why-github
Documentation	https://docs.github.com
Blog	https://github.blog
Changelog	https://github.blog/changelog
Marketplace	https://github.com/marketplace
View all features	https://github.com/features
Enterprises	https://github.com/enterprise
Small and medium teams	https://github.com/team
Startups	https://github.com/enterprise/startups
Nonprofits	https://github.com/solutions/industry/nonprofits
App Modernization	https://github.com/solutions/use-case/app-modernization
DevSecOps	https://github.com/solutions/use-case/devsecops
DevOps	https://github.com/solutions/use-case/devops
CI/CD	https://github.com/solutions/use-case/ci-cd
View all use cases	https://github.com/solutions/use-case
Healthcare	https://github.com/solutions/industry/healthcare
Financial services	https://github.com/solutions/industry/financial-services
Manufacturing	https://github.com/solutions/industry/manufacturing
Government	https://github.com/solutions/industry/government
View all industries	https://github.com/solutions/industry
View all solutions	https://github.com/solutions
AI	https://github.com/resources/articles?topic=ai
Software Development	https://github.com/resources/articles?topic=software-development
DevOps	https://github.com/resources/articles?topic=devops
Security	https://github.com/resources/articles?topic=security
View all topics	https://github.com/resources/articles
Customer stories	https://github.com/customer-stories
Events & webinars	https://github.com/resources/events
Ebooks & reports	https://github.com/resources/whitepapers
Business insights	https://github.com/solutions/executive-insights
GitHub Skills	https://skills.github.com
Documentation	https://docs.github.com
Customer support	https://support.github.com
Community forum	https://github.com/orgs/community/discussions
Trust center	https://github.com/trust-center
Partners	https://github.com/partners
GitHub SponsorsFund open source developers	https://github.com/sponsors
Security Lab	https://securitylab.github.com
Maintainer Community	https://maintainers.github.com
Accelerator	https://github.com/accelerator
Archive Program	https://archiveprogram.github.com
Topics	https://github.com/topics
Trending	https://github.com/trending
Collections	https://github.com/collections
Enterprise platformAI-powered developer platform	https://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security features	https://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI features	https://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 support	https://github.com/premium-support
Pricing	https://github.com/pricing
Search syntax tips	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentation	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in	https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2FSmartUser001%2Fkoboldcpp
Sign up	https://patch-diff.githubusercontent.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=SmartUser001%2Fkoboldcpp
Reload	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp
Reload	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp
Reload	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp
SmartUser001	https://patch-diff.githubusercontent.com/SmartUser001
koboldcpp	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp
LostRuins/koboldcpp	https://patch-diff.githubusercontent.com/LostRuins/koboldcpp
Notifications	https://patch-diff.githubusercontent.com/login?return_to=%2FSmartUser001%2Fkoboldcpp
Fork 0	https://patch-diff.githubusercontent.com/login?return_to=%2FSmartUser001%2Fkoboldcpp
Star 0	https://patch-diff.githubusercontent.com/login?return_to=%2FSmartUser001%2Fkoboldcpp
github.com/lostruins/koboldcpp	https://github.com/lostruins/koboldcpp
AGPL-3.0 license	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/LICENSE.md
0 stars	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/stargazers
14.6k forks	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/forks
Branches	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/branches
Tags	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tags
Activity	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/activity
Star	https://patch-diff.githubusercontent.com/login?return_to=%2FSmartUser001%2Fkoboldcpp
Notifications	https://patch-diff.githubusercontent.com/login?return_to=%2FSmartUser001%2Fkoboldcpp
Code	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp
Pull requests 0	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/pulls
Actions	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/actions
Projects 0	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/projects
Security 0	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/security
Insights	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/pulse
Code	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp
Pull requests	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/pulls
Actions	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/actions
Projects	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/projects
Security	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/security
Insights	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/pulse
Branches	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/branches
Tags	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tags
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/branches
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tags
7,015 Commits	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/commits/concedo/
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/commits/concedo/
.devops/nix	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tree/concedo/.devops/nix
.devops/nix	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tree/concedo/.devops/nix
.github	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tree/concedo/.github
.github	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tree/concedo/.github
common	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tree/concedo/common
common	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tree/concedo/common
docs/backend	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tree/concedo/docs/backend
docs/backend	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tree/concedo/docs/backend
examples	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tree/concedo/examples
examples	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tree/concedo/examples
ggml	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tree/concedo/ggml
ggml	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tree/concedo/ggml
gguf-py	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tree/concedo/gguf-py
gguf-py	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tree/concedo/gguf-py
include	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tree/concedo/include
include	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tree/concedo/include
kcpp_adapters	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tree/concedo/kcpp_adapters
kcpp_adapters	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tree/concedo/kcpp_adapters
lib	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tree/concedo/lib
lib	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tree/concedo/lib
media	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tree/concedo/media
media	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tree/concedo/media
models/templates	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tree/concedo/models/templates
models/templates	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tree/concedo/models/templates
otherarch	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tree/concedo/otherarch
otherarch	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tree/concedo/otherarch
src	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tree/concedo/src
src	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tree/concedo/src
.clang-format	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/.clang-format
.clang-format	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/.clang-format
.editorconfig	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/.editorconfig
.editorconfig	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/.editorconfig
.gitignore	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/.gitignore
.gitignore	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/.gitignore
CLINFO_LICENSE	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/CLINFO_LICENSE
CLINFO_LICENSE	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/CLINFO_LICENSE
CMakeLists.txt	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/CMakeLists.txt
CMakeLists.txt	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/CMakeLists.txt
LICENSE.md	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/LICENSE.md
LICENSE.md	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/LICENSE.md
MIT_LICENSE_GGML_LLAMACPP_ONLY	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/MIT_LICENSE_GGML_LLAMACPP_ONLY
MIT_LICENSE_GGML_LLAMACPP_ONLY	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/MIT_LICENSE_GGML_LLAMACPP_ONLY
Makefile	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/Makefile
Makefile	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/Makefile
OpenCL.dll	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/OpenCL.dll
OpenCL.dll	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/OpenCL.dll
README.md	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/README.md
README.md	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/README.md
Remote-Link.cmd	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/Remote-Link.cmd
Remote-Link.cmd	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/Remote-Link.cmd
build-info.h	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/build-info.h
build-info.h	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/build-info.h
clblast.dll	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/clblast.dll
clblast.dll	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/clblast.dll
colab.ipynb	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/colab.ipynb
colab.ipynb	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/colab.ipynb
convert_hf_to_gguf.py	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/convert_hf_to_gguf.py
convert_hf_to_gguf.py	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/convert_hf_to_gguf.py
convert_hf_to_gguf_update.py	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/convert_hf_to_gguf_update.py
convert_hf_to_gguf_update.py	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/convert_hf_to_gguf_update.py
convert_llama_ggml_to_gguf.py	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/convert_llama_ggml_to_gguf.py
convert_llama_ggml_to_gguf.py	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/convert_llama_ggml_to_gguf.py
convert_lora_to_gguf.py	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/convert_lora_to_gguf.py
convert_lora_to_gguf.py	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/convert_lora_to_gguf.py
create_ver_file.bat	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/create_ver_file.bat
create_ver_file.bat	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/create_ver_file.bat
create_ver_file.sh	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/create_ver_file.sh
create_ver_file.sh	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/create_ver_file.sh
cudart64_110.dll	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/cudart64_110.dll
cudart64_110.dll	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/cudart64_110.dll
cudart64_12.dll	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/cudart64_12.dll
cudart64_12.dll	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/cudart64_12.dll
environment.yaml	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/environment.yaml
environment.yaml	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/environment.yaml
expose.cpp	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/expose.cpp
expose.cpp	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/expose.cpp
expose.h	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/expose.h
expose.h	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/expose.h
glslc.exe	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/glslc.exe
glslc.exe	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/glslc.exe
gpttype_adapter.cpp	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/gpttype_adapter.cpp
gpttype_adapter.cpp	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/gpttype_adapter.cpp
kcpp_docs.embd	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/kcpp_docs.embd
kcpp_docs.embd	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/kcpp_docs.embd
kcpp_sdui.embd	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/kcpp_sdui.embd
kcpp_sdui.embd	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/kcpp_sdui.embd
klite.embd	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/klite.embd
klite.embd	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/klite.embd
koboldcpp.py	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/koboldcpp.py
koboldcpp.py	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/koboldcpp.py
koboldcpp.sh	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/koboldcpp.sh
koboldcpp.sh	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/koboldcpp.sh
make_pyinstaller.bat	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/make_pyinstaller.bat
make_pyinstaller.bat	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/make_pyinstaller.bat
make_pyinstaller.sh	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/make_pyinstaller.sh
make_pyinstaller.sh	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/make_pyinstaller.sh
make_pyinstaller_cuda.bat	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/make_pyinstaller_cuda.bat
make_pyinstaller_cuda.bat	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/make_pyinstaller_cuda.bat
make_pyinstaller_cuda12.bat	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/make_pyinstaller_cuda12.bat
make_pyinstaller_cuda12.bat	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/make_pyinstaller_cuda12.bat
make_pyinstaller_cuda_oldcpu.bat	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/make_pyinstaller_cuda_oldcpu.bat
make_pyinstaller_cuda_oldcpu.bat	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/make_pyinstaller_cuda_oldcpu.bat
model_adapter.cpp	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/model_adapter.cpp
model_adapter.cpp	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/model_adapter.cpp
model_adapter.h	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/model_adapter.h
model_adapter.h	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/model_adapter.h
msvcp140.dll	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/msvcp140.dll
msvcp140.dll	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/msvcp140.dll
msvcp140_codecvt_ids.dll	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/msvcp140_codecvt_ids.dll
msvcp140_codecvt_ids.dll	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/msvcp140_codecvt_ids.dll
mypy.ini	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/mypy.ini
mypy.ini	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/mypy.ini
niko.ico	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/niko.ico
niko.ico	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/niko.ico
nikogreen.ico	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/nikogreen.ico
nikogreen.ico	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/nikogreen.ico
requirements.txt	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/requirements.txt
requirements.txt	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/requirements.txt
rwkv_vocab.embd	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/rwkv_vocab.embd
rwkv_vocab.embd	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/rwkv_vocab.embd
rwkv_world_vocab.embd	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/rwkv_world_vocab.embd
rwkv_world_vocab.embd	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/rwkv_world_vocab.embd
simpleclinfo.cpp	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/simpleclinfo.cpp
simpleclinfo.cpp	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/simpleclinfo.cpp
taesd.embd	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/taesd.embd
taesd.embd	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/taesd.embd
taesd_3.embd	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/taesd_3.embd
taesd_3.embd	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/taesd_3.embd
taesd_f.embd	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/taesd_f.embd
taesd_f.embd	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/taesd_f.embd
taesd_xl.embd	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/taesd_xl.embd
taesd_xl.embd	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/taesd_xl.embd
vcruntime140.dll	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/vcruntime140.dll
vcruntime140.dll	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/vcruntime140.dll
vcruntime140_1.dll	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/vcruntime140_1.dll
vcruntime140_1.dll	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/vcruntime140_1.dll
version.txt	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/version.txt
version.txt	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/version.txt
version_template.txt	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/version_template.txt
version_template.txt	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/version_template.txt
vulkan-1.dll	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/vulkan-1.dll
vulkan-1.dll	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/vulkan-1.dll
winclinfo.exe	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/winclinfo.exe
winclinfo.exe	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/winclinfo.exe
README	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp
License	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#koboldcpp
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/media/preview.png
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/media/preview2.png
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/media/preview3.png
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/media/preview4.png
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#features
Need help finding a model? Read this!	https://github.com/LostRuins/koboldcpp/wiki#getting-an-ai-model-file
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#windows-usage-precompiled-binary-recommended
Download the latest koboldcpp.exe release here	https://github.com/LostRuins/koboldcpp/releases/latest
here	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#Obtaining-a-GGUF-model
http://localhost:5001	http://localhost:5001
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#linux-usage-precompiled-binary-recommended
releases page	https://github.com/LostRuins/koboldcpp/releases/latest
here	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#Obtaining-a-GGUF-model
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#macos-precompiled-binary
Simply download the MacOS binary	https://github.com/LostRuins/koboldcpp/releases/latest
Here's a video guide	https://youtube.com/watch?v=NOW5dyA_JgY
here	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#Obtaining-a-GGUF-model
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#run-on-colab
Try it here!	https://colab.research.google.com/github/LostRuins/koboldcpp/blob/concedo/colab.ipynb
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#run-on-runpod
Try our RunPod image here!	https://koboldai.org/runpodcpp
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#run-on-novita-ai
Check it out here!	https://koboldai.org/novitacpp
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#docker
https://hub.docker.com/r/koboldai/koboldcpp	https://hub.docker.com/r/koboldai/koboldcpp
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#obtaining-a-gguf-model
TheBloke's Huggingface	https://huggingface.co/TheBloke
Airoboros Mistral 7B	https://huggingface.co/TheBloke/airoboros-mistral2.2-7B-GGUF/resolve/main/airoboros-mistral2.2-7b.Q4_K_S.gguf
Tiefighter 13B	https://huggingface.co/KoboldAI/LLaMA2-13B-Tiefighter-GGUF/resolve/main/LLaMA2-13B-Tiefighter.Q4_K_S.gguf
Beepo 22B	https://huggingface.co/concedo/Beepo-22B-GGUF/resolve/main/Beepo-22B-Q4_K_S.gguf
Alternatively, you can download the tools to convert models to the GGUF format yourself here	https://kcpptools.concedo.workers.dev
can be found on the Wiki	https://github.com/LostRuins/koboldcpp/wiki#what-models-does-koboldcpp-support-what-architectures-are-supported
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#improving-performance
check the wiki	https://github.com/LostRuins/koboldcpp/wiki
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#compiling-koboldcpp-from-source-code
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#compiling-on-linux-using-koboldcppsh-automated-compiler-script
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#compiling-on-linux-manual-method
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#compiling-on-windows
https://github.com/skeeto/w64devkit	https://github.com/skeeto/w64devkit
https://github.com/KhronosGroup/OpenCL-SDK	https://github.com/KhronosGroup/OpenCL-SDK
https://github.com/CNugteren/CLBlast	https://github.com/CNugteren/CLBlast
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#compiling-on-macos
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#compiling-on-android-termux-installation
Install and run Termux from F-Droid	https://f-droid.org/en/packages/com.termux/
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#amd-users
https://github.com/YellowRoseCx/koboldcpp-rocm	https://github.com/YellowRoseCx/koboldcpp-rocm
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#third-party-resources
CUBLAS	https://aur.archlinux.org/packages/koboldcpp-cuda
HIPBLAS	https://aur.archlinux.org/packages/koboldcpp-hipblas
korewaChino	https://github.com/korewaChino/koboldCppDocker
noneabove1182	https://github.com/noneabove1182/koboldcpp-docker
Example Nix Setup and further information	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/blob/concedo/examples/nix_example.md
here	https://github.com/NixOS/nixpkgs/issues/new?assignees=&labels=0.kind%3A+bug&projects=&template=bug_report.md&title=
GPTLocalhost	https://gptlocalhost.com/demo#KoboldCpp
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#questions-and-help-wiki
The KoboldCpp FAQ and Knowledgebase	https://github.com/LostRuins/koboldcpp/wiki
KoboldAI Discord	https://koboldai.org/discord
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#koboldcpp-and-koboldai-api-documentation
Documentation for KoboldAI and KoboldCpp endpoints can be found here	https://lite.koboldai.net/koboldcpp_api
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#koboldcpp-public-demo
A public KoboldCpp demo can be found at our Huggingface Space. Please do not abuse it.	https://koboldai-koboldcpp-tiefighter.hf.space/
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#considerations
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#license
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#notes
https://lite.koboldai.net/koboldcpp_api	https://lite.koboldai.net/koboldcpp_api
	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#where-can-i-download-ai-model-files
Airoboros Mistral 7B	https://huggingface.co/TheBloke/airoboros-mistral2.2-7B-GGUF/resolve/main/airoboros-mistral2.2-7b.Q4_K_S.gguf
Tiefighter 13B	https://huggingface.co/KoboldAI/LLaMA2-13B-Tiefighter-GGUF/resolve/main/LLaMA2-13B-Tiefighter.Q4_K_S.gguf
Beepo 22B	https://huggingface.co/concedo/Beepo-22B-GGUF/resolve/main/Beepo-22B-Q4_K_S.gguf
Anything v3	https://huggingface.co/admruul/anything-v3.0/resolve/main/Anything-V3.0-pruned-fp16.safetensors
Deliberate V2	https://huggingface.co/Yntec/Deliberate2/resolve/main/Deliberate_v2.safetensors
Dreamshaper SDXL	https://huggingface.co/Lykon/dreamshaper-xl-v2-turbo/resolve/main/DreamShaperXL_Turbo_v2_1.safetensors
Pick the correct one for your model architecture here	https://huggingface.co/koboldcpp/mmproj/tree/main
Whisper models for Speech-To-Text	https://huggingface.co/koboldcpp/whisper/tree/main
TTS models for Narration	https://huggingface.co/koboldcpp/tts/tree/main
github.com/lostruins/koboldcpp	https://github.com/lostruins/koboldcpp
Readme	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#readme-ov-file
AGPL-3.0 license	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp#AGPL-3.0-1-ov-file
Please reload this page	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp
Activity	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/activity
0 stars	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/stargazers
0 watching	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/watchers
0 forks	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/forks
Report repository	https://patch-diff.githubusercontent.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2FSmartUser001%2Fkoboldcpp&report=SmartUser001+%28user%29
Releases	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/releases
262 tags	https://patch-diff.githubusercontent.com/SmartUser001/koboldcpp/tags
Packages 0	https://patch-diff.githubusercontent.com/users/SmartUser001/packages?repo_name=koboldcpp
	https://github.com
Terms	https://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacy	https://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Security	https://github.com/security
Status	https://www.githubstatus.com/
Community	https://github.community/
Docs	https://docs.github.com/
Contact	https://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.