| react-profiling | 0 |
| react-import-map | react,react-dom,react-dom/client,react-dom/profiling,react-is,react-reconciler,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@d5750093facf |
| route-pattern | /:user_id/:repository |
| route-controller | files |
| route-action | disambiguate |
| fetch-nonce | v2:7cd23fb0-3615-ba65-7979-3f4da7980db0 |
| current-catalog-service-hash | f3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb |
| request-id | 8FAE:C4292:1BF3AA:265718:6AEC719D |
| html-safe-nonce | 81950382e45c119efddca886bda881c5e9f958836a70744955e3df2ae49c6a59 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI4RkFFOkM0MjkyOjFCRjNBQToyNjU3MTg6NkFFQzcxOUQiLCJ2aXNpdG9yX2lkIjoiMTc0ODAzODI2NDE2MzE2ODI5IiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0= |
| visitor-hmac | fbc5afa6ef2265434b3813077ab52a94ff25e058fc044d0284309296e594da0f |
| hovercard-subject-tag | repository:1276110165 |
| github-keyboard-shortcuts | repository,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | // |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/eullm/llama.cpp |
| twitter:image | https://opengraph.githubassets.com/680e5593d974ff2f82f5befe7ea7919d543abf3a8dc0625cb3225a82d9696e78/eullm/llama.cpp |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/680e5593d974ff2f82f5befe7ea7919d543abf3a8dc0625cb3225a82d9696e78/eullm/llama.cpp |
| og:image:alt | EU-hosted daily mirror of ggml-org/llama.cpp — not a fork - eullm/llama.cpp |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| hostname | github.com |
| expected-hostname | github.com |
| None | df3d8f18192e5abe20e94c3682d359994d8a9a7c87d8089a67a508a37977e972 |
| turbo-cache-control | no-cache |
| go-import | github.com/eullm/llama.cpp git https://github.com/eullm/llama.cpp.git |
| octolytics-dimension-user_id | 269812378 |
| octolytics-dimension-user_login | eullm |
| octolytics-dimension-repository_id | 1276110165 |
| octolytics-dimension-repository_nwo | eullm/llama.cpp |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 1276110165 |
| octolytics-dimension-repository_network_root_nwo | eullm/llama.cpp |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | a97c86202ed84efe2eabdcfd54fcee639c79bb3c |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
| Skip to content | https://github.com/eullm/llama.cpp#start-of-content |
| https://github.com/ |
| Sign in | https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Feullm%2Fllama.cpp |
| GitHubRepository hosting, code review, and collaboration | https://github.com/platform |
| CopilotAI coding agent for tasks, projects and automated work | https://github.com/features/copilot |
| ActionsCI/CD and automation | https://github.com/features/actions |
| Code QualityQuality analysis, fixes, and enforcement | https://github.com/features/code-quality |
| CodespacesCloud development environments | https://github.com/features/codespaces |
| Code SecurityVulnerability detection and remediation | https://github.com/security/advanced-security/code-security |
| Secret ProtectionSecret scanning and leak prevention | https://github.com/security/advanced-security/secret-protection |
| All Features | https://github.com/features |
| Documentation | https://docs.github.com/en |
| Training | https://learn.github.com/skills |
| Certifications | https://learn.github.com/credentials |
| Build with Copilot | https://github.com/features/ai |
| Customize Copilot | https://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview |
| Integrations | https://github.com/marketplace |
| Trending repos | https://github.com/trending |
| GitHub Sponsors | https://github.com/open-source/sponsors |
| Developer articles | https://github.com/resources/articles |
| ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place. | https://github.blog/changelog/ |
| Enterprises | https://github.com/enterprise |
| Team | https://github.com/team |
| Startups | https://github.com/enterprise/startups |
| Nonprofits | https://github.com/solutions/industry/nonprofits |
| Healthcare | https://github.com/solutions/industry/healthcare |
| Financial services | https://github.com/solutions/industry/financial-services |
| Manufacturing | https://github.com/solutions/industry/manufacturing |
| Government | https://github.com/solutions/industry/government |
| See all industries | https://github.com/solutions/industry |
| Why GitHub | https://github.com/why-github |
| Customer Stories | https://github.com/customer-stories |
| Business insights | https://github.com/solutions/executive-insights |
| Trust Center | https://github.com/trust-center |
| GitHub Advanced SecurityEnterprise-grade code security | https://github.com/security/advanced-security |
| Copilot for businessEnterprise-grade AI features | https://github.com/features/copilot/copilot-business |
| Premium SupportEnterprise-grade 24/7 support | https://github.com/enterprise/premium-support |
| Documentation | https://docs.github.com/en |
| Resource center | https://github.com/resources |
| Blog | https://github.blog/ |
| Events & webinars | https://github.com/resources/events |
| Community Forum | https://github.com/orgs/community/discussions |
| Customer Stories | https://github.com/customer-stories |
| Integrations | https://github.com/marketplace |
| Customer support | https://help.github.com/ |
| Training | https://learn.github.com/skills |
| GitHub Status | https://www.githubstatus.com/ |
| About | https://github.com/about |
| Partners | https://github.com/partners |
| Changelog | https://github.blog/changelog/ |
| GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub. | https://githubuniverse.com/ |
| Pricing | https://github.com/pricing |
| Sign in | https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Feullm%2Fllama.cpp |
| Sign up | https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=eullm%2Fllama.cpp |
| Reload | https://github.com/eullm/llama.cpp |
| Reload | https://github.com/eullm/llama.cpp |
| Reload | https://github.com/eullm/llama.cpp |
| eullm | https://github.com/eullm |
| llama.cpp | https://github.com/eullm/llama.cpp |
| Code | https://github.com/eullm/llama.cpp |
| Issues | https://github.com/eullm/llama.cpp/issues |
| Pull requests | https://github.com/eullm/llama.cpp/pulls |
| Projects | https://github.com/eullm/llama.cpp/projects |
| Security and quality | https://github.com/eullm/llama.cpp/security |
| Insights | https://github.com/eullm/llama.cpp/pulse |
| https://github.com/eullm/llama.cpp |
| llama.cpp | https://github.com/eullm/llama.cpp |
| Notifications | https://github.com/login?return_to=%2Feullm%2Fllama.cpp |
| Fork0 (0) | https://github.com/login?return_to=%2Feullm%2Fllama.cpp |
| Star1 (1) | https://github.com/login?return_to=%2Feullm%2Fllama.cpp |
| Readme | https://github.com/eullm/llama.cpp#readme-ov-file |
| MIT license | https://github.com/eullm/llama.cpp#MIT-1-ov-file |
| Contributing | https://github.com/eullm/llama.cpp#contributing-ov-file |
| Security policy | https://github.com/eullm/llama.cpp#security-ov-file |
| Activity | https://github.com/eullm/llama.cpp/activity |
| Custom properties | https://github.com/eullm/llama.cpp/custom-properties |
| 0 forks | https://github.com/eullm/llama.cpp/forks |
| Report repository | https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Feullm%2Fllama.cpp&report=eullm+%28user%29 |
| Branches | https://github.com/eullm/llama.cpp/branches |
| Tags | https://github.com/eullm/llama.cpp/tags |
| https://github.com/eullm/llama.cpp/branches |
| https://github.com/eullm/llama.cpp/tags |
| 12,145 Commits | https://github.com/eullm/llama.cpp/commits/master/ |
| https://github.com/eullm/llama.cpp/commits/master/ |
| .devops | https://github.com/eullm/llama.cpp/tree/master/.devops |
| .devops | https://github.com/eullm/llama.cpp/tree/master/.devops |
| .gemini | https://github.com/eullm/llama.cpp/tree/master/.gemini |
| .gemini | https://github.com/eullm/llama.cpp/tree/master/.gemini |
| .github | https://github.com/eullm/llama.cpp/tree/master/.github |
| .github | https://github.com/eullm/llama.cpp/tree/master/.github |
| .pi/gg | https://github.com/eullm/llama.cpp/tree/master/.pi/gg |
| .pi/gg | https://github.com/eullm/llama.cpp/tree/master/.pi/gg |
| app | https://github.com/eullm/llama.cpp/tree/master/app |
| app | https://github.com/eullm/llama.cpp/tree/master/app |
| benches | https://github.com/eullm/llama.cpp/tree/master/benches |
| benches | https://github.com/eullm/llama.cpp/tree/master/benches |
| ci | https://github.com/eullm/llama.cpp/tree/master/ci |
| ci | https://github.com/eullm/llama.cpp/tree/master/ci |
| cmake | https://github.com/eullm/llama.cpp/tree/master/cmake |
| cmake | https://github.com/eullm/llama.cpp/tree/master/cmake |
| common | https://github.com/eullm/llama.cpp/tree/master/common |
| common | https://github.com/eullm/llama.cpp/tree/master/common |
| conversion | https://github.com/eullm/llama.cpp/tree/master/conversion |
| conversion | https://github.com/eullm/llama.cpp/tree/master/conversion |
| docs | https://github.com/eullm/llama.cpp/tree/master/docs |
| docs | https://github.com/eullm/llama.cpp/tree/master/docs |
| examples | https://github.com/eullm/llama.cpp/tree/master/examples |
| examples | https://github.com/eullm/llama.cpp/tree/master/examples |
| ggml | https://github.com/eullm/llama.cpp/tree/master/ggml |
| ggml | https://github.com/eullm/llama.cpp/tree/master/ggml |
| gguf-py | https://github.com/eullm/llama.cpp/tree/master/gguf-py |
| gguf-py | https://github.com/eullm/llama.cpp/tree/master/gguf-py |
| grammars | https://github.com/eullm/llama.cpp/tree/master/grammars |
| grammars | https://github.com/eullm/llama.cpp/tree/master/grammars |
| include | https://github.com/eullm/llama.cpp/tree/master/include |
| include | https://github.com/eullm/llama.cpp/tree/master/include |
| licenses | https://github.com/eullm/llama.cpp/tree/master/licenses |
| licenses | https://github.com/eullm/llama.cpp/tree/master/licenses |
| media | https://github.com/eullm/llama.cpp/tree/master/media |
| media | https://github.com/eullm/llama.cpp/tree/master/media |
| models | https://github.com/eullm/llama.cpp/tree/master/models |
| models | https://github.com/eullm/llama.cpp/tree/master/models |
| pocs | https://github.com/eullm/llama.cpp/tree/master/pocs |
| pocs | https://github.com/eullm/llama.cpp/tree/master/pocs |
| requirements | https://github.com/eullm/llama.cpp/tree/master/requirements |
| requirements | https://github.com/eullm/llama.cpp/tree/master/requirements |
| scripts | https://github.com/eullm/llama.cpp/tree/master/scripts |
| scripts | https://github.com/eullm/llama.cpp/tree/master/scripts |
| skills | https://github.com/eullm/llama.cpp/tree/master/skills |
| skills | https://github.com/eullm/llama.cpp/tree/master/skills |
| src | https://github.com/eullm/llama.cpp/tree/master/src |
| src | https://github.com/eullm/llama.cpp/tree/master/src |
| tests | https://github.com/eullm/llama.cpp/tree/master/tests |
| tests | https://github.com/eullm/llama.cpp/tree/master/tests |
| tools | https://github.com/eullm/llama.cpp/tree/master/tools |
| tools | https://github.com/eullm/llama.cpp/tree/master/tools |
| vendor | https://github.com/eullm/llama.cpp/tree/master/vendor |
| vendor | https://github.com/eullm/llama.cpp/tree/master/vendor |
| .clang-format | https://github.com/eullm/llama.cpp/blob/master/.clang-format |
| .clang-format | https://github.com/eullm/llama.cpp/blob/master/.clang-format |
| .clang-tidy | https://github.com/eullm/llama.cpp/blob/master/.clang-tidy |
| .clang-tidy | https://github.com/eullm/llama.cpp/blob/master/.clang-tidy |
| .dockerignore | https://github.com/eullm/llama.cpp/blob/master/.dockerignore |
| .dockerignore | https://github.com/eullm/llama.cpp/blob/master/.dockerignore |
| .ecrc | https://github.com/eullm/llama.cpp/blob/master/.ecrc |
| .ecrc | https://github.com/eullm/llama.cpp/blob/master/.ecrc |
| .editorconfig | https://github.com/eullm/llama.cpp/blob/master/.editorconfig |
| .editorconfig | https://github.com/eullm/llama.cpp/blob/master/.editorconfig |
| .flake8 | https://github.com/eullm/llama.cpp/blob/master/.flake8 |
| .flake8 | https://github.com/eullm/llama.cpp/blob/master/.flake8 |
| .gitignore | https://github.com/eullm/llama.cpp/blob/master/.gitignore |
| .gitignore | https://github.com/eullm/llama.cpp/blob/master/.gitignore |
| .gitmodules | https://github.com/eullm/llama.cpp/blob/master/.gitmodules |
| .gitmodules | https://github.com/eullm/llama.cpp/blob/master/.gitmodules |
| .pre-commit-config.yaml | https://github.com/eullm/llama.cpp/blob/master/.pre-commit-config.yaml |
| .pre-commit-config.yaml | https://github.com/eullm/llama.cpp/blob/master/.pre-commit-config.yaml |
| AGENTS.md | https://github.com/eullm/llama.cpp/blob/master/AGENTS.md |
| AGENTS.md | https://github.com/eullm/llama.cpp/blob/master/AGENTS.md |
| AUTHORS | https://github.com/eullm/llama.cpp/blob/master/AUTHORS |
| AUTHORS | https://github.com/eullm/llama.cpp/blob/master/AUTHORS |
| CLAUDE.md | https://github.com/eullm/llama.cpp/blob/master/CLAUDE.md |
| CLAUDE.md | https://github.com/eullm/llama.cpp/blob/master/CLAUDE.md |
| CMakeLists.txt | https://github.com/eullm/llama.cpp/blob/master/CMakeLists.txt |
| CMakeLists.txt | https://github.com/eullm/llama.cpp/blob/master/CMakeLists.txt |
| CMakePresets.json | https://github.com/eullm/llama.cpp/blob/master/CMakePresets.json |
| CMakePresets.json | https://github.com/eullm/llama.cpp/blob/master/CMakePresets.json |
| CODEOWNERS | https://github.com/eullm/llama.cpp/blob/master/CODEOWNERS |
| CODEOWNERS | https://github.com/eullm/llama.cpp/blob/master/CODEOWNERS |
| CONTRIBUTING.md | https://github.com/eullm/llama.cpp/blob/master/CONTRIBUTING.md |
| CONTRIBUTING.md | https://github.com/eullm/llama.cpp/blob/master/CONTRIBUTING.md |
| LICENSE | https://github.com/eullm/llama.cpp/blob/master/LICENSE |
| LICENSE | https://github.com/eullm/llama.cpp/blob/master/LICENSE |
| Makefile | https://github.com/eullm/llama.cpp/blob/master/Makefile |
| Makefile | https://github.com/eullm/llama.cpp/blob/master/Makefile |
| README.md | https://github.com/eullm/llama.cpp/blob/master/README.md |
| README.md | https://github.com/eullm/llama.cpp/blob/master/README.md |
| SECURITY.md | https://github.com/eullm/llama.cpp/blob/master/SECURITY.md |
| SECURITY.md | https://github.com/eullm/llama.cpp/blob/master/SECURITY.md |
| build-xcframework.sh | https://github.com/eullm/llama.cpp/blob/master/build-xcframework.sh |
| build-xcframework.sh | https://github.com/eullm/llama.cpp/blob/master/build-xcframework.sh |
| convert_hf_to_gguf.py | https://github.com/eullm/llama.cpp/blob/master/convert_hf_to_gguf.py |
| convert_hf_to_gguf.py | https://github.com/eullm/llama.cpp/blob/master/convert_hf_to_gguf.py |
| convert_hf_to_gguf_update.py | https://github.com/eullm/llama.cpp/blob/master/convert_hf_to_gguf_update.py |
| convert_hf_to_gguf_update.py | https://github.com/eullm/llama.cpp/blob/master/convert_hf_to_gguf_update.py |
| convert_llama_ggml_to_gguf.py | https://github.com/eullm/llama.cpp/blob/master/convert_llama_ggml_to_gguf.py |
| convert_llama_ggml_to_gguf.py | https://github.com/eullm/llama.cpp/blob/master/convert_llama_ggml_to_gguf.py |
| convert_lora_to_gguf.py | https://github.com/eullm/llama.cpp/blob/master/convert_lora_to_gguf.py |
| convert_lora_to_gguf.py | https://github.com/eullm/llama.cpp/blob/master/convert_lora_to_gguf.py |
| flake.nix | https://github.com/eullm/llama.cpp/blob/master/flake.nix |
| flake.nix | https://github.com/eullm/llama.cpp/blob/master/flake.nix |
| mypy.ini | https://github.com/eullm/llama.cpp/blob/master/mypy.ini |
| mypy.ini | https://github.com/eullm/llama.cpp/blob/master/mypy.ini |
| pyproject.toml | https://github.com/eullm/llama.cpp/blob/master/pyproject.toml |
| pyproject.toml | https://github.com/eullm/llama.cpp/blob/master/pyproject.toml |
| pyrightconfig.json | https://github.com/eullm/llama.cpp/blob/master/pyrightconfig.json |
| pyrightconfig.json | https://github.com/eullm/llama.cpp/blob/master/pyrightconfig.json |
| requirements.txt | https://github.com/eullm/llama.cpp/blob/master/requirements.txt |
| requirements.txt | https://github.com/eullm/llama.cpp/blob/master/requirements.txt |
| ty.toml | https://github.com/eullm/llama.cpp/blob/master/ty.toml |
| ty.toml | https://github.com/eullm/llama.cpp/blob/master/ty.toml |
| README | https://github.com/eullm/llama.cpp |
| Contributing | https://github.com/eullm/llama.cpp |
| MIT license | https://github.com/eullm/llama.cpp |
| Security | https://github.com/eullm/llama.cpp |
| https://github.com/eullm/llama.cpp#llamacpp |
| https://raw.githubusercontent.com/ggml-org/llama.brand/refs/heads/master/cover/llama-cpp/cover-llama-cpp-dark.svg |
| https://opensource.org/licenses/MIT |
| https://github.com/ggml-org/llama.cpp/releases?q=tag:v0 |
| https://github.com/ggml-org/llama.cpp/releases?q=b |
| https://github.com/ggml-org/llama.cpp/actions/workflows/server.yml |
| https://github.com/ggml-org/llama.cpp/actions/workflows/docker.yml |
| https://github.com/ggml-org/llama.cpp/actions/workflows/winget.yml |
| ggml | https://github.com/ggml-org/ggml |
| ops | https://github.com/ggml-org/llama.cpp/blob/master/docs/ops.md |
| maintainer PRs | https://github.com/ggml-org/llama.cpp/pulls?q=is%3Apr%20is%3Aopen%20draft%3AFalse%20(author%3Asanmai%20OR%20author%3Argerganov%20OR%20author%3AKitaitiMakoto%20OR%20author%3Adanbev%20OR%20author%3Aaldehir%20OR%20author%3Amax-krasnyansky%20OR%20author%3ACISC%20OR%20author%3Aggerganov%20OR%20author%3Aam17an%20OR%20author%3Ajhen0409%20OR%20author%3Abartowski1182%20OR%20author%3Anikwen%20OR%20author%3Ahipudding%20OR%20author%3Aravi9%20OR%20author%3AServeurpersoCom%20OR%20author%3Athelittlefireman%20OR%20author%3Apwilkin%20OR%20author%3Areeselevine%20OR%20author%3Angxson%20OR%20author%3Ajeffbolznv%20OR%20author%3Amarty1885%20OR%20author%3A0cc4m%20OR%20author%3ATitaniumtown%20OR%20author%3Aangt%20OR%20author%3AIMbackK%20OR%20author%3Aarthw%20OR%20author%3AJohannesGaessler%20OR%20author%3AORippler%20OR%20author%3Aruixiang63%20OR%20author%3Axctan%20OR%20author%3AmasterFoad%20OR%20author%3Aallozaur%20OR%20author%3AAndreas-Krebbel%20OR%20author%3Ayomaytk%20OR%20author%3Aaendk%20OR%20author%3Awine99%20OR%20author%3Agaugarg-nv%20OR%20author%3Ataronaeo%20OR%20author%3Aforforever73%20OR%20author%3Achaxu01%20OR%20author%3Alhez%20OR%20author%3AAlekseiNikiforovIBM%20OR%20author%3Anetrunnereve%20OR%20author%3Afairydreaming%20OR%20author%3Aynankani)%20sort%3Aupdated-desc |
| dev stats | https://github.com/ggml-org/llama.cpp-dev |
| lib llama API | https://github.com/ggml-org/llama.cpp/issues/9289 |
| llama-server REST API | https://github.com/ggml-org/llama.cpp/issues/9291 |
| https://github.com/eullm/llama.cpp#quick-start |
| https://llama.app | https://llama.app |
| Docker documentation | https://github.com/eullm/llama.cpp/blob/master/docs/docker.md |
| releases page | https://github.com/ggml-org/llama.cpp/releases |
| our build guide | https://github.com/eullm/llama.cpp/blob/master/docs/build.md |
| https://private-user-images.githubusercontent.com/1991296/629069102-88726b48-1713-48aa-a525-95a02e78afc4.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3OTM4ODA3NzcsIm5iZiI6MTc5Mzg4MDQ3NywicGF0aCI6Ii8xOTkxMjk2LzYyOTA2OTEwMi04ODcyNmI0OC0xNzEzLTQ4YWEtYTUyNS05NWEwMmU3OGFmYzQucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI2MTEwNSUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNjExMDVUMTIwNzU3WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9MTE3ZmYxNzIzMzU5ZDQ5ODhlNzVjOWYwNzM5MmMyYzRjOTcyMGQzNzJjYTAwNjY1ZjYxZDM1YzVhOTMzYzQ4YyZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QmcmVzcG9uc2UtY29udGVudC10eXBlPWltYWdlJTJGcG5nIn0.AVkrW1cCkDdUR0fhQVXGWPwebE_LSu0lYrOXFsEoHLo |
| https://private-user-images.githubusercontent.com/1991296/628539505-b402f972-2e32-4def-8771-8d849f08cf2e.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3OTM4ODA3NzcsIm5iZiI6MTc5Mzg4MDQ3NywicGF0aCI6Ii8xOTkxMjk2LzYyODUzOTUwNS1iNDAyZjk3Mi0yZTMyLTRkZWYtODc3MS04ZDg0OWYwOGNmMmUucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI2MTEwNSUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNjExMDVUMTIwNzU3WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9NTk0ZDM4MjkxMTIzNWU3MTU5ZmFjYjI2NGQ1MTJlNjBjNjEzY2FlYTdkYzE5ODY3YjVkMjljNjI5MjMzYTZhNSZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QmcmVzcG9uc2UtY29udGVudC10eXBlPWltYWdlJTJGcG5nIn0.mUbH9SK1slMF81TcC-LAhQYYHvYCsV-RIIn2KqCmelQ |
| https://github.com/eullm/llama.cpp#description |
| ggml | https://github.com/ggml-org/ggml |
| https://github.com/eullm/llama.cpp#supported-backends |
| BLAS | https://github.com/eullm/llama.cpp/blob/master/docs/build.md#blas-build |
| BLIS | https://github.com/eullm/llama.cpp/blob/master/docs/backend/BLIS.md |
| CANN | https://github.com/eullm/llama.cpp/blob/master/docs/build.md#cann |
| CUDA | https://github.com/eullm/llama.cpp/blob/master/docs/build.md#cuda |
| HIP | https://github.com/eullm/llama.cpp/blob/master/docs/build.md#hip |
| Hexagon | https://github.com/eullm/llama.cpp/blob/master/docs/backend/snapdragon/README.md |
| IBM zDNN | https://github.com/eullm/llama.cpp/blob/master/docs/backend/zDNN.md |
| MUSA | https://github.com/eullm/llama.cpp/blob/master/docs/build.md#musa |
| Metal | https://github.com/eullm/llama.cpp/blob/master/docs/build.md#metal-build |
| OpenCL | https://github.com/eullm/llama.cpp/blob/master/docs/backend/OPENCL.md |
| OpenVINO [In Progress] | https://github.com/eullm/llama.cpp/blob/master/docs/backend/OPENVINO.md |
| RPC | https://github.com/ggml-org/llama.cpp/tree/master/tools/rpc |
| SYCL | https://github.com/eullm/llama.cpp/blob/master/docs/backend/SYCL.md |
| VirtGPU | https://github.com/eullm/llama.cpp/blob/master/docs/backend/VirtGPU.md |
| Vulkan | https://github.com/eullm/llama.cpp/blob/master/docs/build.md#vulkan |
| WebGPU | https://github.com/eullm/llama.cpp/blob/master/docs/build.md#webgpu |
| ZenDNN | https://github.com/eullm/llama.cpp/blob/master/docs/build.md#zendnn |
| https://github.com/eullm/llama.cpp#documentation |
| https://github.com/eullm/llama.cpp#tools |
| cli | https://github.com/eullm/llama.cpp/blob/master/tools/cli/README.md |
| completion | https://github.com/eullm/llama.cpp/blob/master/tools/completion/README.md |
| server | https://github.com/eullm/llama.cpp/blob/master/tools/server/README.md |
| GBNF grammars | https://github.com/eullm/llama.cpp/blob/master/grammars/README.md |
| https://github.com/eullm/llama.cpp#development |
| How to build | https://github.com/eullm/llama.cpp/blob/master/docs/build.md |
| Running on Docker | https://github.com/eullm/llama.cpp/blob/master/docs/docker.md |
| Build on Android | https://github.com/eullm/llama.cpp/blob/master/docs/android.md |
| Multi-GPU usage | https://github.com/eullm/llama.cpp/blob/master/docs/multi-gpu.md |
| Performance troubleshooting | https://github.com/eullm/llama.cpp/blob/master/docs/development/token_generation_performance_tips.md |
| GGML tips & tricks | https://github.com/ggml-org/llama.cpp/wiki/GGML-Tips-&-Tricks |
| XCFramework | https://github.com/eullm/llama.cpp/blob/master/docs/xcframework.md |
| Completions | https://github.com/eullm/llama.cpp/blob/master/docs/completions.md |
| Models | https://github.com/eullm/llama.cpp/blob/master/docs/models.md |
| Release process | https://github.com/eullm/llama.cpp/blob/master/docs/release.md |
| https://github.com/eullm/llama.cpp#contributing |
| CONTRIBUTING.md | https://github.com/eullm/llama.cpp/blob/master/CONTRIBUTING.md |
| https://github.com/eullm/llama.cpp#acknowledgements |
| yhirose/cpp-httplib | https://github.com/yhirose/cpp-httplib |
| nothings/stb | https://github.com/nothings/stb |
| nlohmann/json | https://github.com/nlohmann/json |
| mackron/miniaudio | https://github.com/mackron/miniaudio |
| sheredom/subprocess.h | https://github.com/sheredom/subprocess.h |
| Readme | https://github.com/eullm/llama.cpp#readme-ov-file |
| MIT license | https://github.com/eullm/llama.cpp#MIT-1-ov-file |
| Contributing | https://github.com/eullm/llama.cpp#contributing-ov-file |
| Security policy | https://github.com/eullm/llama.cpp#security-ov-file |
| Activity | https://github.com/eullm/llama.cpp/activity |
| Custom properties | https://github.com/eullm/llama.cpp/custom-properties |
| 0 forks | https://github.com/eullm/llama.cpp/forks |
| Report repository | https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Feullm%2Fllama.cpp&report=eullm+%28user%29 |
|
| https://github.com |
| Terms | https://docs.github.com/site-policy/github-terms/github-terms-of-service |
| Privacy | https://docs.github.com/site-policy/privacy-policies/github-privacy-statement |
| Security | https://github.com/security |
| Status | https://www.githubstatus.com/ |
| Community | https://github.community/ |
| Docs | https://docs.github.com/ |
| Contact | https://support.github.com?tags=dotcom-footer |