| react-profiling | 0 |
| react-import-map | react,react-dom,react-dom/client,react-dom/profiling,react-is,react-reconciler,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@d5750093facf |
| route-pattern | /:user_id/:repository |
| route-controller | files |
| route-action | disambiguate |
| fetch-nonce | v2:ce23d71f-115c-ff6b-ff49-a2817f45006f |
| current-catalog-service-hash | f3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb |
| request-id | BD0C:3075D4:120EBC7:17AA8D1:6AED6BD1 |
| html-safe-nonce | 9176b76f2873f20eb5b86d3fad61d4650933882b00b1e0a4a8a56326a0c3e16c |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJCRDBDOjMwNzVENDoxMjBFQkM3OjE3QUE4RDE6NkFFRDZCRDEiLCJ2aXNpdG9yX2lkIjoiOTAzMzIyNTgyMjA0NTgyNjAwMSIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9 |
| visitor-hmac | 888814b5fd49649ecb999bebba616978a58fcd1727ccd5398863820260ce68ae |
| hovercard-subject-tag | repository:1268444536 |
| github-keyboard-shortcuts | repository,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | // |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion |
| twitter:image | https://opengraph.githubassets.com/686997b568ccc1b96f59ea476f39c082a208c46b94bee910e2bd34a5d8e93684/aogavrilov/diffusiongemma-llama-cpp-diffusion |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/686997b568ccc1b96f59ea476f39c082a208c46b94bee910e2bd34a5d8e93684/aogavrilov/diffusiongemma-llama-cpp-diffusion |
| og:image:alt | llama.cpp fork with experimental DiffusionGemma full-GPU and CUDA fusion support - aogavrilov/diffusiongemma-llama-cpp-diffusion |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| hostname | github.com |
| expected-hostname | github.com |
| None | 56fb42677ae87ed3e64410323d67980aa65d0485568a7858f874e7edfc6d1c11 |
| turbo-cache-control | no-cache |
| go-import | github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion git https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion.git |
| octolytics-dimension-user_id | 55056138 |
| octolytics-dimension-user_login | aogavrilov |
| octolytics-dimension-repository_id | 1268444536 |
| octolytics-dimension-repository_nwo | aogavrilov/diffusiongemma-llama-cpp-diffusion |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 1268444536 |
| octolytics-dimension-repository_network_root_nwo | aogavrilov/diffusiongemma-llama-cpp-diffusion |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 9c9a37e2423ed382cf39f70b5aa4b4858b40a3b0 |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
| Skip to content | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#start-of-content |
| https://github.com/ |
| Sign in | https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Faogavrilov%2Fdiffusiongemma-llama-cpp-diffusion |
| GitHubRepository hosting, code review, and collaboration | https://github.com/platform |
| CopilotAI coding agent for tasks, projects, and automated work | https://github.com/features/copilot |
| ActionsCI/CD and automation | https://github.com/features/actions |
| Code QualityQuality analysis, fixes, and enforcement | https://github.com/features/code-quality |
| CodespacesCloud development environments | https://github.com/features/codespaces |
| Code SecurityVulnerability detection and remediation | https://github.com/security/advanced-security/code-security |
| Secret ProtectionSecret scanning and leak prevention | https://github.com/security/advanced-security/secret-protection |
| All Features | https://github.com/features |
| Documentation | https://docs.github.com/en |
| Training | https://learn.github.com/skills |
| Certifications | https://learn.github.com/credentials |
| Build with Copilot | https://github.com/features/ai |
| Customize Copilot | https://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview |
| Integrations | https://github.com/marketplace |
| Trending repos | https://github.com/trending |
| GitHub Sponsors | https://github.com/open-source/sponsors |
| Developer articles | https://github.com/resources/articles |
| ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place. | https://github.blog/changelog/ |
| Enterprises | https://github.com/enterprise |
| Team | https://github.com/team |
| Startups | https://github.com/enterprise/startups |
| Nonprofits | https://github.com/solutions/industry/nonprofits |
| Healthcare | https://github.com/solutions/industry/healthcare |
| Financial services | https://github.com/solutions/industry/financial-services |
| Manufacturing | https://github.com/solutions/industry/manufacturing |
| Government | https://github.com/solutions/industry/government |
| See all industries | https://github.com/solutions/industry |
| Why GitHub | https://github.com/why-github |
| Customer Stories | https://github.com/customer-stories |
| Business insights | https://github.com/solutions/executive-insights |
| Trust Center | https://github.com/trust-center |
| GitHub Advanced SecurityEnterprise-grade code security | https://github.com/security/advanced-security |
| Copilot for businessEnterprise-grade AI features | https://github.com/features/copilot/copilot-business |
| Premium SupportEnterprise-grade 24/7 support | https://github.com/enterprise/premium-support |
| Documentation | https://docs.github.com/en |
| Resource center | https://github.com/resources |
| Blog | https://github.blog/ |
| Events & webinars | https://github.com/resources/events |
| Community Forum | https://github.com/orgs/community/discussions |
| Customer Stories | https://github.com/customer-stories |
| Integrations | https://github.com/marketplace |
| Customer support | https://help.github.com/ |
| Training | https://learn.github.com/skills |
| GitHub Status | https://www.githubstatus.com/ |
| About | https://github.com/about |
| Partners | https://github.com/partners |
| Changelog | https://github.blog/changelog/ |
| GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub. | https://githubuniverse.com/ |
| Pricing | https://github.com/pricing |
| Sign in | https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Faogavrilov%2Fdiffusiongemma-llama-cpp-diffusion |
| Sign up | https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=aogavrilov%2Fdiffusiongemma-llama-cpp-diffusion |
| Reload | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion |
| Reload | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion |
| Reload | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion |
| aogavrilov | https://github.com/aogavrilov |
| diffusiongemma-llama-cpp-diffusion | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion |
| Code | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion |
| Issues | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/issues |
| Pull requests | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/pulls |
| Actions | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/actions |
| Projects | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/projects |
| Security and quality | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/security |
| Insights | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/pulse |
| https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion |
| diffusiongemma-llama-cpp-diffusion | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion |
| Notifications | https://github.com/login?return_to=%2Faogavrilov%2Fdiffusiongemma-llama-cpp-diffusion |
| Fork0 (0) | https://github.com/login?return_to=%2Faogavrilov%2Fdiffusiongemma-llama-cpp-diffusion |
| Star0 (0) | https://github.com/login?return_to=%2Faogavrilov%2Fdiffusiongemma-llama-cpp-diffusion |
| github.com/aogavrilov/diffusiongemma-agent | https://github.com/aogavrilov/diffusiongemma-agent |
| cuda | https://github.com/topics/cuda |
| diffusiongemma | https://github.com/topics/diffusiongemma |
| gguf | https://github.com/topics/gguf |
| llama-cpp | https://github.com/topics/llama-cpp |
| Readme | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#readme-ov-file |
| MIT license | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#MIT-1-ov-file |
| Contributing | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#contributing-ov-file |
| Security policy | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#security-ov-file |
| Activity | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/activity |
| 0 forks | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/forks |
| Report repository | https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Faogavrilov%2Fdiffusiongemma-llama-cpp-diffusion&report=aogavrilov+%28user%29 |
| Branches | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/branches |
| Tags | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tags |
| https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/branches |
| https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tags |
| 9,603 Commits | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/commits/diffusiongemma/ |
| https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/commits/diffusiongemma/ |
| .devops | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/.devops |
| .devops | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/.devops |
| .gemini | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/.gemini |
| .gemini | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/.gemini |
| .github | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/.github |
| .github | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/.github |
| .pi/gg | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/.pi/gg |
| .pi/gg | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/.pi/gg |
| app | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/app |
| app | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/app |
| benches | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/benches |
| benches | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/benches |
| ci | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/ci |
| ci | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/ci |
| cmake | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/cmake |
| cmake | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/cmake |
| common | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/common |
| common | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/common |
| conversion | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/conversion |
| conversion | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/conversion |
| docs | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/docs |
| docs | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/docs |
| examples | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/examples |
| examples | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/examples |
| ggml | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/ggml |
| ggml | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/ggml |
| gguf-py | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/gguf-py |
| gguf-py | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/gguf-py |
| grammars | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/grammars |
| grammars | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/grammars |
| include | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/include |
| include | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/include |
| licenses | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/licenses |
| licenses | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/licenses |
| media | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/media |
| media | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/media |
| models | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/models |
| models | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/models |
| pocs | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/pocs |
| pocs | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/pocs |
| requirements | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/requirements |
| requirements | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/requirements |
| scripts | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/scripts |
| scripts | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/scripts |
| src | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/src |
| src | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/src |
| tests | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/tests |
| tests | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/tests |
| tools | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/tools |
| tools | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/tools |
| vendor | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/vendor |
| vendor | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/tree/diffusiongemma/vendor |
| .clang-format | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/.clang-format |
| .clang-format | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/.clang-format |
| .clang-tidy | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/.clang-tidy |
| .clang-tidy | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/.clang-tidy |
| .dockerignore | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/.dockerignore |
| .dockerignore | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/.dockerignore |
| .ecrc | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/.ecrc |
| .ecrc | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/.ecrc |
| .editorconfig | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/.editorconfig |
| .editorconfig | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/.editorconfig |
| .flake8 | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/.flake8 |
| .flake8 | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/.flake8 |
| .gitignore | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/.gitignore |
| .gitignore | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/.gitignore |
| .gitmodules | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/.gitmodules |
| .gitmodules | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/.gitmodules |
| .pre-commit-config.yaml | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/.pre-commit-config.yaml |
| .pre-commit-config.yaml | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/.pre-commit-config.yaml |
| AGENTS.md | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/AGENTS.md |
| AGENTS.md | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/AGENTS.md |
| AUTHORS | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/AUTHORS |
| AUTHORS | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/AUTHORS |
| CLAUDE.md | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/CLAUDE.md |
| CLAUDE.md | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/CLAUDE.md |
| CMakeLists.txt | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/CMakeLists.txt |
| CMakeLists.txt | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/CMakeLists.txt |
| CMakePresets.json | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/CMakePresets.json |
| CMakePresets.json | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/CMakePresets.json |
| CODEOWNERS | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/CODEOWNERS |
| CODEOWNERS | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/CODEOWNERS |
| CONTRIBUTING.md | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/CONTRIBUTING.md |
| CONTRIBUTING.md | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/CONTRIBUTING.md |
| DIFFUSIONGEMMA_FORK.md | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/DIFFUSIONGEMMA_FORK.md |
| DIFFUSIONGEMMA_FORK.md | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/DIFFUSIONGEMMA_FORK.md |
| LICENSE | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/LICENSE |
| LICENSE | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/LICENSE |
| Makefile | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/Makefile |
| Makefile | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/Makefile |
| README.md | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/README.md |
| README.md | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/README.md |
| SECURITY.md | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/SECURITY.md |
| SECURITY.md | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/SECURITY.md |
| build-xcframework.sh | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/build-xcframework.sh |
| build-xcframework.sh | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/build-xcframework.sh |
| convert_hf_to_gguf.py | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/convert_hf_to_gguf.py |
| convert_hf_to_gguf.py | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/convert_hf_to_gguf.py |
| convert_hf_to_gguf_update.py | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/convert_hf_to_gguf_update.py |
| convert_hf_to_gguf_update.py | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/convert_hf_to_gguf_update.py |
| convert_llama_ggml_to_gguf.py | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/convert_llama_ggml_to_gguf.py |
| convert_llama_ggml_to_gguf.py | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/convert_llama_ggml_to_gguf.py |
| convert_lora_to_gguf.py | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/convert_lora_to_gguf.py |
| convert_lora_to_gguf.py | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/convert_lora_to_gguf.py |
| flake.nix | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/flake.nix |
| flake.nix | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/flake.nix |
| mypy.ini | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/mypy.ini |
| mypy.ini | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/mypy.ini |
| pyproject.toml | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/pyproject.toml |
| pyproject.toml | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/pyproject.toml |
| pyrightconfig.json | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/pyrightconfig.json |
| pyrightconfig.json | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/pyrightconfig.json |
| requirements.txt | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/requirements.txt |
| requirements.txt | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/requirements.txt |
| ty.toml | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/ty.toml |
| ty.toml | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/ty.toml |
| README | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion |
| Contributing | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion |
| MIT license | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion |
| Security | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion |
| https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#llamacpp |
| https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png |
| https://opensource.org/licenses/MIT |
| https://github.com/ggml-org/llama.cpp/releases |
| https://github.com/ggml-org/llama.cpp/actions/workflows/server.yml |
| https://github.com/ggml-org/llama.cpp/actions/workflows/docker.yml |
| https://github.com/ggml-org/llama.cpp/actions/workflows/winget.yml |
| Manifesto | https://github.com/ggml-org/llama.cpp/discussions/205 |
| ggml | https://github.com/ggml-org/ggml |
| ops | https://github.com/ggml-org/llama.cpp/blob/master/docs/ops.md |
| https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#recent-api-changes |
| Changelog for libllama API | https://github.com/ggml-org/llama.cpp/issues/9289 |
| Changelog for llama-server REST API | https://github.com/ggml-org/llama.cpp/issues/9291 |
| https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#hot-topics |
| guide : using the new WebUI of llama.cpp | https://github.com/ggml-org/llama.cpp/discussions/16938 |
| guide : running gpt-oss with llama.cpp | https://github.com/ggml-org/llama.cpp/discussions/15396 |
| [FEEDBACK] Better packaging for llama.cpp to support downstream consumers 🤗 | https://github.com/ggml-org/llama.cpp/discussions/15313 |
| PR | https://github.com/ggml-org/llama.cpp/pull/15091 |
| Collaboration with NVIDIA | https://blogs.nvidia.com/blog/rtx-ai-garage-openai-oss |
| Comment | https://github.com/ggml-org/llama.cpp/discussions/15095 |
| #12898 | https://github.com/ggml-org/llama.cpp/pull/12898 |
| documentation | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/docs/multimodal.md |
| https://github.com/ggml-org/llama.vscode | https://github.com/ggml-org/llama.vscode |
| https://github.com/ggml-org/llama.vim | https://github.com/ggml-org/llama.vim |
| ggml-org/llama.cpp#9669 | https://github.com/ggml-org/llama.cpp/discussions/9669 |
| discussion | https://github.com/ggml-org/llama.cpp/discussions/9268 |
| tool | https://huggingface.co/spaces/CISCai/gguf-editor |
| here | https://reeselevine.github.io/llamas-on-the-web/ |
| https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#quick-start |
| brew, nix or winget | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/docs/install.md |
| Docker documentation | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/docs/docker.md |
| releases page | https://github.com/ggml-org/llama.cpp/releases |
| our build guide | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/docs/build.md |
| Obtaining and quantizing models | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#obtaining-and-quantizing-models |
| https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#description |
| ggml | https://github.com/ggml-org/ggml |
| HOWTO-add-model.md | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/docs/development/HOWTO-add-model.md |
| https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#text-only |
| Mistral 7B | https://huggingface.co/mistralai/Mistral-7B-v0.1 |
| Mixtral MoE | https://huggingface.co/models?search=mistral-ai/Mixtral |
| DBRX | https://huggingface.co/databricks/dbrx-instruct |
| Jamba | https://huggingface.co/ai21labs |
| Falcon | https://huggingface.co/models?search=tiiuae/falcon |
| Chinese LLaMA / Alpaca | https://github.com/ymcui/Chinese-LLaMA-Alpaca |
| Chinese LLaMA-2 / Alpaca-2 | https://github.com/ymcui/Chinese-LLaMA-Alpaca-2 |
| Vigogne (French) | https://github.com/bofenghuang/vigogne |
| BERT | https://github.com/ggml-org/llama.cpp/pull/5423 |
| Koala | https://bair.berkeley.edu/blog/2023/04/03/koala/ |
| Baichuan 1 & 2 | https://huggingface.co/models?search=baichuan-inc/Baichuan |
| derivations | https://huggingface.co/hiyouga/baichuan-7b-sft |
| Aquila 1 & 2 | https://huggingface.co/models?search=BAAI/Aquila |
| Starcoder models | https://github.com/ggml-org/llama.cpp/pull/3187 |
| Refact | https://huggingface.co/smallcloudai/Refact-1_6B-fim |
| MPT | https://github.com/ggml-org/llama.cpp/pull/3417 |
| Bloom | https://github.com/ggml-org/llama.cpp/pull/3553 |
| Yi models | https://huggingface.co/models?search=01-ai/Yi |
| StableLM models | https://huggingface.co/stabilityai |
| Deepseek models | https://huggingface.co/models?search=deepseek-ai/deepseek |
| Qwen models | https://huggingface.co/models?search=Qwen/Qwen |
| PLaMo-13B | https://github.com/ggml-org/llama.cpp/pull/3557 |
| Phi models | https://huggingface.co/models?search=microsoft/phi |
| PhiMoE | https://github.com/ggml-org/llama.cpp/pull/11003 |
| GPT-2 | https://huggingface.co/gpt2 |
| Orion 14B | https://github.com/ggml-org/llama.cpp/pull/5118 |
| InternLM2 | https://huggingface.co/models?search=internlm2 |
| CodeShell | https://github.com/WisdomShell/codeshell |
| Gemma | https://ai.google.dev/gemma |
| Mamba | https://github.com/state-spaces/mamba |
| Grok-1 | https://huggingface.co/keyfan/grok-1-hf |
| Xverse | https://huggingface.co/models?search=xverse |
| Command-R models | https://huggingface.co/models?search=CohereForAI/c4ai-command-r |
| SEA-LION | https://huggingface.co/models?search=sea-lion |
| GritLM-7B | https://huggingface.co/GritLM/GritLM-7B |
| GritLM-8x7B | https://huggingface.co/GritLM/GritLM-8x7B |
| OLMo | https://allenai.org/olmo |
| OLMo 2 | https://allenai.org/olmo |
| OLMoE | https://huggingface.co/allenai/OLMoE-1B-7B-0924 |
| Granite models | https://huggingface.co/collections/ibm-granite/granite-code-models-6624c5cec322e4c148c8b330 |
| GPT-NeoX | https://github.com/EleutherAI/gpt-neox |
| Pythia | https://github.com/EleutherAI/pythia |
| Snowflake-Arctic MoE | https://huggingface.co/collections/Snowflake/arctic-66290090abe542894a5ac520 |
| Smaug | https://huggingface.co/models?search=Smaug |
| Poro 34B | https://huggingface.co/LumiOpen/Poro-34B |
| Bitnet b1.58 models | https://huggingface.co/1bitLLM |
| Flan T5 | https://huggingface.co/models?search=flan-t5 |
| Open Elm models | https://huggingface.co/collections/apple/openelm-instruct-models-6619ad295d7ae9f868b759ca |
| ChatGLM3-6b | https://huggingface.co/THUDM/chatglm3-6b |
| ChatGLM4-9b | https://huggingface.co/THUDM/glm-4-9b |
| GLMEdge-1.5b | https://huggingface.co/THUDM/glm-edge-1.5b-chat |
| GLMEdge-4b | https://huggingface.co/THUDM/glm-edge-4b-chat |
| GLM-4-0414 | https://huggingface.co/collections/THUDM/glm-4-0414-67f3cbcb34dd9d252707cb2e |
| SmolLM | https://huggingface.co/collections/HuggingFaceTB/smollm-6695016cad7167254ce15966 |
| EXAONE-3.0-7.8B-Instruct | https://huggingface.co/LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct |
| FalconMamba Models | https://huggingface.co/collections/tiiuae/falconmamba-7b-66b9a580324dd1598b0f6d4a |
| Jais | https://huggingface.co/inceptionai/jais-13b-chat |
| Bielik-11B-v2.3 | https://huggingface.co/collections/speakleash/bielik-11b-v23-66ee813238d9b526a072408a |
| RWKV-7 | https://huggingface.co/collections/shoumenchougou/rwkv7-gxx-gguf |
| RWKV-6 | https://github.com/BlinkDL/RWKV-LM |
| QRWKV-6 | https://huggingface.co/recursal/QRWKV6-32B-Instruct-Preview-v0.1 |
| GigaChat-20B-A3B | https://huggingface.co/ai-sage/GigaChat-20B-A3B-instruct |
| Trillion-7B-preview | https://huggingface.co/trillionlabs/Trillion-7B-preview |
| Ling models | https://huggingface.co/collections/inclusionAI/ling-67c51c85b34a7ea0aba94c32 |
| LFM2 models | https://huggingface.co/collections/LiquidAI/lfm2-686d721927015b2ad73eaa38 |
| Hunyuan models | https://huggingface.co/collections/tencent/hunyuan-dense-model-6890632cda26b19119c9c5e7 |
| BailingMoeV2 (Ring/Ling 2.0) models | https://huggingface.co/collections/inclusionAI/ling-v2-68bf1dd2fc34c306c1fa6f86 |
| Mellum models | https://huggingface.co/JetBrains/models?search=mellum |
| https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#multimodal |
| LLaVA 1.5 models | https://huggingface.co/collections/liuhaotian/llava-15-653aac15d994e992e2677a7e |
| LLaVA 1.6 models | https://huggingface.co/collections/liuhaotian/llava-16-65b9e40155f60fd046a5ccf2 |
| BakLLaVA | https://huggingface.co/models?search=SkunkworksAI/Bakllava |
| Obsidian | https://huggingface.co/NousResearch/Obsidian-3B-V0.5 |
| ShareGPT4V | https://huggingface.co/models?search=Lin-Chen/ShareGPT4V |
| MobileVLM 1.7B/3B models | https://huggingface.co/models?search=mobileVLM |
| Yi-VL | https://huggingface.co/models?search=Yi-VL |
| Mini CPM | https://huggingface.co/models?search=MiniCPM |
| Moondream | https://huggingface.co/vikhyatk/moondream2 |
| Bunny | https://github.com/BAAI-DCAI/Bunny |
| GLM-EDGE | https://huggingface.co/models?search=glm-edge |
| Qwen2-VL | https://huggingface.co/collections/Qwen/qwen2-vl-66cee7455501d7126940800d |
| LFM2-VL | https://huggingface.co/collections/LiquidAI/lfm2-vl-68963bbc84a610f7638d5ffa |
| ddh0/easy-llama | https://github.com/ddh0/easy-llama |
| abetlen/llama-cpp-python | https://github.com/abetlen/llama-cpp-python |
| go-skynet/go-llama.cpp | https://github.com/go-skynet/go-llama.cpp |
| withcatai/node-llama-cpp | https://github.com/withcatai/node-llama-cpp |
| lgrammel/modelfusion | https://modelfusion.dev/integration/model-provider/llamacpp |
| offline-ai/cli | https://github.com/offline-ai/cli |
| tangledgroup/llama-cpp-wasm | https://github.com/tangledgroup/llama-cpp-wasm |
| ngxson/wllama | https://github.com/ngxson/wllama |
| yoshoku/llama_cpp.rb | https://github.com/yoshoku/llama_cpp.rb |
| docusealco/rllama | https://github.com/docusealco/rllama |
| edgenai/llama_cpp-rs | https://github.com/edgenai/llama_cpp-rs |
| mdrokz/rust-llama.cpp | https://github.com/mdrokz/rust-llama.cpp |
| utilityai/llama-cpp-rs | https://github.com/utilityai/llama-cpp-rs |
| ShelbyJenkins/llm_client | https://github.com/ShelbyJenkins/llm_client |
| SciSharp/LLamaSharp | https://github.com/SciSharp/LLamaSharp |
| LM-Kit.NET | https://docs.lm-kit.com/lm-kit-net/index.html |
| donderom/llm4s | https://github.com/donderom/llm4s |
| phronmophobic/llama.clj | https://github.com/phronmophobic/llama.clj |
| mybigday/llama.rn | https://github.com/mybigday/llama.rn |
| kherud/java-llama.cpp | https://github.com/kherud/java-llama.cpp |
| QuasarByte/llama-cpp-jna | https://github.com/QuasarByte/llama-cpp-jna |
| deins/llama.cpp.zig | https://github.com/Deins/llama.cpp.zig |
| netdur/llama_cpp_dart | https://github.com/netdur/llama_cpp_dart |
| xuegao-tzx/Fllama | https://github.com/xuegao-tzx/Fllama |
| distantmagic/resonance | https://github.com/distantmagic/resonance |
| (more info) | https://github.com/ggml-org/llama.cpp/pull/6326 |
| guile_llama_cpp | https://savannah.nongnu.org/projects/guile-llama-cpp |
| srgtuszy/llama-cpp-swift | https://github.com/srgtuszy/llama-cpp-swift |
| ShenghaiWang/SwiftLlama | https://github.com/ShenghaiWang/SwiftLlama |
| Embarcadero/llama-cpp-delphi | https://github.com/Embarcadero/llama-cpp-delphi |
| hybridgroup/yzma | https://github.com/hybridgroup/yzma |
| llama.android | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/examples/llama.android |
| AI Sublime Text plugin | https://github.com/yaroslavyaroslav/OpenAI-sublime-text |
| BonzAI App | https://apps.apple.com/us/app/bonzai-your-local-ai-agent/id6752847988 |
| cztomsik/ava | https://github.com/cztomsik/ava |
| Dot | https://github.com/alexpinel/Dot |
| eva | https://github.com/ylsdamxssjxxdd/eva |
| iohub/collama | https://github.com/iohub/coLLaMA |
| janhq/jan | https://github.com/janhq/jan |
| johnbean393/Sidekick | https://github.com/johnbean393/Sidekick |
| KanTV | https://github.com/zhouwg/kantv?tab=readme-ov-file |
| KodiBot | https://github.com/firatkiral/kodibot |
| llama.vim | https://github.com/ggml-org/llama.vim |
| LARS | https://github.com/abgulati/LARS |
| Llama Assistant | https://github.com/vietanhdev/llama-assistant |
| LlamaLib | https://github.com/undreamai/LlamaLib |
| LLMFarm | https://github.com/guinmoon/LLMFarm?tab=readme-ov-file |
| LLMUnity | https://github.com/undreamai/LLMUnity |
| LMStudio | https://lmstudio.ai/ |
| LocalAI | https://github.com/mudler/LocalAI |
| LostRuins/koboldcpp | https://github.com/LostRuins/koboldcpp |
| MindMac | https://mindmac.app |
| MindWorkAI/AI-Studio | https://github.com/MindWorkAI/AI-Studio |
| Mobile-Artificial-Intelligence/maid | https://github.com/Mobile-Artificial-Intelligence/maid |
| Mozilla-Ocho/llamafile | https://github.com/Mozilla-Ocho/llamafile |
| nat/openplayground | https://github.com/nat/openplayground |
| nomic-ai/gpt4all | https://github.com/nomic-ai/gpt4all |
| ollama/ollama | https://github.com/ollama/ollama |
| oobabooga/text-generation-webui | https://github.com/oobabooga/text-generation-webui |
| PocketPal AI | https://github.com/a-ghorbani/pocketpal-ai |
| psugihara/FreeChat | https://github.com/psugihara/FreeChat |
| ptsochantaris/emeltal | https://github.com/ptsochantaris/emeltal |
| pythops/tenere | https://github.com/pythops/tenere |
| ramalama | https://github.com/containers/ramalama |
| semperai/amica | https://github.com/semperai/amica |
| withcatai/catai | https://github.com/withcatai/catai |
| Autopen | https://github.com/blackhole89/autopen |
| akx/ggify | https://github.com/akx/ggify |
| akx/ollama-dl | https://github.com/akx/ollama-dl |
| crashr/gppm | https://github.com/crashr/gppm |
| gpustack/gguf-parser | https://github.com/gpustack/gguf-parser-go/tree/main/cmd/gguf-parser |
| Styled Lines | https://marketplace.unity.com/packages/tools/generative-ai/styled-lines-llama-cpp-model-292902 |
| unslothai/unsloth | https://github.com/unslothai/unsloth |
| Paddler | https://github.com/intentee/paddler |
| GPUStack | https://github.com/gpustack/gpustack |
| llama_cpp_canister | https://github.com/onicai/llama_cpp_canister |
| llama-swap | https://github.com/mostlygeek/llama-swap |
| Kalavai | https://github.com/kalavai-net/kalavai-client |
| llmaz | https://github.com/InftyAI/llmaz |
| LLMKube | https://github.com/defilantech/llmkube |
| Lucy's Labyrinth | https://github.com/MorganRO8/Lucys_Labyrinth |
| https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#supported-backends |
| Metal | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/docs/build.md#metal-build |
| BLAS | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/docs/build.md#blas-build |
| BLIS | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/docs/backend/BLIS.md |
| SYCL | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/docs/backend/SYCL.md |
| OpenVINO [In Progress] | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/docs/backend/OPENVINO.md |
| MUSA | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/docs/build.md#musa |
| CUDA | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/docs/build.md#cuda |
| HIP | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/docs/build.md#hip |
| ZenDNN | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/docs/build.md#zendnn |
| Vulkan | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/docs/build.md#vulkan |
| CANN | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/docs/build.md#cann |
| OpenCL | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/docs/backend/OPENCL.md |
| IBM zDNN | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/docs/backend/zDNN.md |
| WebGPU | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/docs/build.md#webgpu |
| RPC | https://github.com/ggml-org/llama.cpp/tree/master/tools/rpc |
| Hexagon [In Progress] | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/docs/backend/snapdragon/README.md |
| VirtGPU | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/docs/backend/VirtGPU.md |
| https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#obtaining-and-quantizing-models |
| Hugging Face | https://huggingface.co |
| number of LLMs | https://huggingface.co/models?library=gguf&sort=trending |
| Trending | https://huggingface.co/models?library=gguf&sort=trending |
| LLaMA | https://huggingface.co/models?sort=trending&search=llama+gguf |
| Hugging Face | https://huggingface.co/ |
| GGUF | https://github.com/ggml-org/ggml/blob/master/docs/gguf.md |
| GGUF-my-repo space | https://huggingface.co/spaces/ggml-org/gguf-my-repo |
| GGUF-my-LoRA space | https://huggingface.co/spaces/ggml-org/gguf-my-lora |
| ggml-org/llama.cpp#10123 | https://github.com/ggml-org/llama.cpp/discussions/10123 |
| GGUF-editor space | https://huggingface.co/spaces/CISCai/gguf-editor |
| ggml-org/llama.cpp#9268 | https://github.com/ggml-org/llama.cpp/discussions/9268 |
| Inference Endpoints | https://ui.endpoints.huggingface.co/ |
| ggml-org/llama.cpp#9669 | https://github.com/ggml-org/llama.cpp/discussions/9669 |
| read this documentation | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/tools/quantize/README.md |
| llama-cli | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/tools/cli |
| https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#llama-cli |
| https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#a-cli-tool-for-accessing-and-experimenting-with-most-of-llamacpps-functionality |
| grammars/ | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/grammars |
| GBNF Guide | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/grammars/README.md |
| https://grammar.intrinsiclabs.ai/ | https://grammar.intrinsiclabs.ai/ |
| llama-server | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/tools/server |
| https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#llama-server |
| OpenAI API | https://github.com/openai/openai-openapi |
| https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#a-lightweight-openai-api-compatible-http-server-for-serving-llms |
| llama-perplexity | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/tools/perplexity |
| https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#llama-perplexity |
| perplexity | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/tools/perplexity/README.md |
| 1 | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#user-content-fn-1-be8abd1de25e6377cbbf5c99cf173e68 |
| https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#a-tool-for-measuring-the-perplexity-1-and-other-quality-metrics-of-a-model-over-a-given-text |
| llama-bench | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/tools/llama-bench |
| https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#llama-bench |
| https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#benchmark-the-performance-of-the-inference-for-various-parameters |
| llama-simple | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/examples/simple |
| https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#llama-simple |
| https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#a-minimal-example-for-implementing-apps-with-llamacpp-useful-for-developers |
| https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#contributing |
| good first issues | https://github.com/ggml-org/llama.cpp/issues?q=is%3Aissue+is%3Aopen+label%3A%22good+first+issue%22 |
| CONTRIBUTING.md | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/CONTRIBUTING.md |
| Inference at the edge | https://github.com/ggml-org/llama.cpp/discussions/205 |
| Changelog podcast | https://changelog.com/podcast/532 |
| https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#other-documentation |
| cli | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/tools/cli/README.md |
| completion | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/tools/completion/README.md |
| server | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/tools/server/README.md |
| GBNF grammars | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/grammars/README.md |
| https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#development-documentation |
| How to build | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/docs/build.md |
| Running on Docker | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/docs/docker.md |
| Build on Android | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/docs/android.md |
| Multi-GPU usage | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/docs/multi-gpu.md |
| Performance troubleshooting | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/blob/diffusiongemma/docs/development/token_generation_performance_tips.md |
| GGML tips & tricks | https://github.com/ggml-org/llama.cpp/wiki/GGML-Tips-&-Tricks |
| https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#seminal-papers-and-background-on-the-models |
| Introducing LLaMA: A foundational, 65-billion-parameter large language model | https://ai.facebook.com/blog/large-language-model-llama-meta-ai/ |
| LLaMA: Open and Efficient Foundation Language Models | https://arxiv.org/abs/2302.13971 |
| Language Models are Few-Shot Learners | https://arxiv.org/abs/2005.14165 |
| Aligning language models to follow instructions | https://openai.com/research/instruction-following |
| Training language models to follow instructions with human feedback | https://arxiv.org/abs/2203.02155 |
| https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#xcframework |
| https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#completions |
| https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#bash-completion |
| https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#dependencies |
| yhirose/cpp-httplib | https://github.com/yhirose/cpp-httplib |
| stb-image | https://github.com/nothings/stb |
| nlohmann/json | https://github.com/nlohmann/json |
| miniaudio.h | https://github.com/mackron/miniaudio |
| subprocess.h | https://github.com/sheredom/subprocess.h |
| https://huggingface.co/docs/transformers/perplexity | https://huggingface.co/docs/transformers/perplexity |
| ↩ | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#user-content-fnref-1-be8abd1de25e6377cbbf5c99cf173e68 |
| github.com/aogavrilov/diffusiongemma-agent | https://github.com/aogavrilov/diffusiongemma-agent |
| cuda | https://github.com/topics/cuda |
| diffusiongemma | https://github.com/topics/diffusiongemma |
| gguf | https://github.com/topics/gguf |
| llama-cpp | https://github.com/topics/llama-cpp |
| Readme | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#readme-ov-file |
| MIT license | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#MIT-1-ov-file |
| Contributing | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#contributing-ov-file |
| Security policy | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion#security-ov-file |
| Activity | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/activity |
| 0 forks | https://github.com/aogavrilov/diffusiongemma-llama-cpp-diffusion/forks |
| Report repository | https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Faogavrilov%2Fdiffusiongemma-llama-cpp-diffusion&report=aogavrilov+%28user%29 |
|
| https://github.com |
| Terms | https://docs.github.com/site-policy/github-terms/github-terms-of-service |
| Privacy | https://docs.github.com/site-policy/privacy-policies/github-privacy-statement |
| Security | https://github.com/security |
| Status | https://www.githubstatus.com/ |
| Community | https://github.community/ |
| Docs | https://docs.github.com/ |
| Contact | https://support.github.com?tags=dotcom-footer |
