René's URL Explorer Experiment

Title: GitHub - defilantech/LLMKube: Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed. · GitHub

Open Graph Title: GitHub - defilantech/LLMKube: Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.

X Title: GitHub - defilantech/LLMKube: Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.

Description: Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed. - defilantech/LLMKube

Open Graph Description: Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding,...

X Description: Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding,...

Opengraph URL: https://github.com/defilantech/LLMKube

X: @github

direct link

Domain: github.com

route-pattern	/:user_id/:repository
route-controller	files
route-action	disambiguate
fetch-nonce	v2:bc9a96bd-7ffa-7c10-1321-50cfd810c3f5
current-catalog-service-hash	f3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-id	8EBE:327072:90B9AE:C11D97:6A4C4A32
html-safe-nonce	84e45665a2259a1e0e63e723d46be4d6f5cab070f44f8c7e7b68344858ff9472
visitor-payload	eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI4RUJFOjMyNzA3Mjo5MEI5QUU6QzExRDk3OjZBNEM0QTMyIiwidmlzaXRvcl9pZCI6IjQ3OTU4OTg3NDM3ODkyMTAxNjIiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmac	b2dec08952c683338ca1b899041df259ea98964645b5f2634ab11eb427a34996
hovercard-subject-tag	repository:1095330682
github-keyboard-shortcuts	repository,copilot
google-site-verification	Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-url	https://collector.github.com/github/collect
analytics-location	//
fb:app_id	1401488693436528
apple-itunes-app	app-id=1477376905, app-argument=https://github.com/defilantech/llmkube
twitter:image	https://opengraph.githubassets.com/9ee51620a582b210b049103a8f9f2ef053ec2ba071275a562eb7f59f55c0a709/defilantech/LLMKube
twitter:card	summary_large_image
og:image	https://opengraph.githubassets.com/9ee51620a582b210b049103a8f9f2ef053ec2ba071275a562eb7f59f55c0a709/defilantech/LLMKube
og:image:alt	Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding,...
og:image:width	1200
og:image:height	600
og:site_name	GitHub
og:type	object
hostname	github.com
expected-hostname	github.com
None	3d11bb817438277de2a940854450e83a7d32b6aeb5014e9e6b00a6423900251c
turbo-cache-control	no-cache
go-import	github.com/defilantech/LLMKube git https://github.com/defilantech/LLMKube.git
octolytics-dimension-user_id	69058620
octolytics-dimension-user_login	defilantech
octolytics-dimension-repository_id	1095330682
octolytics-dimension-repository_nwo	defilantech/LLMKube
octolytics-dimension-repository_public	true
octolytics-dimension-repository_is_fork	false
octolytics-dimension-repository_network_root_id	1095330682
octolytics-dimension-repository_network_root_nwo	defilantech/LLMKube
turbo-body-classes	logged-out env-production page-responsive
disable-turbo	false
browser-stats-url	https://api.github.com/_private/browser/stats
browser-errors-url	https://api.github.com/_private/browser/errors
release	65d78903193f110d7a9d1f8587c6dc3cb911aae0
ui-target	full
theme-color	#1e2327
color-scheme	light dark

Links:

Skip to content	https://github.com/defilantech/llmkube#start-of-content
	https://github.com/
Sign in	https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fdefilantech%2Fllmkube
GitHub CopilotWrite better code with AI	https://github.com/features/copilot
GitHub Copilot appDirect agents from issue to merge	https://github.com/features/ai/github-app
MCP RegistryNewIntegrate external tools	https://github.com/mcp
ActionsAutomate any workflow	https://github.com/features/actions
CodespacesInstant dev environments	https://github.com/features/codespaces
IssuesPlan and track work	https://github.com/features/issues
Code ReviewManage code changes	https://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilities	https://github.com/security/advanced-security
Code securitySecure your code as you build	https://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they start	https://github.com/security/advanced-security/secret-protection
Why GitHub	https://github.com/why-github
Documentation	https://docs.github.com
Blog	https://github.blog
Changelog	https://github.blog/changelog
Marketplace	https://github.com/marketplace
View all features	https://github.com/features
Enterprises	https://github.com/enterprise
Small and medium teams	https://github.com/team
Startups	https://github.com/enterprise/startups
Nonprofits	https://github.com/solutions/industry/nonprofits
App Modernization	https://github.com/solutions/use-case/app-modernization
DevSecOps	https://github.com/solutions/use-case/devsecops
DevOps	https://github.com/solutions/use-case/devops
CI/CD	https://github.com/solutions/use-case/ci-cd
View all use cases	https://github.com/solutions/use-case
Healthcare	https://github.com/solutions/industry/healthcare
Financial services	https://github.com/solutions/industry/financial-services
Manufacturing	https://github.com/solutions/industry/manufacturing
Government	https://github.com/solutions/industry/government
View all industries	https://github.com/solutions/industry
View all solutions	https://github.com/solutions
AI	https://github.com/resources/articles?topic=ai
Software Development	https://github.com/resources/articles?topic=software-development
DevOps	https://github.com/resources/articles?topic=devops
Security	https://github.com/resources/articles?topic=security
View all topics	https://github.com/resources/articles
Customer stories	https://github.com/customer-stories
Events & webinars	https://github.com/resources/events
Ebooks & reports	https://github.com/resources/whitepapers
Business insights	https://github.com/solutions/executive-insights
GitHub Skills	https://skills.github.com
Documentation	https://docs.github.com
Customer support	https://support.github.com
Community forum	https://github.com/orgs/community/discussions
Trust center	https://github.com/trust-center
Partners	https://github.com/partners
View all resources	https://github.com/resources
GitHub SponsorsFund open source developers	https://github.com/sponsors
Security Lab	https://securitylab.github.com
Maintainer Community	https://maintainers.github.com
Accelerator	https://github.com/accelerator
GitHub Stars	https://stars.github.com
Archive Program	https://archiveprogram.github.com
Topics	https://github.com/topics
Trending	https://github.com/trending
Collections	https://github.com/collections
Enterprise platformAI-powered developer platform	https://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security features	https://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI features	https://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 support	https://github.com/premium-support
Pricing	https://github.com/pricing
Search syntax tips	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentation	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in	https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fdefilantech%2Fllmkube
Sign up	https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=defilantech%2FLLMKube
Reload	https://github.com/defilantech/llmkube
Reload	https://github.com/defilantech/llmkube
Reload	https://github.com/defilantech/llmkube
Please reload this page	https://github.com/defilantech/llmkube
defilantech	https://github.com/defilantech
LLMKube	https://github.com/defilantech/LLMKube
Please reload this page	https://github.com/defilantech/llmkube
Notifications	https://github.com/login?return_to=%2Fdefilantech%2FLLMKube
Fork 24	https://github.com/login?return_to=%2Fdefilantech%2FLLMKube
Star 162	https://github.com/login?return_to=%2Fdefilantech%2FLLMKube
Code	https://github.com/defilantech/LLMKube
Issues 51	https://github.com/defilantech/LLMKube/issues
Pull requests 5	https://github.com/defilantech/LLMKube/pulls
Discussions	https://github.com/defilantech/LLMKube/discussions
Actions	https://github.com/defilantech/LLMKube/actions
Projects	https://github.com/defilantech/LLMKube/projects
Security and quality 0	https://github.com/defilantech/LLMKube/security
Insights	https://github.com/defilantech/LLMKube/pulse
Code	https://github.com/defilantech/LLMKube
Issues	https://github.com/defilantech/LLMKube/issues
Pull requests	https://github.com/defilantech/LLMKube/pulls
Discussions	https://github.com/defilantech/LLMKube/discussions
Actions	https://github.com/defilantech/LLMKube/actions
Projects	https://github.com/defilantech/LLMKube/projects
Security and quality	https://github.com/defilantech/LLMKube/security
Insights	https://github.com/defilantech/LLMKube/pulse
	https://github.com/defilantech/LLMKube
Branches	https://github.com/defilantech/LLMKube/branches
Tags	https://github.com/defilantech/LLMKube/tags
	https://github.com/defilantech/LLMKube/branches
	https://github.com/defilantech/LLMKube/tags
630 Commits	https://github.com/defilantech/LLMKube/commits/main/
	https://github.com/defilantech/LLMKube/commits/main/
.devcontainer	https://github.com/defilantech/LLMKube/tree/main/.devcontainer
.devcontainer	https://github.com/defilantech/LLMKube/tree/main/.devcontainer
.github	https://github.com/defilantech/LLMKube/tree/main/.github
.github	https://github.com/defilantech/LLMKube/tree/main/.github
api	https://github.com/defilantech/LLMKube/tree/main/api
api	https://github.com/defilantech/LLMKube/tree/main/api
catalog	https://github.com/defilantech/LLMKube/tree/main/catalog
catalog	https://github.com/defilantech/LLMKube/tree/main/catalog
charts	https://github.com/defilantech/LLMKube/tree/main/charts
charts	https://github.com/defilantech/LLMKube/tree/main/charts
cmd	https://github.com/defilantech/LLMKube/tree/main/cmd
cmd	https://github.com/defilantech/LLMKube/tree/main/cmd
config	https://github.com/defilantech/LLMKube/tree/main/config
config	https://github.com/defilantech/LLMKube/tree/main/config
deployment	https://github.com/defilantech/LLMKube/tree/main/deployment
deployment	https://github.com/defilantech/LLMKube/tree/main/deployment
docs	https://github.com/defilantech/LLMKube/tree/main/docs
docs	https://github.com/defilantech/LLMKube/tree/main/docs
examples	https://github.com/defilantech/LLMKube/tree/main/examples
examples	https://github.com/defilantech/LLMKube/tree/main/examples
hack	https://github.com/defilantech/LLMKube/tree/main/hack
hack	https://github.com/defilantech/LLMKube/tree/main/hack
internal	https://github.com/defilantech/LLMKube/tree/main/internal
internal	https://github.com/defilantech/LLMKube/tree/main/internal
pkg	https://github.com/defilantech/LLMKube/tree/main/pkg
pkg	https://github.com/defilantech/LLMKube/tree/main/pkg
scripts	https://github.com/defilantech/LLMKube/tree/main/scripts
scripts	https://github.com/defilantech/LLMKube/tree/main/scripts
terraform	https://github.com/defilantech/LLMKube/tree/main/terraform
terraform	https://github.com/defilantech/LLMKube/tree/main/terraform
test	https://github.com/defilantech/LLMKube/tree/main/test
test	https://github.com/defilantech/LLMKube/tree/main/test
.dockerignore	https://github.com/defilantech/LLMKube/blob/main/.dockerignore
.dockerignore	https://github.com/defilantech/LLMKube/blob/main/.dockerignore
.gitignore	https://github.com/defilantech/LLMKube/blob/main/.gitignore
.gitignore	https://github.com/defilantech/LLMKube/blob/main/.gitignore
.golangci.yml	https://github.com/defilantech/LLMKube/blob/main/.golangci.yml
.golangci.yml	https://github.com/defilantech/LLMKube/blob/main/.golangci.yml
.goreleaser.yaml	https://github.com/defilantech/LLMKube/blob/main/.goreleaser.yaml
.goreleaser.yaml	https://github.com/defilantech/LLMKube/blob/main/.goreleaser.yaml
.release-please-manifest.json	https://github.com/defilantech/LLMKube/blob/main/.release-please-manifest.json
.release-please-manifest.json	https://github.com/defilantech/LLMKube/blob/main/.release-please-manifest.json
ADOPTERS.md	https://github.com/defilantech/LLMKube/blob/main/ADOPTERS.md
ADOPTERS.md	https://github.com/defilantech/LLMKube/blob/main/ADOPTERS.md
AGENTS.md	https://github.com/defilantech/LLMKube/blob/main/AGENTS.md
AGENTS.md	https://github.com/defilantech/LLMKube/blob/main/AGENTS.md
CHANGELOG.md	https://github.com/defilantech/LLMKube/blob/main/CHANGELOG.md
CHANGELOG.md	https://github.com/defilantech/LLMKube/blob/main/CHANGELOG.md
CODE_OF_CONDUCT.md	https://github.com/defilantech/LLMKube/blob/main/CODE_OF_CONDUCT.md
CODE_OF_CONDUCT.md	https://github.com/defilantech/LLMKube/blob/main/CODE_OF_CONDUCT.md
CONTRIBUTING.md	https://github.com/defilantech/LLMKube/blob/main/CONTRIBUTING.md
CONTRIBUTING.md	https://github.com/defilantech/LLMKube/blob/main/CONTRIBUTING.md
Dockerfile	https://github.com/defilantech/LLMKube/blob/main/Dockerfile
Dockerfile	https://github.com/defilantech/LLMKube/blob/main/Dockerfile
Dockerfile.foreman-agent	https://github.com/defilantech/LLMKube/blob/main/Dockerfile.foreman-agent
Dockerfile.foreman-agent	https://github.com/defilantech/LLMKube/blob/main/Dockerfile.foreman-agent
Dockerfile.foreman-agent-builder	https://github.com/defilantech/LLMKube/blob/main/Dockerfile.foreman-agent-builder
Dockerfile.foreman-agent-builder	https://github.com/defilantech/LLMKube/blob/main/Dockerfile.foreman-agent-builder
Dockerfile.foreman-agent.goreleaser	https://github.com/defilantech/LLMKube/blob/main/Dockerfile.foreman-agent.goreleaser
Dockerfile.foreman-agent.goreleaser	https://github.com/defilantech/LLMKube/blob/main/Dockerfile.foreman-agent.goreleaser
Dockerfile.foreman-operator	https://github.com/defilantech/LLMKube/blob/main/Dockerfile.foreman-operator
Dockerfile.foreman-operator	https://github.com/defilantech/LLMKube/blob/main/Dockerfile.foreman-operator
Dockerfile.foreman-operator.goreleaser	https://github.com/defilantech/LLMKube/blob/main/Dockerfile.foreman-operator.goreleaser
Dockerfile.foreman-operator.goreleaser	https://github.com/defilantech/LLMKube/blob/main/Dockerfile.foreman-operator.goreleaser
Dockerfile.goreleaser	https://github.com/defilantech/LLMKube/blob/main/Dockerfile.goreleaser
Dockerfile.goreleaser	https://github.com/defilantech/LLMKube/blob/main/Dockerfile.goreleaser
Dockerfile.router-proxy	https://github.com/defilantech/LLMKube/blob/main/Dockerfile.router-proxy
Dockerfile.router-proxy	https://github.com/defilantech/LLMKube/blob/main/Dockerfile.router-proxy
Dockerfile.router-proxy.goreleaser	https://github.com/defilantech/LLMKube/blob/main/Dockerfile.router-proxy.goreleaser
Dockerfile.router-proxy.goreleaser	https://github.com/defilantech/LLMKube/blob/main/Dockerfile.router-proxy.goreleaser
LICENSE	https://github.com/defilantech/LLMKube/blob/main/LICENSE
LICENSE	https://github.com/defilantech/LLMKube/blob/main/LICENSE
MAINTAINERS.md	https://github.com/defilantech/LLMKube/blob/main/MAINTAINERS.md
MAINTAINERS.md	https://github.com/defilantech/LLMKube/blob/main/MAINTAINERS.md
Makefile	https://github.com/defilantech/LLMKube/blob/main/Makefile
Makefile	https://github.com/defilantech/LLMKube/blob/main/Makefile
PROJECT	https://github.com/defilantech/LLMKube/blob/main/PROJECT
PROJECT	https://github.com/defilantech/LLMKube/blob/main/PROJECT
README.md	https://github.com/defilantech/LLMKube/blob/main/README.md
README.md	https://github.com/defilantech/LLMKube/blob/main/README.md
ROADMAP.md	https://github.com/defilantech/LLMKube/blob/main/ROADMAP.md
ROADMAP.md	https://github.com/defilantech/LLMKube/blob/main/ROADMAP.md
SECURITY.md	https://github.com/defilantech/LLMKube/blob/main/SECURITY.md
SECURITY.md	https://github.com/defilantech/LLMKube/blob/main/SECURITY.md
codecov.yml	https://github.com/defilantech/LLMKube/blob/main/codecov.yml
codecov.yml	https://github.com/defilantech/LLMKube/blob/main/codecov.yml
go.mod	https://github.com/defilantech/LLMKube/blob/main/go.mod
go.mod	https://github.com/defilantech/LLMKube/blob/main/go.mod
go.sum	https://github.com/defilantech/LLMKube/blob/main/go.sum
go.sum	https://github.com/defilantech/LLMKube/blob/main/go.sum
install.sh	https://github.com/defilantech/LLMKube/blob/main/install.sh
install.sh	https://github.com/defilantech/LLMKube/blob/main/install.sh
release-please-config.json	https://github.com/defilantech/LLMKube/blob/main/release-please-config.json
release-please-config.json	https://github.com/defilantech/LLMKube/blob/main/release-please-config.json
README	https://github.com/defilantech/llmkube
Code of conduct	https://github.com/defilantech/llmkube
Contributing	https://github.com/defilantech/llmkube
Apache-2.0 license	https://github.com/defilantech/llmkube
Security	https://github.com/defilantech/llmkube
	https://github.com/defilantech/LLMKube/blob/main/docs/images/logo.png
	https://github.com/defilantech/llmkube#llmkube
	https://github.com/defilantech/llmkube#the-kubernetes-operator-for-self-hosted-llm-inference
Foreman	https://github.com/defilantech/llmkube#foreman
	https://github.com/defilantech/LLMKube/actions/workflows/test.yml
	https://github.com/defilantech/LLMKube/actions/workflows/helm-chart.yml
	https://goreportcard.com/report/github.com/defilantech/llmkube
	https://github.com/defilantech/LLMKube/releases
	https://github.com/defilantech/LLMKube/stargazers
	https://github.com/defilantech/LLMKube/blob/main/LICENSE
	https://camo.githubusercontent.com/3ee2a6002d7ddfd67d5e5b0240e9f9f8ae02b24cab4215eaf1575e809e785d4d/68747470733a2f2f696d672e736869656c64732e696f2f6769746875622f676f2d6d6f642f676f2d76657273696f6e2f646566696c616e746563682f4c4c4d4b756265
	https://discord.gg/Ktz85RFHDv
Quick Start	https://github.com/defilantech/llmkube#quick-start
ModelRouter	https://github.com/defilantech/llmkube#composition-modelrouter
Foreman	https://github.com/defilantech/llmkube#foreman
Metal Agent	https://github.com/defilantech/llmkube#the-metal-agent
Why LLMKube?	https://github.com/defilantech/llmkube#how-is-this-different
Benchmarks	https://github.com/defilantech/llmkube#performance
Roadmap	https://github.com/defilantech/LLMKube/blob/main/ROADMAP.md
Discord	https://discord.gg/Ktz85RFHDv
	https://github.com/defilantech/llmkube#the-problem
#508	https://github.com/defilantech/LLMKube/pull/508
#588	https://github.com/defilantech/LLMKube/pull/588
Foreman	https://github.com/defilantech/llmkube#foreman
live Foreman docs	https://llmkube.com/docs/foreman
Composition: ModelRouter	https://github.com/defilantech/llmkube#composition-modelrouter
	https://github.com/defilantech/llmkube#architecture
deployment/macos/README.md	https://github.com/defilantech/LLMKube/blob/main/deployment/macos/README.md
	https://github.com/defilantech/llmkube#see-it-in-action
	https://llmkube.com/docs/getting-started
llmkube.com/docs/getting-started	https://llmkube.com/docs/getting-started
	https://github.com/defilantech/llmkube#quick-start
Minikube Quickstart	https://github.com/defilantech/LLMKube/blob/main/docs/minikube-quickstart.md
GKE with GPUs	https://github.com/defilantech/LLMKube/blob/main/docs/gpu-setup-guide.md
Intel GPU Quickstart	https://github.com/defilantech/LLMKube/blob/main/docs/intel-gpu-quickstart.md
DGX Spark (MicroK8s)	https://github.com/defilantech/LLMKube/blob/main/docs/dgx-spark-microk8s.md
Air-Gapped Deployment	https://github.com/defilantech/LLMKube/blob/main/docs/air-gapped-quickstart.md
OpenShift	https://github.com/defilantech/llmkube#troubleshooting
	https://github.com/defilantech/llmkube#the-metal-agent
Full Metal Agent guide →	https://github.com/defilantech/LLMKube/blob/main/deployment/macos/README.md
	https://github.com/defilantech/llmkube#composition-modelrouter
Full ModelRouter concept doc →	https://github.com/defilantech/LLMKube/blob/main/docs/site/concepts/model-router.md
Sample manifest	https://github.com/defilantech/LLMKube/blob/main/config/samples/inference_v1alpha1_modelrouter.yaml
	https://github.com/defilantech/llmkube#foreman
	https://github.com/defilantech/LLMKube/blob/main/docs/site/images/foreman-logo-icon.svg
#508	https://github.com/defilantech/LLMKube/pull/508
#588	https://github.com/defilantech/LLMKube/pull/588
Full Foreman docs →	https://llmkube.com/docs/foreman
Model compatibility table	https://llmkube.com/docs/foreman/model-compatibility
Sample manifests	https://github.com/defilantech/LLMKube/blob/main/examples/foreman
	https://github.com/defilantech/llmkube#how-is-this-different
	https://github.com/defilantech/llmkube#performance
	https://github.com/defilantech/llmkube#cloud-gpu-gke-nvidia-l4
	https://github.com/defilantech/llmkube#desktop-gpu-dual-rtx-5060-ti
v0.4 release notes	https://github.com/defilantech/LLMKube/blob/main/docs/releases/RELEASE_NOTES_v0.4.0.md
	https://github.com/defilantech/llmkube#features
guide	https://github.com/defilantech/LLMKube/blob/main/docs/MODEL-CACHE.md
ModelRouter	https://github.com/defilantech/llmkube#composition-modelrouter
Metal Agent	https://github.com/defilantech/LLMKube/blob/main/deployment/macos
guide	https://github.com/defilantech/LLMKube/blob/main/docs/MULTI-GPU-DEPLOYMENT.md
	https://github.com/defilantech/llmkube#use-the-api
	https://github.com/defilantech/llmkube#installation
	https://github.com/defilantech/llmkube#helm-recommended
	https://github.com/defilantech/llmkube#cli
	https://github.com/defilantech/llmkube#from-source
Helm Chart docs	https://github.com/defilantech/LLMKube/blob/main/charts/llmkube/README.md
Minikube Quickstart	https://github.com/defilantech/LLMKube/blob/main/docs/minikube-quickstart.md
GKE GPU Setup	https://github.com/defilantech/LLMKube/blob/main/docs/gpu-setup-guide.md
	https://github.com/defilantech/llmkube#troubleshooting
	https://github.com/defilantech/llmkube#contributing
CONTRIBUTING.md	https://github.com/defilantech/LLMKube/blob/main/CONTRIBUTING.md
	https://github.com/defilantech/llmkube#contributors
	https://github.com/defilantech/LLMKube/graphs/contributors
	https://github.com/defilantech/llmkube#community
Discord	https://discord.gg/Ktz85RFHDv
GitHub Issues	https://github.com/defilantech/LLMKube/issues
GitHub Discussions	https://github.com/defilantech/LLMKube/discussions
ROADMAP.md	https://github.com/defilantech/LLMKube/blob/main/ROADMAP.md
	https://github.com/defilantech/llmkube#acknowledgments
Kubebuilder	https://kubebuilder.io
llama.cpp	https://github.com/ggml-org/llama.cpp
Prometheus	https://prometheus.io
Helm	https://helm.sh
	https://github.com/defilantech/llmkube#license
LICENSE	https://github.com/defilantech/LLMKube/blob/main/LICENSE
	https://github.com/defilantech/llmkube#trademarks
Get started in 5 minutes →	https://github.com/defilantech/LLMKube/blob/main/docs/minikube-quickstart.md
a star helps others find it	https://github.com/defilantech/LLMKube
llmkube.com	https://llmkube.com
kubernetes	https://github.com/topics/kubernetes
ai	https://github.com/topics/ai
metal	https://github.com/topics/metal
gpu	https://github.com/topics/gpu
inference	https://github.com/topics/inference
self-hosted	https://github.com/topics/self-hosted
nvidia	https://github.com/topics/nvidia
kubernetes-operator	https://github.com/topics/kubernetes-operator
autoscaling	https://github.com/topics/autoscaling
homelab	https://github.com/topics/homelab
multi-gpu	https://github.com/topics/multi-gpu
mlx	https://github.com/topics/mlx
edge-computing	https://github.com/topics/edge-computing
tgi	https://github.com/topics/tgi
apple-silicon	https://github.com/topics/apple-silicon
llm	https://github.com/topics/llm
llama-cpp	https://github.com/topics/llama-cpp
vllm	https://github.com/topics/vllm
local-llm	https://github.com/topics/local-llm
gguf	https://github.com/topics/gguf
Readme	https://github.com/defilantech/llmkube#readme-ov-file
Apache-2.0 license	https://github.com/defilantech/llmkube#Apache-2.0-1-ov-file
Code of conduct	https://github.com/defilantech/llmkube#coc-ov-file
Contributing	https://github.com/defilantech/llmkube#contributing-ov-file
Security policy	https://github.com/defilantech/llmkube#security-ov-file
Please reload this page	https://github.com/defilantech/llmkube
Activity	https://github.com/defilantech/LLMKube/activity
Custom properties	https://github.com/defilantech/LLMKube/custom-properties
24 forks	https://github.com/defilantech/LLMKube/forks
Report repository	https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Fdefilantech%2FLLMKube&report=defilantech+%28user%29
Releases 173	https://github.com/defilantech/LLMKube/releases
v0.9.0 Latest Jul 5, 2026	https://github.com/defilantech/LLMKube/releases/tag/v0.9.0
+ 172 releases	https://github.com/defilantech/LLMKube/releases
Please reload this page	https://github.com/defilantech/llmkube
Learn more about GitHub Sponsors	https://github.com/sponsors
Packages 0	https://github.com/orgs/defilantech/packages?repo_name=LLMKube
Please reload this page	https://github.com/defilantech/llmkube
Please reload this page	https://github.com/defilantech/llmkube
Contributors	https://github.com/defilantech/LLMKube/graphs/contributors
Please reload this page	https://github.com/defilantech/llmkube
Go 96.9%	https://github.com/defilantech/LLMKube/search?l=go
Shell 1.9%	https://github.com/defilantech/LLMKube/search?l=shell
	https://github.com
Terms	https://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacy	https://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Security	https://github.com/security
Status	https://www.githubstatus.com/
Community	https://github.community/
Docs	https://docs.github.com/
Contact	https://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.