| react-profiling | 0 |
| react-import-map | react,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322 |
| route-pattern | /:user_id/:repository |
| route-controller | files |
| route-action | disambiguate |
| fetch-nonce | v2:a30e6a52-8d08-4417-4b64-410db58be697 |
| current-catalog-service-hash | f3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb |
| request-id | B7BC:302CFA:2232E44:2D783BF:6B03691F |
| html-safe-nonce | 839c3fb8c0c8ecbc8b6f0fc7e3d1d0a25415f5f701b2b3466f326fcdaca41235 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJCN0JDOjMwMkNGQToyMjMyRTQ0OjJENzgzQkY6NkIwMzY5MUYiLCJ2aXNpdG9yX2lkIjoiMjk1Njc3NDYxNzg2OTY3NDc4MyIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9 |
| visitor-hmac | 091c39aa40bf84bbd2be7d84530e98818aebf3fe91ecf347e0c32c39a1fc213a |
| hovercard-subject-tag | repository:1263554756 |
| github-keyboard-shortcuts | repository,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | // |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/neverCase/Mooncake |
| twitter:image | https://opengraph.githubassets.com/83d41531839978f45a6cf9bd9a575c9cc7c880be08abb25af8179cea62d56e1c/neverCase/Mooncake |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/83d41531839978f45a6cf9bd9a575c9cc7c880be08abb25af8179cea62d56e1c/neverCase/Mooncake |
| og:image:alt | Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI. - neverCase/Mooncake |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| hostname | github.com |
| expected-hostname | github.com |
| None | 87e774ee7c6b3bee0490394e4d3e57ec9dbc956f74b87ea685dc8996c1676456 |
| turbo-cache-control | no-cache |
| go-import | github.com/neverCase/Mooncake git https://github.com/neverCase/Mooncake.git |
| octolytics-dimension-user_id | 21275863 |
| octolytics-dimension-user_login | neverCase |
| octolytics-dimension-repository_id | 1263554756 |
| octolytics-dimension-repository_nwo | neverCase/Mooncake |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | true |
| octolytics-dimension-repository_parent_id | 819733173 |
| octolytics-dimension-repository_parent_nwo | kvcache-ai/Mooncake |
| octolytics-dimension-repository_network_root_id | 819733173 |
| octolytics-dimension-repository_network_root_nwo | kvcache-ai/Mooncake |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 423dbb54c5e7bfecc838eb387c1435eb3d0e760d |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
| Skip to content | https://github.com/neverCase/Mooncake#start-of-content |
| https://github.com/ |
| Sign in | https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FneverCase%2FMooncake |
| GitHubRepository hosting, code review, and collaboration | https://github.com/platform |
| CopilotAI coding agent for tasks, projects, and automated work | https://github.com/features/copilot |
| ActionsCI/CD and automation | https://github.com/features/actions |
| Code QualityQuality analysis, fixes, and enforcement | https://github.com/features/code-quality |
| CodespacesCloud development environments | https://github.com/features/codespaces |
| Code SecurityVulnerability detection and remediation | https://github.com/security/advanced-security/code-security |
| Secret ProtectionSecret scanning and leak prevention | https://github.com/security/advanced-security/secret-protection |
| All Features | https://github.com/features |
| Documentation | https://docs.github.com/en |
| Training | https://learn.github.com/skills |
| Certifications | https://learn.github.com/credentials |
| Build with Copilot | https://github.com/features/ai |
| Customize Copilot | https://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview |
| Integrations | https://github.com/marketplace |
| Trending repos | https://github.com/trending |
| GitHub Sponsors | https://github.com/open-source/sponsors |
| Developer articles | https://github.com/resources/articles |
| ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place. | https://github.blog/changelog/ |
| Enterprises | https://github.com/enterprise |
| Team | https://github.com/team |
| Startups | https://github.com/enterprise/startups |
| Nonprofits | https://github.com/solutions/industry/nonprofits |
| Healthcare | https://github.com/solutions/industry/healthcare |
| Financial services | https://github.com/solutions/industry/financial-services |
| Manufacturing | https://github.com/solutions/industry/manufacturing |
| Government | https://github.com/solutions/industry/government |
| See all industries | https://github.com/solutions/industry |
| Why GitHub | https://github.com/why-github |
| Customer Stories | https://github.com/customer-stories |
| Business insights | https://github.com/solutions/executive-insights |
| Trust Center | https://github.com/trust-center |
| GitHub Advanced SecurityEnterprise-grade code security | https://github.com/security/advanced-security |
| Copilot for businessEnterprise-grade AI features | https://github.com/features/copilot/copilot-business |
| Premium SupportEnterprise-grade 24/7 support | https://github.com/enterprise/premium-support |
| Documentation | https://docs.github.com/en |
| Resource center | https://github.com/resources |
| Blog | https://github.blog/ |
| Events & webinars | https://github.com/resources/events |
| Community Forum | https://github.com/orgs/community/discussions |
| Customer Stories | https://github.com/customer-stories |
| Integrations | https://github.com/marketplace |
| Customer support | https://help.github.com/ |
| Training | https://learn.github.com/skills |
| GitHub Status | https://www.githubstatus.com/ |
| About | https://github.com/about |
| Partners | https://github.com/partners |
| Changelog | https://github.blog/changelog/ |
| GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub. | https://githubuniverse.com/ |
| Pricing | https://github.com/pricing |
| Sign in | https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FneverCase%2FMooncake |
| Sign up | https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=neverCase%2FMooncake |
| Reload | https://github.com/neverCase/Mooncake |
| Reload | https://github.com/neverCase/Mooncake |
| Reload | https://github.com/neverCase/Mooncake |
| neverCase | https://github.com/neverCase |
| Mooncake | https://github.com/neverCase/Mooncake |
| Code | https://github.com/neverCase/Mooncake |
| Pull requests | https://github.com/neverCase/Mooncake/pulls |
| Actions | https://github.com/neverCase/Mooncake/actions |
| Projects | https://github.com/neverCase/Mooncake/projects |
| Security and quality | https://github.com/neverCase/Mooncake/security |
| Insights | https://github.com/neverCase/Mooncake/pulse |
| https://github.com/neverCase/Mooncake |
| Mooncake | https://github.com/neverCase/Mooncake |
| kvcache-ai/Mooncake | https://github.com/kvcache-ai/Mooncake |
| Notifications | https://github.com/login?return_to=%2FneverCase%2FMooncake |
| Fork0 (0) | https://github.com/login?return_to=%2FneverCase%2FMooncake |
| Star0 (0) | https://github.com/login?return_to=%2FneverCase%2FMooncake |
| kvcache-ai.github.io/Mooncake/ | https://kvcache-ai.github.io/Mooncake/ |
| Readme | https://github.com/neverCase/Mooncake#readme-ov-file |
| License | https://github.com/neverCase/Mooncake#License-1-ov-file |
| Code of conduct | https://github.com/neverCase/Mooncake#coc-ov-file |
| Contributing | https://github.com/neverCase/Mooncake#contributing-ov-file |
| Activity | https://github.com/neverCase/Mooncake/activity |
| 0 forks | https://github.com/neverCase/Mooncake/forks |
| Report repository | https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2FneverCase%2FMooncake&report=neverCase+%28user%29 |
| Branches | https://github.com/neverCase/Mooncake/branches |
| Tags | https://github.com/neverCase/Mooncake/tags |
| https://github.com/neverCase/Mooncake/branches |
| https://github.com/neverCase/Mooncake/tags |
| 2,755 Commits | https://github.com/neverCase/Mooncake/commits/main/ |
| https://github.com/neverCase/Mooncake/commits/main/ |
| .claude-plugin | https://github.com/neverCase/Mooncake/tree/main/.claude-plugin |
| .claude-plugin | https://github.com/neverCase/Mooncake/tree/main/.claude-plugin |
| .claude/skills | https://github.com/neverCase/Mooncake/tree/main/.claude/skills |
| .claude/skills | https://github.com/neverCase/Mooncake/tree/main/.claude/skills |
| .devcontainer | https://github.com/neverCase/Mooncake/tree/main/.devcontainer |
| .devcontainer | https://github.com/neverCase/Mooncake/tree/main/.devcontainer |
| .github | https://github.com/neverCase/Mooncake/tree/main/.github |
| .github | https://github.com/neverCase/Mooncake/tree/main/.github |
| FAST25-release | https://github.com/neverCase/Mooncake/tree/main/FAST25-release |
| FAST25-release | https://github.com/neverCase/Mooncake/tree/main/FAST25-release |
| benchmarks | https://github.com/neverCase/Mooncake/tree/main/benchmarks |
| benchmarks | https://github.com/neverCase/Mooncake/tree/main/benchmarks |
| cmake | https://github.com/neverCase/Mooncake/tree/main/cmake |
| cmake | https://github.com/neverCase/Mooncake/tree/main/cmake |
| docker | https://github.com/neverCase/Mooncake/tree/main/docker |
| docker | https://github.com/neverCase/Mooncake/tree/main/docker |
| docs | https://github.com/neverCase/Mooncake/tree/main/docs |
| docs | https://github.com/neverCase/Mooncake/tree/main/docs |
| extern | https://github.com/neverCase/Mooncake/tree/main/extern |
| extern | https://github.com/neverCase/Mooncake/tree/main/extern |
| image | https://github.com/neverCase/Mooncake/tree/main/image |
| image | https://github.com/neverCase/Mooncake/tree/main/image |
| monitoring | https://github.com/neverCase/Mooncake/tree/main/monitoring |
| monitoring | https://github.com/neverCase/Mooncake/tree/main/monitoring |
| mooncake-common | https://github.com/neverCase/Mooncake/tree/main/mooncake-common |
| mooncake-common | https://github.com/neverCase/Mooncake/tree/main/mooncake-common |
| mooncake-conductor | https://github.com/neverCase/Mooncake/tree/main/mooncake-conductor |
| mooncake-conductor | https://github.com/neverCase/Mooncake/tree/main/mooncake-conductor |
| mooncake-ep | https://github.com/neverCase/Mooncake/tree/main/mooncake-ep |
| mooncake-ep | https://github.com/neverCase/Mooncake/tree/main/mooncake-ep |
| mooncake-integration | https://github.com/neverCase/Mooncake/tree/main/mooncake-integration |
| mooncake-integration | https://github.com/neverCase/Mooncake/tree/main/mooncake-integration |
| mooncake-p2p-store | https://github.com/neverCase/Mooncake/tree/main/mooncake-p2p-store |
| mooncake-p2p-store | https://github.com/neverCase/Mooncake/tree/main/mooncake-p2p-store |
| mooncake-pg | https://github.com/neverCase/Mooncake/tree/main/mooncake-pg |
| mooncake-pg | https://github.com/neverCase/Mooncake/tree/main/mooncake-pg |
| mooncake-reshard | https://github.com/neverCase/Mooncake/tree/main/mooncake-reshard |
| mooncake-reshard | https://github.com/neverCase/Mooncake/tree/main/mooncake-reshard |
| mooncake-rl/examples | https://github.com/neverCase/Mooncake/tree/main/mooncake-rl/examples |
| mooncake-rl/examples | https://github.com/neverCase/Mooncake/tree/main/mooncake-rl/examples |
| mooncake-store-rs | https://github.com/neverCase/Mooncake/tree/main/mooncake-store-rs |
| mooncake-store-rs | https://github.com/neverCase/Mooncake/tree/main/mooncake-store-rs |
| mooncake-store | https://github.com/neverCase/Mooncake/tree/main/mooncake-store |
| mooncake-store | https://github.com/neverCase/Mooncake/tree/main/mooncake-store |
| mooncake-transfer-engine | https://github.com/neverCase/Mooncake/tree/main/mooncake-transfer-engine |
| mooncake-transfer-engine | https://github.com/neverCase/Mooncake/tree/main/mooncake-transfer-engine |
| mooncake-wheel | https://github.com/neverCase/Mooncake/tree/main/mooncake-wheel |
| mooncake-wheel | https://github.com/neverCase/Mooncake/tree/main/mooncake-wheel |
| python | https://github.com/neverCase/Mooncake/tree/main/python |
| python | https://github.com/neverCase/Mooncake/tree/main/python |
| scripts | https://github.com/neverCase/Mooncake/tree/main/scripts |
| scripts | https://github.com/neverCase/Mooncake/tree/main/scripts |
| .clang-format | https://github.com/neverCase/Mooncake/blob/main/.clang-format |
| .clang-format | https://github.com/neverCase/Mooncake/blob/main/.clang-format |
| .cmake-format.json | https://github.com/neverCase/Mooncake/blob/main/.cmake-format.json |
| .cmake-format.json | https://github.com/neverCase/Mooncake/blob/main/.cmake-format.json |
| .dockerignore | https://github.com/neverCase/Mooncake/blob/main/.dockerignore |
| .dockerignore | https://github.com/neverCase/Mooncake/blob/main/.dockerignore |
| .gitignore | https://github.com/neverCase/Mooncake/blob/main/.gitignore |
| .gitignore | https://github.com/neverCase/Mooncake/blob/main/.gitignore |
| .gitmodules | https://github.com/neverCase/Mooncake/blob/main/.gitmodules |
| .gitmodules | https://github.com/neverCase/Mooncake/blob/main/.gitmodules |
| .pre-commit-config.yaml | https://github.com/neverCase/Mooncake/blob/main/.pre-commit-config.yaml |
| .pre-commit-config.yaml | https://github.com/neverCase/Mooncake/blob/main/.pre-commit-config.yaml |
| .typos.toml | https://github.com/neverCase/Mooncake/blob/main/.typos.toml |
| .typos.toml | https://github.com/neverCase/Mooncake/blob/main/.typos.toml |
| AGENTS.md | https://github.com/neverCase/Mooncake/blob/main/AGENTS.md |
| AGENTS.md | https://github.com/neverCase/Mooncake/blob/main/AGENTS.md |
| CLAUDE.md | https://github.com/neverCase/Mooncake/blob/main/CLAUDE.md |
| CLAUDE.md | https://github.com/neverCase/Mooncake/blob/main/CLAUDE.md |
| CMakeLists.txt | https://github.com/neverCase/Mooncake/blob/main/CMakeLists.txt |
| CMakeLists.txt | https://github.com/neverCase/Mooncake/blob/main/CMakeLists.txt |
| CODE_OF_CONDUCT.md | https://github.com/neverCase/Mooncake/blob/main/CODE_OF_CONDUCT.md |
| CODE_OF_CONDUCT.md | https://github.com/neverCase/Mooncake/blob/main/CODE_OF_CONDUCT.md |
| CONTRIBUTING.md | https://github.com/neverCase/Mooncake/blob/main/CONTRIBUTING.md |
| CONTRIBUTING.md | https://github.com/neverCase/Mooncake/blob/main/CONTRIBUTING.md |
| DCO | https://github.com/neverCase/Mooncake/blob/main/DCO |
| DCO | https://github.com/neverCase/Mooncake/blob/main/DCO |
| LICENSE-APACHE | https://github.com/neverCase/Mooncake/blob/main/LICENSE-APACHE |
| LICENSE-APACHE | https://github.com/neverCase/Mooncake/blob/main/LICENSE-APACHE |
| MAINTAINERS.md | https://github.com/neverCase/Mooncake/blob/main/MAINTAINERS.md |
| MAINTAINERS.md | https://github.com/neverCase/Mooncake/blob/main/MAINTAINERS.md |
| README.md | https://github.com/neverCase/Mooncake/blob/main/README.md |
| README.md | https://github.com/neverCase/Mooncake/blob/main/README.md |
| dependencies.sh | https://github.com/neverCase/Mooncake/blob/main/dependencies.sh |
| dependencies.sh | https://github.com/neverCase/Mooncake/blob/main/dependencies.sh |
| pyproject.toml | https://github.com/neverCase/Mooncake/blob/main/pyproject.toml |
| pyproject.toml | https://github.com/neverCase/Mooncake/blob/main/pyproject.toml |
| requirements.txt | https://github.com/neverCase/Mooncake/blob/main/requirements.txt |
| requirements.txt | https://github.com/neverCase/Mooncake/blob/main/requirements.txt |
| README | https://github.com/neverCase/Mooncake |
| Code of conduct | https://github.com/neverCase/Mooncake |
| Contributing | https://github.com/neverCase/Mooncake |
| License | https://github.com/neverCase/Mooncake |
| https://github.com/neverCase/Mooncake/blob/main/image/mooncake-icon.png |
| https://github.com/neverCase/Mooncake#------a-kvcache-centric-disaggregated-architecture-for-llm-serving-- |
| Paper | https://www.usenix.org/system/files/fast25-qin.pdf |
| Slides | https://www.usenix.org/system/files/fast25_slides-qin.pdf |
| Traces | https://github.com/neverCase/Mooncake/blob/main/FAST25-release/traces |
| Documentation | https://kvcache-ai.github.io/Mooncake/ |
| Blog | https://kvcache.ai/ |
| Slack | https://join.slack.com/t/mooncake-project/shared_invite/zt-3qx4x35ea-zSSTqTHItHJs9SCoXLOSPA |
| https://pypi.org/project/mooncake-transfer-engine |
| https://github.com/kvcache-ai/Mooncake/graphs/commit-activity |
| https://github.com/kvcache-ai/Mooncake/blob/main/LICENSE-APACHE |
| https://hub.docker.com/r/kvcacheai/mooncake |
| https://pypi.org/project/mooncake-transfer-engine |
| https://pypi.org/project/mooncake-transfer-engine-cuda13 |
| https://pypi.org/project/mooncake-transfer-engine-non-cuda/ |
| https://pypi.org/project/mooncake-transfer-engine-npu/ |
| https://pypi.org/project/mooncake-transfer-engine-musa/ |
| https://pypi.org/project/mooncake-transfer-engine-rocm/ |
| Kimi | https://kimi.ai/ |
| Moonshot AI | https://www.moonshot.cn/ |
| https://github.com/neverCase/Mooncake#-updates |
| AMD ATOM integrated Mooncake | https://kvcache.ai/blog/atom-meets-mooncake/ |
| Mooncake Store connector | https://github.com/NVIDIA/TensorRT-LLM/pull/19171 |
| TokenSpeed v0.1.1 | https://github.com/lightseekorg/tokenspeed/releases/tag/v0.1.1 |
| cross-encoder embedding reuse | https://github.com/vllm-project/vllm/pull/56242 |
| encoder-cache transfer connector | https://github.com/vllm-project/vllm/pull/41567 |
| vLLM v0.31.0 | https://github.com/vllm-project/vllm/releases/tag/v0.31.0 |
| Mooncake Store support | https://github.com/InternLM/lmdeploy/pull/4903 |
| LMDeploy v0.18.0 | https://github.com/InternLM/lmdeploy/releases/tag/v0.18.0 |
| AgentX / InferenceX v3 | https://newsletter.semianalysis.com/p/agentx-inferencexv3-does-cuda-moat |
| Mooncake optimization details | https://inferencex.semianalysis.com/agentx/optimizations/mooncake |
| Miles | https://github.com/radixark/miles |
| KVCache.AI | https://kvcache.ai/blog/mooncake-rl-rollout-data-transfer/ |
| lmsys | https://www.lmsys.org/blog/2026-08-20-miles-mooncake-rollout-data-transfer |
| Speculators | https://github.com/vllm-project/speculators |
| Benchmark on GB300 NVL72 | https://x.com/mgoin_/status/2072785822231728363 |
| Mooncake PD deployment guide | https://github.com/llm-d/llm-d/pull/1511 |
| Mooncake Store tiered offloading integration | https://github.com/llm-d/llm-d/pull/1826 |
| event-driven Mooncake shared-cache index | https://github.com/ai-dynamo/dynamo/pull/11239 |
| Mooncake Store as a distributed REMOTE-tier backend | https://github.com/taco-project/FlexKV/pull/231 |
| GPUDirect RDMA support for its Mooncake Store backend | https://github.com/Ascend/TransferQueue/pull/131 |
| vLLM officially features Mooncake Store | https://vllm.ai/blog/mooncake-store |
| RDMA-based P2P weight transfer for large-scale distributed RL | https://lmsys.org/blog/2026-04-29-p2p-update/ |
| Mooncake Store L2 adapter for multiprocess mode | https://github.com/LMCache/LMCache/pull/2911 |
| TENT technical report | https://arxiv.org/abs/2604.00368 |
| TorchSpec: Speculative Decoding Training at Scale | https://pytorch.org/blog/torchspec-speculative-decoding-training-at-scale |
| open sourced | https://github.com/torchspec-project/TorchSpec |
| Mooncake Store cache read/write support to its PD pipeline | https://github.com/PaddlePaddle/FastDeploy/pull/6768 |
| global KV cache pooling | https://github.com/PaddlePaddle/FastDeploy/blob/develop/docs/features/global_cache_pooling.md |
| LightX2V | https://github.com/ModelTC/LightX2V/pull/893 |
| blog | https://light-ai.top/LightX2V-BLOG/posts/Disaggregation/ |
| Mooncake checkpoint-engine backend | https://github.com/verl-project/verl/pull/5176 |
| SGLang | https://github.com/sgl-project/sglang |
| Encoder Global Cache Manager | https://github.com/sgl-project/sglang/pull/16137 |
| vLLM-Omni | https://docs.vllm.ai/projects/vllm-omni/en/latest/design/feature/disaggregated_inference/ |
| Mooncake Joins PyTorch Ecosystem | https://pytorch.org/blog/mooncake-joins-pytorch-ecosystem/ |
| FlexKV | https://github.com/taco-project/FlexKV |
| distributed KVCache reuse | https://github.com/taco-project/FlexKV/blob/main/docs/dist_reuse/README_en.md |
| ROLL | https://github.com/alibaba/ROLL |
| here | https://arxiv.org/abs/2512.22560 |
| Encode-Prefill-Decode (EPD) Disaggregation | https://lmsys.org/blog/2026-01-12-epd/ |
| integrated into TensorRT LLM | https://github.com/NVIDIA/TensorRT-LLM/tree/main/cpp/tensorrt_llm/executor/cache_transmission/mooncake_utils |
| KV Connector | https://docs.vllm.ai/en/latest/features/mooncake_connector_usage/ |
| RBG + SGLang HiCache + Mooncake | https://github.com/sgl-project/rbg/blob/main/keps/74-mooncake-integration/README.md |
| Mooncake EP and a collective communication backend | https://github.com/sgl-project/sglang/pull/10423 |
| the distributed KV cache pool backend | https://github.com/vllm-project/vllm-ascend/blob/main/docs/source/user_guide/feature_guide/kv_cache_pool_ascend_store.md |
| hierarchical KV caching storage backend | https://lmsys.org/blog/2025-09-10-sglang-hicache/ |
| checkpoint-engine | https://github.com/MoonshotAI/checkpoint-engine/ |
| xLLM | https://github.com/jd-opensource/xllm |
| integrates Mooncake Transfer Engine | https://github.com/vllm-project/vllm-ascend/blob/main/docs/source/tutorials/features/pd_disaggregation_mooncake_multi_node.md |
| the deployment of Kimi K2 | https://lmsys.org/blog/2025-07-20-k2-large-scale-ep/ |
| backend | https://kvcache-ai.github.io/Mooncake/deployment/integrations/lmdeploy.html |
| a backend plugin | https://github.com/ai-dynamo/nixl/blob/main/src/plugins/mooncake/README.md |
| Mooncake x LMCache | https://kvcache-ai.github.io/Mooncake/deployment/integrations/lmcache/index.html |
| guidance | https://lmsys.org/blog/2025-05-05-large-scale-ep/ |
| remote connector | https://blog.lmcache.ai/2025-04-22-tencent/ |
| traces | https://github.com/neverCase/Mooncake/blob/main/FAST25-release/traces |
| JSONL file | https://github.com/kvcache-ai/Mooncake/blob/main/FAST25-release/arxiv-trace/mooncake_trace.jsonl |
| zhihu 1 | https://zhuanlan.zhihu.com/p/705754254 |
| 2 | https://zhuanlan.zhihu.com/p/705910725 |
| 3 | https://zhuanlan.zhihu.com/p/706204757 |
| 4 | https://zhuanlan.zhihu.com/p/707997501 |
| 5 | https://zhuanlan.zhihu.com/p/9461861451 |
| 6 | https://zhuanlan.zhihu.com/p/1939988652114580803 |
| 7 | https://zhuanlan.zhihu.com/p/1959366095443064318 |
| https://github.com/neverCase/Mooncake#-overview |
| https://github.com/neverCase/Mooncake/blob/main/image/components.png |
| https://github.com/neverCase/Mooncake#-show-cases |
| https://github.com/neverCase/Mooncake#transfer-engine-te |
| Transfer Engine guide | https://kvcache-ai.github.io/Mooncake/design/transfer-engine/index.html |
| https://github.com/neverCase/Mooncake/blob/main/image/transfer-engine-performance.png |
| Supported Protocols Documentation | https://kvcache-ai.github.io/Mooncake/getting_started/supported-protocols.html |
| SGLang | https://github.com/sgl-project/sglang |
| vLLM | https://github.com/vllm-project/vllm |
| TensorRT-LLM | https://github.com/NVIDIA/TensorRT-LLM |
| vLLM-Ascend | https://github.com/vllm-project/vllm-ascend |
| checkpoint-engine | https://github.com/MoonshotAI/checkpoint-engine |
| NIXL | https://github.com/ai-dynamo/nixl |
| https://github.com/neverCase/Mooncake#mooncake-store |
| Mooncake Store guide | https://kvcache-ai.github.io/Mooncake/design/mooncake-store.html |
| SGLang's Hierarchical KV Caching | https://lmsys.org/blog/2025-09-10-sglang-hicache/ |
| vLLM's prefill serving | https://docs.vllm.ai/en/latest/features/disagg_prefill.html |
| LMCache | https://kvcache-ai.github.io/Mooncake/deployment/integrations/lmcache/index.html |
| TorchSpec | https://pytorch.org/blog/torchspec-speculative-decoding-training-at-scale/ |
| TransferQueue | https://github.com/Ascend/TransferQueue |
| https://github.com/neverCase/Mooncake#mooncake-ep-and-process-group-pg |
| Mooncake EP & Backend guide | https://kvcache-ai.github.io/Mooncake/api-reference/python/ep-backend.html |
| https://github.com/neverCase/Mooncake#tensor-centric-ecosystem |
| Guide | https://kvcache-ai.github.io/Mooncake/deployment/integrations/sglang/index.html |
| https://github.com/neverCase/Mooncake#sglang-integration-guide |
| SGLang | https://github.com/sgl-project/sglang/ |
| Elastic EP | https://www.lmsys.org/blog/2026-03-25-eep-partial-failure-tolerance/ |
| RBG | https://github.com/sgl-project/rbg |
| SGLang-Omni | https://github.com/sgl-project/sglang-omni |
| Guide | https://kvcache-ai.github.io/Mooncake/deployment/integrations/vllm/index.html |
| https://github.com/neverCase/Mooncake#vllm-integration-guide |
| vLLM | https://github.com/vllm-project/vllm |
| Mooncake Store extends vLLM | https://vllm.ai/blog/2026-05-06-mooncake-store |
| vLLM-Omni | https://github.com/vllm-project/vllm-omni |
| https://github.com/neverCase/Mooncake#-ecosystem-integrations |
| Integration guide | https://kvcache-ai.github.io/Mooncake/deployment/integrations/sglang/index.html |
| Elastic EP | https://github.com/sgl-project/sglang/pull/10423 |
| PD connector | https://docs.vllm.ai/en/latest/features/mooncake_connector_usage/ |
| Store connector | https://docs.vllm.ai/en/latest/features/mooncake_store_connector_usage/ |
| encoder connector | https://docs.vllm.ai/en/latest/features/mooncake_ec_connector_usage/ |
| Server configuration | https://github.com/lightseekorg/tokenspeed/blob/main/docs/configuration/server.md |
| TE implementation | https://github.com/NVIDIA/TensorRT-LLM/tree/main/cpp/tensorrt_llm/executor/cache_transmission/mooncake_utils |
| Store connector | https://github.com/NVIDIA/TensorRT-LLM/pull/19171 |
| TE guide | https://kvcache-ai.github.io/Mooncake/deployment/integrations/lmdeploy.html |
| Store connector | https://github.com/InternLM/lmdeploy/pull/4903 |
| PD deployment | https://github.com/vllm-project/vllm-ascend/blob/main/docs/source/tutorials/features/pd_disaggregation_mooncake_multi_node.md |
| KV pool | https://github.com/vllm-project/vllm-ascend/blob/main/docs/source/user_guide/feature_guide/kv_cache_pool_ascend_store.md |
| Global cache pooling | https://github.com/PaddlePaddle/FastDeploy/blob/develop/docs/features/global_cache_pooling.md |
| KV transfer backends | https://github.com/jd-opensource/xllm/tree/main/xllm/core/kv_cache/transfer |
| PD disaggregation | https://github.com/thu-pacman/chitu/blob/public-main/chitu/distributed/pd_disaggregation/README.md |
| Store guide | https://docs.lmcache.ai/kv_cache/storage_backends/mooncake.html |
| MP adapter | https://docs.lmcache.ai/mp/l2_storage.html#mooncake-store-mooncake-store-native-connector |
| P2P backend | https://github.com/LMCache/LMCache/pull/4182 |
| Distributed reuse | https://github.com/taco-project/FlexKV/blob/main/docs/dist_reuse/README_en.md |
| Store backend | https://github.com/taco-project/FlexKV/pull/231 |
| Plugin guide | https://github.com/ai-dynamo/nixl/blob/main/src/plugins/mooncake/README.md |
| HiCache integration | https://github.com/ai-dynamo/dynamo/blob/main/docs/fern/pages/developer-guide/knowledge-base/modular-components/backends/sglang/hicache.md |
| PD integration | https://github.com/llm-d/llm-d/pull/1511 |
| Tiered prefix cache | https://github.com/llm-d/llm-d/tree/main/guides/tiered-prefix-cache |
| Deployment examples | https://github.com/sgl-project/rbg/tree/main/examples/inference/ecosystem/mooncake |
| Mooncake services | https://github.com/NVIDIA/srt-slurm/blob/main/docs/mooncake-kv-store.md |
| Data plane | https://github.com/NVIDIA-NeMo/RL/blob/main/nemo_rl/data_plane/README.md |
| GDR support | https://github.com/NVIDIA-NeMo/RL/pull/3501 |
| Store client | https://github.com/Ascend/TransferQueue/blob/main/transfer_queue/storage/clients/mooncake_client.py |
| GDR guide | https://github.com/Ascend/TransferQueue/blob/main/docs/storage_backends/mooncake_gdr.md |
| Mooncake backend | https://github.com/verl-project/verl/blob/main/verl/checkpoint_engine/mooncake_checkpoint_engine.py |
| P2P backend | https://github.com/MoonshotAI/checkpoint-engine |
| Rollout transfer guide | https://github.com/radixark/miles/blob/main/docs/advanced/mooncake-rollout-transfer.md |
| Training architecture | https://github.com/torchspec-project/TorchSpec |
| Hidden-state connectors | https://github.com/vllm-project/speculators/tree/main/hs_connectors |
| Omni connectors | https://github.com/vllm-project/vllm-omni/tree/main/vllm_omni/distributed/omni_connectors/connectors |
| Transfer backend | https://github.com/ModelTC/LightX2V/blob/main/lightx2v/disagg/mooncake.py |
| RL serving architecture | https://github.com/THUDM/slime/blob/main/docs/en/advanced/rl-systems.md |
| KVBM G4 Store adapter proposal | https://github.com/ai-dynamo/dynamo/pull/9786 |
| https://github.com/neverCase/Mooncake#️-supported-hardware |
| supported protocols | https://kvcache-ai.github.io/Mooncake/getting_started/supported-protocols.html |
| Transfer Engine design docs | https://kvcache-ai.github.io/Mooncake/design/transfer-engine/index.html |
| https://github.com/neverCase/Mooncake/blob/main/image/partners/nvidia_logo.png |
| https://github.com/neverCase/Mooncake/blob/main/image/partners/huawei_logo.png |
| https://github.com/neverCase/Mooncake/blob/main/image/partners/amd_logo.png |
| https://github.com/neverCase/Mooncake/blob/main/image/hardwares/cambricon_logo.png |
| https://github.com/neverCase/Mooncake/blob/main/image/partners/moore_thread_logo.jpg |
| https://github.com/neverCase/Mooncake/blob/main/image/partners/aws-logo.png |
| https://github.com/neverCase/Mooncake/blob/main/image/hardwares/MetaX_logo.png |
| https://github.com/neverCase/Mooncake/blob/main/image/hardwares/T-Head_logo.png |
| https://github.com/neverCase/Mooncake/blob/main/image/partners/aliyun_logo.png |
| https://github.com/neverCase/Mooncake/blob/main/image/partners/sunrise_logo.png |
| https://github.com/neverCase/Mooncake/blob/main/image/partners/hygon_logo.png |
| https://github.com/neverCase/Mooncake/blob/main/image/hardwares/biren_logo.png |
| https://github.com/neverCase/Mooncake/blob/main/image/hardwares/intel_logo.png |
| https://github.com/neverCase/Mooncake/blob/main/image/hardwares/google_logo.png |
| https://github.com/neverCase/Mooncake/blob/main/image/hardwares/hpe_logo.png |
| https://github.com/neverCase/Mooncake/blob/main/image/hardwares/iluvatar_corex_logo.png |
| https://github.com/neverCase/Mooncake/blob/main/image/hardwares/flagos_logo.png |
| https://github.com/neverCase/Mooncake#-getting-started |
| Quick Start | https://kvcache-ai.github.io/Mooncake/getting_started/quick-start.html |
| Build from Source | https://kvcache-ai.github.io/Mooncake/getting_started/build.html |
| Deployment Guide | https://kvcache-ai.github.io/Mooncake/deployment/mooncake-store-deployment-guide.html |
| https://github.com/neverCase/Mooncake#skills-for-ai-assistants |
| .claude/skills | https://github.com/neverCase/Mooncake/blob/main/.claude/skills |
| Claude Code plugin marketplace | https://code.claude.com/docs/en/plugin-marketplaces |
| https://github.com/neverCase/Mooncake#-open-source-traces-and-tools- |
| FAST25-release | https://github.com/neverCase/Mooncake/blob/main/FAST25-release |
| KV Cache Size Calculator | https://kvcache.ai/tools/kv-cache-size-calculator/ |
| KV Cache Hit Rate Simulator | https://kvcache.ai/tools/kv-cache-hit-rate-simulator/ |
| here | https://github.com/kvcache-ai/kvcache-blog |
| https://github.com/neverCase/Mooncake#-citation |
| kvcache-ai.github.io/Mooncake/ | https://kvcache-ai.github.io/Mooncake/ |
| Readme | https://github.com/neverCase/Mooncake#readme-ov-file |
| License | https://github.com/neverCase/Mooncake#License-1-ov-file |
| Code of conduct | https://github.com/neverCase/Mooncake#coc-ov-file |
| Contributing | https://github.com/neverCase/Mooncake#contributing-ov-file |
| Activity | https://github.com/neverCase/Mooncake/activity |
| 0 forks | https://github.com/neverCase/Mooncake/forks |
| Report repository | https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2FneverCase%2FMooncake&report=neverCase+%28user%29 |
|
| https://github.com |
| Terms | https://docs.github.com/site-policy/github-terms/github-terms-of-service |
| Privacy | https://docs.github.com/site-policy/privacy-policies/github-privacy-statement |
| Security | https://github.com/security |
| Status | https://www.githubstatus.com/ |
| Community | https://github.community/ |
| Docs | https://docs.github.com/ |
| Contact | https://support.github.com?tags=dotcom-footer |