René's URL Explorer Experiment


Title: GitHub - neverCase/Mooncake: Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI. · GitHub

Open Graph Title: GitHub - neverCase/Mooncake: Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

X Title: GitHub - neverCase/Mooncake: Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

Description: Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI. - neverCase/Mooncake

Open Graph Description: Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI. - neverCase/Mooncake

X Description: Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI. - neverCase/Mooncake

Opengraph URL: https://github.com/neverCase/Mooncake

X: @github

direct link

Domain: github.com

IPv4 address: 140.82.114.4

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322
route-pattern/:user_id/:repository
route-controllerfiles
route-actiondisambiguate
fetch-noncev2:a30e6a52-8d08-4417-4b64-410db58be697
current-catalog-service-hashf3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-idB7BC:302CFA:2232E44:2D783BF:6B03691F
html-safe-nonce839c3fb8c0c8ecbc8b6f0fc7e3d1d0a25415f5f701b2b3466f326fcdaca41235
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJCN0JDOjMwMkNGQToyMjMyRTQ0OjJENzgzQkY6NkIwMzY5MUYiLCJ2aXNpdG9yX2lkIjoiMjk1Njc3NDYxNzg2OTY3NDc4MyIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmac091c39aa40bf84bbd2be7d84530e98818aebf3fe91ecf347e0c32c39a1fc213a
hovercard-subject-tagrepository:1263554756
github-keyboard-shortcutsrepository,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location//
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/neverCase/Mooncake
twitter:imagehttps://opengraph.githubassets.com/83d41531839978f45a6cf9bd9a575c9cc7c880be08abb25af8179cea62d56e1c/neverCase/Mooncake
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/83d41531839978f45a6cf9bd9a575c9cc7c880be08abb25af8179cea62d56e1c/neverCase/Mooncake
og:image:altMooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI. - neverCase/Mooncake
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None87e774ee7c6b3bee0490394e4d3e57ec9dbc956f74b87ea685dc8996c1676456
turbo-cache-controlno-cache
go-importgithub.com/neverCase/Mooncake git https://github.com/neverCase/Mooncake.git
octolytics-dimension-user_id21275863
octolytics-dimension-user_loginneverCase
octolytics-dimension-repository_id1263554756
octolytics-dimension-repository_nwoneverCase/Mooncake
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forktrue
octolytics-dimension-repository_parent_id819733173
octolytics-dimension-repository_parent_nwokvcache-ai/Mooncake
octolytics-dimension-repository_network_root_id819733173
octolytics-dimension-repository_network_root_nwokvcache-ai/Mooncake
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release423dbb54c5e7bfecc838eb387c1435eb3d0e760d
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/neverCase/Mooncake#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FneverCase%2FMooncake
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FneverCase%2FMooncake
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=neverCase%2FMooncake
Reloadhttps://github.com/neverCase/Mooncake
Reloadhttps://github.com/neverCase/Mooncake
Reloadhttps://github.com/neverCase/Mooncake
neverCasehttps://github.com/neverCase
Mooncakehttps://github.com/neverCase/Mooncake
Codehttps://github.com/neverCase/Mooncake
Pull requestshttps://github.com/neverCase/Mooncake/pulls
Actionshttps://github.com/neverCase/Mooncake/actions
Projectshttps://github.com/neverCase/Mooncake/projects
Security and qualityhttps://github.com/neverCase/Mooncake/security
Insightshttps://github.com/neverCase/Mooncake/pulse
https://github.com/neverCase/Mooncake
Mooncakehttps://github.com/neverCase/Mooncake
kvcache-ai/Mooncakehttps://github.com/kvcache-ai/Mooncake
Notificationshttps://github.com/login?return_to=%2FneverCase%2FMooncake
Fork0 (0)https://github.com/login?return_to=%2FneverCase%2FMooncake
Star0 (0)https://github.com/login?return_to=%2FneverCase%2FMooncake
kvcache-ai.github.io/Mooncake/https://kvcache-ai.github.io/Mooncake/
Readmehttps://github.com/neverCase/Mooncake#readme-ov-file
Licensehttps://github.com/neverCase/Mooncake#License-1-ov-file
Code of conducthttps://github.com/neverCase/Mooncake#coc-ov-file
Contributinghttps://github.com/neverCase/Mooncake#contributing-ov-file
Activityhttps://github.com/neverCase/Mooncake/activity
0 forkshttps://github.com/neverCase/Mooncake/forks
Report repositoryhttps://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2FneverCase%2FMooncake&report=neverCase+%28user%29
Brancheshttps://github.com/neverCase/Mooncake/branches
Tagshttps://github.com/neverCase/Mooncake/tags
https://github.com/neverCase/Mooncake/branches
https://github.com/neverCase/Mooncake/tags
2,755 Commitshttps://github.com/neverCase/Mooncake/commits/main/
https://github.com/neverCase/Mooncake/commits/main/
.claude-pluginhttps://github.com/neverCase/Mooncake/tree/main/.claude-plugin
.claude-pluginhttps://github.com/neverCase/Mooncake/tree/main/.claude-plugin
.claude/skillshttps://github.com/neverCase/Mooncake/tree/main/.claude/skills
.claude/skillshttps://github.com/neverCase/Mooncake/tree/main/.claude/skills
.devcontainerhttps://github.com/neverCase/Mooncake/tree/main/.devcontainer
.devcontainerhttps://github.com/neverCase/Mooncake/tree/main/.devcontainer
.githubhttps://github.com/neverCase/Mooncake/tree/main/.github
.githubhttps://github.com/neverCase/Mooncake/tree/main/.github
FAST25-releasehttps://github.com/neverCase/Mooncake/tree/main/FAST25-release
FAST25-releasehttps://github.com/neverCase/Mooncake/tree/main/FAST25-release
benchmarkshttps://github.com/neverCase/Mooncake/tree/main/benchmarks
benchmarkshttps://github.com/neverCase/Mooncake/tree/main/benchmarks
cmakehttps://github.com/neverCase/Mooncake/tree/main/cmake
cmakehttps://github.com/neverCase/Mooncake/tree/main/cmake
dockerhttps://github.com/neverCase/Mooncake/tree/main/docker
dockerhttps://github.com/neverCase/Mooncake/tree/main/docker
docshttps://github.com/neverCase/Mooncake/tree/main/docs
docshttps://github.com/neverCase/Mooncake/tree/main/docs
externhttps://github.com/neverCase/Mooncake/tree/main/extern
externhttps://github.com/neverCase/Mooncake/tree/main/extern
imagehttps://github.com/neverCase/Mooncake/tree/main/image
imagehttps://github.com/neverCase/Mooncake/tree/main/image
monitoringhttps://github.com/neverCase/Mooncake/tree/main/monitoring
monitoringhttps://github.com/neverCase/Mooncake/tree/main/monitoring
mooncake-commonhttps://github.com/neverCase/Mooncake/tree/main/mooncake-common
mooncake-commonhttps://github.com/neverCase/Mooncake/tree/main/mooncake-common
mooncake-conductorhttps://github.com/neverCase/Mooncake/tree/main/mooncake-conductor
mooncake-conductorhttps://github.com/neverCase/Mooncake/tree/main/mooncake-conductor
mooncake-ephttps://github.com/neverCase/Mooncake/tree/main/mooncake-ep
mooncake-ephttps://github.com/neverCase/Mooncake/tree/main/mooncake-ep
mooncake-integrationhttps://github.com/neverCase/Mooncake/tree/main/mooncake-integration
mooncake-integrationhttps://github.com/neverCase/Mooncake/tree/main/mooncake-integration
mooncake-p2p-storehttps://github.com/neverCase/Mooncake/tree/main/mooncake-p2p-store
mooncake-p2p-storehttps://github.com/neverCase/Mooncake/tree/main/mooncake-p2p-store
mooncake-pghttps://github.com/neverCase/Mooncake/tree/main/mooncake-pg
mooncake-pghttps://github.com/neverCase/Mooncake/tree/main/mooncake-pg
mooncake-reshardhttps://github.com/neverCase/Mooncake/tree/main/mooncake-reshard
mooncake-reshardhttps://github.com/neverCase/Mooncake/tree/main/mooncake-reshard
mooncake-rl/exampleshttps://github.com/neverCase/Mooncake/tree/main/mooncake-rl/examples
mooncake-rl/exampleshttps://github.com/neverCase/Mooncake/tree/main/mooncake-rl/examples
mooncake-store-rshttps://github.com/neverCase/Mooncake/tree/main/mooncake-store-rs
mooncake-store-rshttps://github.com/neverCase/Mooncake/tree/main/mooncake-store-rs
mooncake-storehttps://github.com/neverCase/Mooncake/tree/main/mooncake-store
mooncake-storehttps://github.com/neverCase/Mooncake/tree/main/mooncake-store
mooncake-transfer-enginehttps://github.com/neverCase/Mooncake/tree/main/mooncake-transfer-engine
mooncake-transfer-enginehttps://github.com/neverCase/Mooncake/tree/main/mooncake-transfer-engine
mooncake-wheelhttps://github.com/neverCase/Mooncake/tree/main/mooncake-wheel
mooncake-wheelhttps://github.com/neverCase/Mooncake/tree/main/mooncake-wheel
pythonhttps://github.com/neverCase/Mooncake/tree/main/python
pythonhttps://github.com/neverCase/Mooncake/tree/main/python
scriptshttps://github.com/neverCase/Mooncake/tree/main/scripts
scriptshttps://github.com/neverCase/Mooncake/tree/main/scripts
.clang-formathttps://github.com/neverCase/Mooncake/blob/main/.clang-format
.clang-formathttps://github.com/neverCase/Mooncake/blob/main/.clang-format
.cmake-format.jsonhttps://github.com/neverCase/Mooncake/blob/main/.cmake-format.json
.cmake-format.jsonhttps://github.com/neverCase/Mooncake/blob/main/.cmake-format.json
.dockerignorehttps://github.com/neverCase/Mooncake/blob/main/.dockerignore
.dockerignorehttps://github.com/neverCase/Mooncake/blob/main/.dockerignore
.gitignorehttps://github.com/neverCase/Mooncake/blob/main/.gitignore
.gitignorehttps://github.com/neverCase/Mooncake/blob/main/.gitignore
.gitmoduleshttps://github.com/neverCase/Mooncake/blob/main/.gitmodules
.gitmoduleshttps://github.com/neverCase/Mooncake/blob/main/.gitmodules
.pre-commit-config.yamlhttps://github.com/neverCase/Mooncake/blob/main/.pre-commit-config.yaml
.pre-commit-config.yamlhttps://github.com/neverCase/Mooncake/blob/main/.pre-commit-config.yaml
.typos.tomlhttps://github.com/neverCase/Mooncake/blob/main/.typos.toml
.typos.tomlhttps://github.com/neverCase/Mooncake/blob/main/.typos.toml
AGENTS.mdhttps://github.com/neverCase/Mooncake/blob/main/AGENTS.md
AGENTS.mdhttps://github.com/neverCase/Mooncake/blob/main/AGENTS.md
CLAUDE.mdhttps://github.com/neverCase/Mooncake/blob/main/CLAUDE.md
CLAUDE.mdhttps://github.com/neverCase/Mooncake/blob/main/CLAUDE.md
CMakeLists.txthttps://github.com/neverCase/Mooncake/blob/main/CMakeLists.txt
CMakeLists.txthttps://github.com/neverCase/Mooncake/blob/main/CMakeLists.txt
CODE_OF_CONDUCT.mdhttps://github.com/neverCase/Mooncake/blob/main/CODE_OF_CONDUCT.md
CODE_OF_CONDUCT.mdhttps://github.com/neverCase/Mooncake/blob/main/CODE_OF_CONDUCT.md
CONTRIBUTING.mdhttps://github.com/neverCase/Mooncake/blob/main/CONTRIBUTING.md
CONTRIBUTING.mdhttps://github.com/neverCase/Mooncake/blob/main/CONTRIBUTING.md
DCOhttps://github.com/neverCase/Mooncake/blob/main/DCO
DCOhttps://github.com/neverCase/Mooncake/blob/main/DCO
LICENSE-APACHEhttps://github.com/neverCase/Mooncake/blob/main/LICENSE-APACHE
LICENSE-APACHEhttps://github.com/neverCase/Mooncake/blob/main/LICENSE-APACHE
MAINTAINERS.mdhttps://github.com/neverCase/Mooncake/blob/main/MAINTAINERS.md
MAINTAINERS.mdhttps://github.com/neverCase/Mooncake/blob/main/MAINTAINERS.md
README.mdhttps://github.com/neverCase/Mooncake/blob/main/README.md
README.mdhttps://github.com/neverCase/Mooncake/blob/main/README.md
dependencies.shhttps://github.com/neverCase/Mooncake/blob/main/dependencies.sh
dependencies.shhttps://github.com/neverCase/Mooncake/blob/main/dependencies.sh
pyproject.tomlhttps://github.com/neverCase/Mooncake/blob/main/pyproject.toml
pyproject.tomlhttps://github.com/neverCase/Mooncake/blob/main/pyproject.toml
requirements.txthttps://github.com/neverCase/Mooncake/blob/main/requirements.txt
requirements.txthttps://github.com/neverCase/Mooncake/blob/main/requirements.txt
READMEhttps://github.com/neverCase/Mooncake
Code of conducthttps://github.com/neverCase/Mooncake
Contributinghttps://github.com/neverCase/Mooncake
Licensehttps://github.com/neverCase/Mooncake
https://github.com/neverCase/Mooncake/blob/main/image/mooncake-icon.png
https://github.com/neverCase/Mooncake#------a-kvcache-centric-disaggregated-architecture-for-llm-serving--
Paperhttps://www.usenix.org/system/files/fast25-qin.pdf
Slideshttps://www.usenix.org/system/files/fast25_slides-qin.pdf
Traceshttps://github.com/neverCase/Mooncake/blob/main/FAST25-release/traces
Documentationhttps://kvcache-ai.github.io/Mooncake/
Bloghttps://kvcache.ai/
Slackhttps://join.slack.com/t/mooncake-project/shared_invite/zt-3qx4x35ea-zSSTqTHItHJs9SCoXLOSPA
https://pypi.org/project/mooncake-transfer-engine
https://github.com/kvcache-ai/Mooncake/graphs/commit-activity
https://github.com/kvcache-ai/Mooncake/blob/main/LICENSE-APACHE
https://hub.docker.com/r/kvcacheai/mooncake
https://pypi.org/project/mooncake-transfer-engine
https://pypi.org/project/mooncake-transfer-engine-cuda13
https://pypi.org/project/mooncake-transfer-engine-non-cuda/
https://pypi.org/project/mooncake-transfer-engine-npu/
https://pypi.org/project/mooncake-transfer-engine-musa/
https://pypi.org/project/mooncake-transfer-engine-rocm/
Kimihttps://kimi.ai/
Moonshot AIhttps://www.moonshot.cn/
https://github.com/neverCase/Mooncake#-updates
AMD ATOM integrated Mooncakehttps://kvcache.ai/blog/atom-meets-mooncake/
Mooncake Store connectorhttps://github.com/NVIDIA/TensorRT-LLM/pull/19171
TokenSpeed v0.1.1https://github.com/lightseekorg/tokenspeed/releases/tag/v0.1.1
cross-encoder embedding reusehttps://github.com/vllm-project/vllm/pull/56242
encoder-cache transfer connectorhttps://github.com/vllm-project/vllm/pull/41567
vLLM v0.31.0https://github.com/vllm-project/vllm/releases/tag/v0.31.0
Mooncake Store supporthttps://github.com/InternLM/lmdeploy/pull/4903
LMDeploy v0.18.0https://github.com/InternLM/lmdeploy/releases/tag/v0.18.0
AgentX / InferenceX v3https://newsletter.semianalysis.com/p/agentx-inferencexv3-does-cuda-moat
Mooncake optimization detailshttps://inferencex.semianalysis.com/agentx/optimizations/mooncake
Mileshttps://github.com/radixark/miles
KVCache.AIhttps://kvcache.ai/blog/mooncake-rl-rollout-data-transfer/
lmsyshttps://www.lmsys.org/blog/2026-08-20-miles-mooncake-rollout-data-transfer
Speculatorshttps://github.com/vllm-project/speculators
Benchmark on GB300 NVL72https://x.com/mgoin_/status/2072785822231728363
Mooncake PD deployment guidehttps://github.com/llm-d/llm-d/pull/1511
Mooncake Store tiered offloading integrationhttps://github.com/llm-d/llm-d/pull/1826
event-driven Mooncake shared-cache indexhttps://github.com/ai-dynamo/dynamo/pull/11239
Mooncake Store as a distributed REMOTE-tier backendhttps://github.com/taco-project/FlexKV/pull/231
GPUDirect RDMA support for its Mooncake Store backendhttps://github.com/Ascend/TransferQueue/pull/131
vLLM officially features Mooncake Storehttps://vllm.ai/blog/mooncake-store
RDMA-based P2P weight transfer for large-scale distributed RLhttps://lmsys.org/blog/2026-04-29-p2p-update/
Mooncake Store L2 adapter for multiprocess modehttps://github.com/LMCache/LMCache/pull/2911
TENT technical reporthttps://arxiv.org/abs/2604.00368
TorchSpec: Speculative Decoding Training at Scalehttps://pytorch.org/blog/torchspec-speculative-decoding-training-at-scale
open sourcedhttps://github.com/torchspec-project/TorchSpec
Mooncake Store cache read/write support to its PD pipelinehttps://github.com/PaddlePaddle/FastDeploy/pull/6768
global KV cache poolinghttps://github.com/PaddlePaddle/FastDeploy/blob/develop/docs/features/global_cache_pooling.md
LightX2Vhttps://github.com/ModelTC/LightX2V/pull/893
bloghttps://light-ai.top/LightX2V-BLOG/posts/Disaggregation/
Mooncake checkpoint-engine backendhttps://github.com/verl-project/verl/pull/5176
SGLanghttps://github.com/sgl-project/sglang
Encoder Global Cache Managerhttps://github.com/sgl-project/sglang/pull/16137
vLLM-Omnihttps://docs.vllm.ai/projects/vllm-omni/en/latest/design/feature/disaggregated_inference/
Mooncake Joins PyTorch Ecosystemhttps://pytorch.org/blog/mooncake-joins-pytorch-ecosystem/
FlexKVhttps://github.com/taco-project/FlexKV
distributed KVCache reusehttps://github.com/taco-project/FlexKV/blob/main/docs/dist_reuse/README_en.md
ROLLhttps://github.com/alibaba/ROLL
herehttps://arxiv.org/abs/2512.22560
Encode-Prefill-Decode (EPD) Disaggregationhttps://lmsys.org/blog/2026-01-12-epd/
integrated into TensorRT LLMhttps://github.com/NVIDIA/TensorRT-LLM/tree/main/cpp/tensorrt_llm/executor/cache_transmission/mooncake_utils
KV Connectorhttps://docs.vllm.ai/en/latest/features/mooncake_connector_usage/
RBG + SGLang HiCache + Mooncakehttps://github.com/sgl-project/rbg/blob/main/keps/74-mooncake-integration/README.md
Mooncake EP and a collective communication backendhttps://github.com/sgl-project/sglang/pull/10423
the distributed KV cache pool backendhttps://github.com/vllm-project/vllm-ascend/blob/main/docs/source/user_guide/feature_guide/kv_cache_pool_ascend_store.md
hierarchical KV caching storage backendhttps://lmsys.org/blog/2025-09-10-sglang-hicache/
checkpoint-enginehttps://github.com/MoonshotAI/checkpoint-engine/
xLLMhttps://github.com/jd-opensource/xllm
integrates Mooncake Transfer Enginehttps://github.com/vllm-project/vllm-ascend/blob/main/docs/source/tutorials/features/pd_disaggregation_mooncake_multi_node.md
the deployment of Kimi K2https://lmsys.org/blog/2025-07-20-k2-large-scale-ep/
backendhttps://kvcache-ai.github.io/Mooncake/deployment/integrations/lmdeploy.html
a backend pluginhttps://github.com/ai-dynamo/nixl/blob/main/src/plugins/mooncake/README.md
Mooncake x LMCachehttps://kvcache-ai.github.io/Mooncake/deployment/integrations/lmcache/index.html
guidancehttps://lmsys.org/blog/2025-05-05-large-scale-ep/
remote connectorhttps://blog.lmcache.ai/2025-04-22-tencent/
traceshttps://github.com/neverCase/Mooncake/blob/main/FAST25-release/traces
JSONL filehttps://github.com/kvcache-ai/Mooncake/blob/main/FAST25-release/arxiv-trace/mooncake_trace.jsonl
zhihu 1https://zhuanlan.zhihu.com/p/705754254
2https://zhuanlan.zhihu.com/p/705910725
3https://zhuanlan.zhihu.com/p/706204757
4https://zhuanlan.zhihu.com/p/707997501
5https://zhuanlan.zhihu.com/p/9461861451
6https://zhuanlan.zhihu.com/p/1939988652114580803
7https://zhuanlan.zhihu.com/p/1959366095443064318
https://github.com/neverCase/Mooncake#-overview
https://github.com/neverCase/Mooncake/blob/main/image/components.png
https://github.com/neverCase/Mooncake#-show-cases
https://github.com/neverCase/Mooncake#transfer-engine-te
Transfer Engine guidehttps://kvcache-ai.github.io/Mooncake/design/transfer-engine/index.html
https://github.com/neverCase/Mooncake/blob/main/image/transfer-engine-performance.png
Supported Protocols Documentationhttps://kvcache-ai.github.io/Mooncake/getting_started/supported-protocols.html
SGLanghttps://github.com/sgl-project/sglang
vLLMhttps://github.com/vllm-project/vllm
TensorRT-LLMhttps://github.com/NVIDIA/TensorRT-LLM
vLLM-Ascendhttps://github.com/vllm-project/vllm-ascend
checkpoint-enginehttps://github.com/MoonshotAI/checkpoint-engine
NIXLhttps://github.com/ai-dynamo/nixl
https://github.com/neverCase/Mooncake#mooncake-store
Mooncake Store guidehttps://kvcache-ai.github.io/Mooncake/design/mooncake-store.html
SGLang's Hierarchical KV Cachinghttps://lmsys.org/blog/2025-09-10-sglang-hicache/
vLLM's prefill servinghttps://docs.vllm.ai/en/latest/features/disagg_prefill.html
LMCachehttps://kvcache-ai.github.io/Mooncake/deployment/integrations/lmcache/index.html
TorchSpechttps://pytorch.org/blog/torchspec-speculative-decoding-training-at-scale/
TransferQueuehttps://github.com/Ascend/TransferQueue
https://github.com/neverCase/Mooncake#mooncake-ep-and-process-group-pg
Mooncake EP & Backend guidehttps://kvcache-ai.github.io/Mooncake/api-reference/python/ep-backend.html
https://github.com/neverCase/Mooncake#tensor-centric-ecosystem
Guidehttps://kvcache-ai.github.io/Mooncake/deployment/integrations/sglang/index.html
https://github.com/neverCase/Mooncake#sglang-integration-guide
SGLanghttps://github.com/sgl-project/sglang/
Elastic EPhttps://www.lmsys.org/blog/2026-03-25-eep-partial-failure-tolerance/
RBGhttps://github.com/sgl-project/rbg
SGLang-Omnihttps://github.com/sgl-project/sglang-omni
Guidehttps://kvcache-ai.github.io/Mooncake/deployment/integrations/vllm/index.html
https://github.com/neverCase/Mooncake#vllm-integration-guide
vLLMhttps://github.com/vllm-project/vllm
Mooncake Store extends vLLMhttps://vllm.ai/blog/2026-05-06-mooncake-store
vLLM-Omnihttps://github.com/vllm-project/vllm-omni
https://github.com/neverCase/Mooncake#-ecosystem-integrations
Integration guidehttps://kvcache-ai.github.io/Mooncake/deployment/integrations/sglang/index.html
Elastic EPhttps://github.com/sgl-project/sglang/pull/10423
PD connectorhttps://docs.vllm.ai/en/latest/features/mooncake_connector_usage/
Store connectorhttps://docs.vllm.ai/en/latest/features/mooncake_store_connector_usage/
encoder connectorhttps://docs.vllm.ai/en/latest/features/mooncake_ec_connector_usage/
Server configurationhttps://github.com/lightseekorg/tokenspeed/blob/main/docs/configuration/server.md
TE implementationhttps://github.com/NVIDIA/TensorRT-LLM/tree/main/cpp/tensorrt_llm/executor/cache_transmission/mooncake_utils
Store connectorhttps://github.com/NVIDIA/TensorRT-LLM/pull/19171
TE guidehttps://kvcache-ai.github.io/Mooncake/deployment/integrations/lmdeploy.html
Store connectorhttps://github.com/InternLM/lmdeploy/pull/4903
PD deploymenthttps://github.com/vllm-project/vllm-ascend/blob/main/docs/source/tutorials/features/pd_disaggregation_mooncake_multi_node.md
KV poolhttps://github.com/vllm-project/vllm-ascend/blob/main/docs/source/user_guide/feature_guide/kv_cache_pool_ascend_store.md
Global cache poolinghttps://github.com/PaddlePaddle/FastDeploy/blob/develop/docs/features/global_cache_pooling.md
KV transfer backendshttps://github.com/jd-opensource/xllm/tree/main/xllm/core/kv_cache/transfer
PD disaggregationhttps://github.com/thu-pacman/chitu/blob/public-main/chitu/distributed/pd_disaggregation/README.md
Store guidehttps://docs.lmcache.ai/kv_cache/storage_backends/mooncake.html
MP adapterhttps://docs.lmcache.ai/mp/l2_storage.html#mooncake-store-mooncake-store-native-connector
P2P backendhttps://github.com/LMCache/LMCache/pull/4182
Distributed reusehttps://github.com/taco-project/FlexKV/blob/main/docs/dist_reuse/README_en.md
Store backendhttps://github.com/taco-project/FlexKV/pull/231
Plugin guidehttps://github.com/ai-dynamo/nixl/blob/main/src/plugins/mooncake/README.md
HiCache integrationhttps://github.com/ai-dynamo/dynamo/blob/main/docs/fern/pages/developer-guide/knowledge-base/modular-components/backends/sglang/hicache.md
PD integrationhttps://github.com/llm-d/llm-d/pull/1511
Tiered prefix cachehttps://github.com/llm-d/llm-d/tree/main/guides/tiered-prefix-cache
Deployment exampleshttps://github.com/sgl-project/rbg/tree/main/examples/inference/ecosystem/mooncake
Mooncake serviceshttps://github.com/NVIDIA/srt-slurm/blob/main/docs/mooncake-kv-store.md
Data planehttps://github.com/NVIDIA-NeMo/RL/blob/main/nemo_rl/data_plane/README.md
GDR supporthttps://github.com/NVIDIA-NeMo/RL/pull/3501
Store clienthttps://github.com/Ascend/TransferQueue/blob/main/transfer_queue/storage/clients/mooncake_client.py
GDR guidehttps://github.com/Ascend/TransferQueue/blob/main/docs/storage_backends/mooncake_gdr.md
Mooncake backendhttps://github.com/verl-project/verl/blob/main/verl/checkpoint_engine/mooncake_checkpoint_engine.py
P2P backendhttps://github.com/MoonshotAI/checkpoint-engine
Rollout transfer guidehttps://github.com/radixark/miles/blob/main/docs/advanced/mooncake-rollout-transfer.md
Training architecturehttps://github.com/torchspec-project/TorchSpec
Hidden-state connectorshttps://github.com/vllm-project/speculators/tree/main/hs_connectors
Omni connectorshttps://github.com/vllm-project/vllm-omni/tree/main/vllm_omni/distributed/omni_connectors/connectors
Transfer backendhttps://github.com/ModelTC/LightX2V/blob/main/lightx2v/disagg/mooncake.py
RL serving architecturehttps://github.com/THUDM/slime/blob/main/docs/en/advanced/rl-systems.md
KVBM G4 Store adapter proposalhttps://github.com/ai-dynamo/dynamo/pull/9786
https://github.com/neverCase/Mooncake#️-supported-hardware
supported protocolshttps://kvcache-ai.github.io/Mooncake/getting_started/supported-protocols.html
Transfer Engine design docshttps://kvcache-ai.github.io/Mooncake/design/transfer-engine/index.html
https://github.com/neverCase/Mooncake/blob/main/image/partners/nvidia_logo.png
https://github.com/neverCase/Mooncake/blob/main/image/partners/huawei_logo.png
https://github.com/neverCase/Mooncake/blob/main/image/partners/amd_logo.png
https://github.com/neverCase/Mooncake/blob/main/image/hardwares/cambricon_logo.png
https://github.com/neverCase/Mooncake/blob/main/image/partners/moore_thread_logo.jpg
https://github.com/neverCase/Mooncake/blob/main/image/partners/aws-logo.png
https://github.com/neverCase/Mooncake/blob/main/image/hardwares/MetaX_logo.png
https://github.com/neverCase/Mooncake/blob/main/image/hardwares/T-Head_logo.png
https://github.com/neverCase/Mooncake/blob/main/image/partners/aliyun_logo.png
https://github.com/neverCase/Mooncake/blob/main/image/partners/sunrise_logo.png
https://github.com/neverCase/Mooncake/blob/main/image/partners/hygon_logo.png
https://github.com/neverCase/Mooncake/blob/main/image/hardwares/biren_logo.png
https://github.com/neverCase/Mooncake/blob/main/image/hardwares/intel_logo.png
https://github.com/neverCase/Mooncake/blob/main/image/hardwares/google_logo.png
https://github.com/neverCase/Mooncake/blob/main/image/hardwares/hpe_logo.png
https://github.com/neverCase/Mooncake/blob/main/image/hardwares/iluvatar_corex_logo.png
https://github.com/neverCase/Mooncake/blob/main/image/hardwares/flagos_logo.png
https://github.com/neverCase/Mooncake#-getting-started
Quick Starthttps://kvcache-ai.github.io/Mooncake/getting_started/quick-start.html
Build from Sourcehttps://kvcache-ai.github.io/Mooncake/getting_started/build.html
Deployment Guidehttps://kvcache-ai.github.io/Mooncake/deployment/mooncake-store-deployment-guide.html
https://github.com/neverCase/Mooncake#skills-for-ai-assistants
.claude/skillshttps://github.com/neverCase/Mooncake/blob/main/.claude/skills
Claude Code plugin marketplacehttps://code.claude.com/docs/en/plugin-marketplaces
https://github.com/neverCase/Mooncake#-open-source-traces-and-tools-
FAST25-releasehttps://github.com/neverCase/Mooncake/blob/main/FAST25-release
KV Cache Size Calculatorhttps://kvcache.ai/tools/kv-cache-size-calculator/
KV Cache Hit Rate Simulatorhttps://kvcache.ai/tools/kv-cache-hit-rate-simulator/
herehttps://github.com/kvcache-ai/kvcache-blog
https://github.com/neverCase/Mooncake#-citation
kvcache-ai.github.io/Mooncake/https://kvcache-ai.github.io/Mooncake/
Readmehttps://github.com/neverCase/Mooncake#readme-ov-file
Licensehttps://github.com/neverCase/Mooncake#License-1-ov-file
Code of conducthttps://github.com/neverCase/Mooncake#coc-ov-file
Contributinghttps://github.com/neverCase/Mooncake#contributing-ov-file
Activityhttps://github.com/neverCase/Mooncake/activity
0 forkshttps://github.com/neverCase/Mooncake/forks
Report repositoryhttps://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2FneverCase%2FMooncake&report=neverCase+%28user%29
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Response headers:
Servergithub.com
Content-Typetext/html; charset=utf-8
Cache-Controlmax-age=0, private, must-revalidate

Viewport: width=device-width


URLs of crawlers that visited me.