Mooncake

paper dataset
Moonshot AI
A KVCache-centric disaggregated architecture for LLM serving. Won Best Paper at FAST 2025.
Paper (arXiv)GitHub

Outputs 2

Mooncake: KVCache-centric Disaggregated Architecture

paper

arXiv: 2407.00079

Venue: FAST 2025

Mooncake Dataset & Code

dataset

GitHub Repository

infrastructureefficiency