Back to papers
June 23, 2026cs.DCcs.AIcs.LGcs.PF

CrossPool: Efficient Multi-LLM Serving for Cold MoE Models through KV-Cache and Weight Disaggregation

Zhuoren Ye, Tianyu Wo, Dinghao Xue, Mingming Zhang, Yuchen Teng, Chunming Hu, Renyu Yang
Read on arXivDownload PDF
Categories

cs.DC, cs.AI, cs.LG, cs.PF