Back to papers
November 10, 2026cs.LG

SinkState: On-the-Fly SVD of Recurrent States for Efficient Hybrid LLM Serving

Haolin Jiang, Weihang Li, Zhongzhu Zhou, Jinwen Pan, Santosh Pandey, Hang Liu
Read on arXivDownload PDF
Categories

cs.LG

SinkState: On-the-Fly SVD of Recurrent States for Efficient Hybrid LLM Serving - AI Research | One9Founders