Back to papers
July 24, 2026cs.ARcs.AIcs.LG

HiKV: Hierarchical Importance-Aware KV Cache with Hardware Acceleration for LLM Decoding

Chao Fang, Jun Yin, Man Shi, Marian Verhelst
Read on arXivDownload PDF
Categories

cs.AR, cs.AI, cs.LG