New KV cache compaction technique cuts LLM memory 50x without accuracy loss

2 comments

• westurner 2 hours ago

  ScholarlyArticle: "Fast KV Compaction via Attention Matching" (2025) https://arxiv.org/abs/2602.16284

• androiddrew 8 hours ago

  I hope this is real.