GAAC: Lossless KV Cache Compression for Faster LLM Inference

2 comments

• Kevin_Flynn 5 hours ago

  I searched around, but couldn't find source code. :(

  [-]

  • wslh 5 hours ago

    I couldn't find it either but there is something related: https://github.com/lichangshiwhu/Adacode