HyperCache – Distributed KV-cache quantization and relative RoPE reuse

(github.com)

2 points | by samganyx 7 hours ago ago

1 comments