73 points | by mfiguiere 3 hours ago ago
6 comments
I am very impressed with the KV Cache Compression work as well as the prefix cacheing making queries converge on practically free.
404 on the blog page? https://zartbot.github.io/blog/
Removed
The website design definitely is, but I don’t know if the content is? This reads pretty human to me and is quite interesting to boot!
you don't know him?
The writing feels human to me… and I call out AI slop as much as possible.
I am very impressed with the KV Cache Compression work as well as the prefix cacheing making queries converge on practically free.
404 on the blog page? https://zartbot.github.io/blog/
Removed
The website design definitely is, but I don’t know if the content is? This reads pretty human to me and is quite interesting to boot!
you don't know him?
The writing feels human to me… and I call out AI slop as much as possible.