13 points | by liventruth a day ago ago
1 comments
This should be trivially demonstrable if it actually works. Cosine similarity is not a good metric, however, for attention compression.
This should be trivially demonstrable if it actually works. Cosine similarity is not a good metric, however, for attention compression.