Lost in Backpropagation: The LM Head Is a Gradient Bottleneck

(arxiv.org)

3 points | by famouswaffles 4 hours ago ago

No comments yet.