Attention Is All You Need

(arxiv.org)

6 points | by Bluestein 20 hours ago ago

2 comments

  • jruohonen 19 hours ago

    But it was not only attention. And if you now look at the paper viz "standards", well. Maybe it tells something.

    • Bluestein 19 hours ago

      Good point. Hindsight is warranted. Heavens knows about what (what approach, what tech, what algo) we might be saying the same, a year from now: MoEs, agents, persistent memory ... quantum computing, embodied AI, robotics ...