The architecture of open-weight LLMs: MoE, hybrid layers, ternary weights

(silasdata.com)

16 points | by silasyl 3 days ago ago

1 comments