Pipeline Parallelism in SGLang: Scaling to Million-Token Contexts

(lmsys.org)

3 points | by roody_wurlitzer 6 hours ago ago

No comments yet.