Fastest Inference Meta Muse Glimmer 30B on Apple

(basecompute.co)

2 points | by lukasonedge 10 hours ago ago

2 comments

  • 10 hours ago
    [deleted]
  • lukasonedge 9 hours ago

    hey guys, we've optimised our inference engine to run Meta Muse Glimmer 30B faster than any other engine (llama.cpp etc) on Mac. Best performance on M5 Pro.