Run LLM Locally – which open model fits your GPU or Mac, and how fast

3 comments

• micahdeath 3 hours ago

  Doesn't support my AMD Athlon 3000G w/ 64GB RAM =P -- nor my real consumer GPUs (older than 4 years)

  (And yes, I do run AI on my athlon... it is slow but works.)

• cmdrmac 3 hours ago

  Another tool that isn't up to date on Apple processors...

• schamy 4 hours ago

  [flagged]