Pool spare GPU capacity to run LLMs at larger scale

2 comments

• iwinux 4 hours ago

  You lost me on "spare GPU". I don't have any capable GPUs, let alone spare ones :)

• vagrantJin an hour ago

  This is very promising, definitely looks more user friendly than exo. Can't wait to try it out.