We fine-tuned a 235B model on 4 GPUs. Then we didn't need it

(blog.vertexcover.io)

13 points | by kgritesh a day ago ago

2 comments

  • rurban a day ago

    We still fine-tune, because our problems aren't covered by existing models, proprietary tagged images. But not on mixture of experts models. This is only needed for text, not images

  • greazy a day ago

    I really enjoyed this blog, well written and takes the time to describe technical aspects of LLMs that I wasn't familiar with (noob here).