Making a Vintage LLM from Scratch

(crlf.link)

2 points | by croqaz 7 hours ago ago

1 comments

  • croqaz 7 hours ago

    I am creating my tiny Llama 340M base model from scratch. If you're curious about the steps, challenges and cost, read on. I am still working on the instruct model.