Ask HN: What are the machine requirements for a LLM like Llama-3.1-8B?

2 comments

• yorwba 8 hours ago

  https://www.canirun.ai can help you find a model that'll run on your hardware.

• alex7o 9 hours ago

  Think of it like that 8b model needs 8gb of vram. Also search online there is a lot of info on that