Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

An H100 is maybe a car but not nearly close to a house...


Maybe not in your area, but it's very doable in other places, like where I live.


You expect me to believe there are other places than where I live?!


8 H100s would have enough VRAM to finetune a 70B model.


Is a single H100 enough?


80GB is enough, yeah.

I'm not sure what exact LORA/quantization settings would be ideal, but check out https://github.com/OpenAccess-AI-Collective/axolotl#config




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: