Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Oh yes, according to [1], training GPT-2 1.5B cost $50k in 2019 (reproduced in 2024 for $672!).

[1]: https://www.reddit.com/r/mlscaling/comments/1d3a793/andrej_k...



That makes sense, and it was definitely impressive for $50k.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: