Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> And even on my meager hardware, I can barely generate 7 token/sec with OpenAI.

How are you running a modern OpenAI model on your own hardware?



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: