Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Just had a quick look - while they have that self-hosting option, they still assume you will use a cloud LLM. I started digging because I got confused of them not mentioning any GPU when it comes to resource requirements. There is some documentation on using it fully self-hosted including the LLM, but the emphasis here is on "some".

To be clear: I am looking at this from a CEO perspective, not a "I will play with it in my spare time" nerd one.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: