Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Sorry for the late response; from what I can tell from my experience is that they're good at eliminating the unnecessary information (at least, as best as it can). You can see exactly what is passed in to the chat bot (for me, openweb-ui) and can see it's all text elements of what makes pertinent sense to be summarized.

My ideal would be an additional prompt that says "hey this page content is beyond your context length, fine with extending it to whatever the maximum context length plus some for the model's context length"?



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: