Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I'm not 100% sure what you mean by this, but there is token probability available in some providers:

https://cookbook.openai.com/examples/using_logprobs



I think logprobs functionality was removed because it allowed to exfiltrate the last layer of weights of their propietary models




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: