This looks really useful. Any thoughts on managing costs? I've been developing a... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		anotherpaulg on May 28, 2023 \| parent \| context \| favorite \| on: Hard stuff when building products with LLMs This looks really useful. Any thoughts on managing costs? I've been developing against gpt-4, and it runs up charges quickly. I've been thinking I will need to be careful about adding live api calls in any sort of testing situations. Wondering if your tool has any features to help avoid/minimize wasted api usage?

typpo on May 29, 2023 [–]

The tool maintains an LRU cache on disk by default - which means repeat identical requests will be fetched from cache instead of the live API.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact