ie when you cant beat them, make new metrics and you can absolutely evaluate how... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		prog_1 on Sept 13, 2024 \| parent \| context \| favorite \| on: Notes on OpenAI's new o1 chain-of-thought models ie when you cant beat them, make new metrics and you can absolutely evaluate how smart someone is in a 2min casual conversation. You wont be able to tell how well they are in some niche topic, but %insert something about different flavors of intelligence and how they do not equate do subject matter expertise%

skybrian on Sept 13, 2024 [–]

It’s a common pattern that AI benchmarks get too easy, so they make new ones that are harder.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact