My take: multi turn evals are hard because to do it really correctly you have to...

		dontreact 9 months ago \| parent \| context \| favorite \| on: LLMs get lost in multi-turn conversation My take: multi turn evals are hard because to do it really correctly you have to simulate a user. This is not yet modeled well enough for multi turn to work as well as it could.