As people become more familiar with (and annoyed by) LLMs' tone, I wonder if future RLHF reviewers will stop choosing the sycophantic responses.