Leaderboard Lies: Broken Metrics from For-Hire Raters
·20 words·1 min
Metrics generated by for-hire human raters are broken?
The LLM leaderboard was too good to be true?
@lmsysorg https://x.com/arankomatsuzaki/status/1661908342829187072