Nathan Lambert：Interconnects· Nathan Lambert·· 3 小时前AI 评分27
Artificial Analysis v5 与基准测试者的困境
Artificial Analysis v5 and the benchmarker's dilemma
AI 导读
Artificial Analysis v5 发布，文章讨论基准测试者面临的困境：提升分数虽昂贵但有清晰打法，而在当前 AI 前沿打造有意义的基准却难得多。作者认为，语言模型的独立评估难度被严重低估。
正文 · 原文
Housekeeping: I’m on the road so the voiceover will be late.
Hill-climbing is easy, knowing what to hill-climb is hard. Making scores go up is expensive, but we have a much clearer playbook for it than we do for creating meaningful benchmarks at the true frontier of AI today.
Independent evaluation of language models is under-appreciated in how hard of a …
Subscribe for free to continue reading
Enter your email and get every post from Interconnects AI.
来源：Nathan Lambert：Interconnects · interconnects.ai