Nathan Lambert· @natolambert · X·· 3 小时前AI 评分53
AI 导读
Nathan Lambert 发表对基准评测行业的 meta-review，认为开放模型被夸大了衰落，但此前 Artificial Analysis 的指数确实高估了它们。他提出行业需要更具体的智能指数，因为 LLM 被用于差异极大的任务，并附上 Interconnects 长文链接。
正文 · 原文
Open models' demise has been greatly exaggerated, but the previous AA index did flatter them. As an industry we need more specific intelligence indices, as LLMs are used in vastly different tasks.
My meta-review on the benchmarking industry.
https://www.interconnects.ai/p/artificial-analysis-v5-and-the-benchmarkers
来源：Nathan Lambert · x.com