Arena.ai· @arena · X·· 3 小时前AI 评分43
Arena 对齐指数更新:OpenAI 包揽前七
AI 导读
Arena 更新对齐指数,改进模型失败检测信号,覆盖更广、判断更可靠。OpenAI 包揽全部七个最高位;Anthropic 新发布的 Claude Fable 5.2 以 78.2 分首次上榜列第 8,此前第 6 的 Claude Opus 5.5 降至第 17。最佳开源模型 Kimi K3.1 Pro 列第 9,第二的 Mimo-V2.6-Flash 列第 26,多数开源模型仍落后于闭源发布。
正文 · 原文
The Arena Alignment Index has been updated!
We've refined how our signals detect model failures, providing broader coverage and more reliable judgements. Based on the updated methodology:
- @OpenAI continues to dominate, holding all seven top positions.
- @Anthropic's latest release, Claude Fable 5.2, debuts at #8 with a score of 78.2. Claude Opus 5.5, which ranked #6 on the previous index, is now #17.
- Kimi K3.1 Pro by @Kimi_Moonshot is the biggest upgrade over its predecessor (more info in thread).
- Most open source models are trailing closed releases. The best open model - Kimi K3.1 Pro - occupies #9, and the second best, Mimo-V2.6-Flash, is #26 on the Index, followed by Hy4, Beam, Inkling, DeepSeek and GLM.
The Top-6 lab:
- #1 @OpenAI GPT-6.2 Sol
- #2 @AnthropicAI Claude Fable 5.2
- #3 @Kimi_Moonshot Kimi K3.1 Pro
- #4 @GoogleDeepmind Gemini 4 Hydrogen
- #5 @spacexai Grok 4.7
- #6 @AIatMeta Muse Ember
Alignment Index measures how agents behave in real user sessions across three dimensions:
- Unauthorized Action: Doing what the user didn’t ask for or approve
- Deceptive Completion: Saying work is done, checked or working when it isn't
- False Attribution: Crediting the user with something they never said or did
More insights in the thread🧵
来源:Arena.ai · x.com