跳到正文
Arena.ai· @arena · X·· 3 小时前AI 评分43

Arena 对齐指数更新:OpenAI 包揽前七

AI 导读

Arena 更新对齐指数,改进模型失败检测信号,覆盖更广、判断更可靠。OpenAI 包揽全部七个最高位;Anthropic 新发布的 Claude Fable 5.2 以 78.2 分首次上榜列第 8,此前第 6 的 Claude Opus 5.5 降至第 17。最佳开源模型 Kimi K3.1 Pro 列第 9,第二的 Mimo-V2.6-Flash 列第 26,多数开源模型仍落后于闭源发布。

正文 · 原文

The Arena Alignment Index has been updated!

We've refined how our signals detect model failures, providing broader coverage and more reliable judgements. Based on the updated methodology:

  • @OpenAI continues to dominate, holding all seven top positions.
  • @Anthropic's latest release, Claude Fable 5.2, debuts at #8 with a score of 78.2. Claude Opus 5.5, which ranked #6 on the previous index, is now #17.
  • Kimi K3.1 Pro by @Kimi_Moonshot is the biggest upgrade over its predecessor (more info in thread).
  • Most open source models are trailing closed releases. The best open model - Kimi K3.1 Pro - occupies #9, and the second best, Mimo-V2.6-Flash, is #26 on the Index, followed by Hy4, Beam, Inkling, DeepSeek and GLM.

The Top-6 lab:

  • #1 @OpenAI GPT-6.2 Sol
  • #2 @AnthropicAI Claude Fable 5.2
  • #3 @Kimi_Moonshot Kimi K3.1 Pro
  • #4 @GoogleDeepmind Gemini 4 Hydrogen
  • #5 @spacexai Grok 4.7
  • #6 @AIatMeta Muse Ember

Alignment Index measures how agents behave in real user sessions across three dimensions:

  • Unauthorized Action: Doing what the user didn’t ask for or approve
  • Deceptive Completion: Saying work is done, checked or working when it isn't
  • False Attribution: Crediting the user with something they never said or did

More insights in the thread🧵

来源:Arena.ai · x.com