跳到正文
Cognition· @cognition · X·· 3 小时前AI 评分45
AI 导读

我们在 FrontierCode 2.0 上评估了 Gemini 4 Carbon 和 Gemini 4 Argon,这是我们的编程基准,衡量模型超越规格要求的能力。 Gemini 4 Carbon 得分接近 SOTA,为 40%,每任务成本 $4.04,落后于 Claude Opus 5.5、GPT-6 Astra 和 Claude Sonnet 5.5。 Gemini 4 Argon 得分 26.3%,每任务成本 $6.41,领先于 Muse Wonder 1.0,但落后于 Claude Haiku 5.5 和 Grok 4.7。 查看完整得分排行榜:https://cognition.com/frontiercode

正文 · 原文

We've evaluated Gemini 4 Carbon and Gemini 4 Argon on FrontierCode 2.0, our coding benchmark that measure's a model's ability to go beyond the spec.

Gemini 4 Carbon scores near SOTA with a score of 40% and a cost of $4.04 per task, behind Claude Opus 5.5, GPT-6 Astra, and Claude Sonnet 5.5.

Gemini 4 Argon scores 26.3% with a cost of $6.41 per task, ahead of Muse Wonder 1.0, but behind Claude Haiku 5.5 and Grok 4.7.

See the leaderboard with full scores: https://cognition.com/frontiercode

来源:Cognition · x.com