跳到正文
Karina· @karinanguyen · X·· 2026-07-18AI 评分58
AI 导读

Karina Nguyen 团队发布 DiligenceBench,一个面向公开股权研究的基于评分标准的新评测基准。Meta Muse Spark 1.1 以 57.4% 的成绩领先金融评测,其后为 GLM 5.2、Sonnet 4.6 和 GPT-5.6 Sol。评测发现,金融评测框架能同时提升多数模型的性能与性价比,其中 GLM 5.2 绝对性能领先,MiniMax M3 综合效率最强。

正文 · 原文

We dropped DiligenceBench, a new frontier, rubric-based eval for public-equity research.

A few observations:

1/ Meta Muse Spark 1.1 tops the finance harness at 57.4%, followed by GLM 5.2, Sonnet 4.6, and GPT-5.6 Sol.

2/ We found that strong models benefit primarily from generic tools that unlock execution, while weaker models require more opinionated, domain-specific scaffolding.

3/ Inkling appears to be domain-competence bottlenecked. The generic sandbox barely improved its performance, from 20.9% to 22.5%, suggesting that tool access alone was not enough. The finance harness then lifted it to 32.8%, with the largest gain coming from factual accuracy. This makes the value of a harness model-dependent.

4/ The finance harness shifts the price–performance frontier: it makes most models simultaneously better and cheaper, with GLM 5.2 leading on absolute performance and MiniMax M3 offering the strongest overall efficiency.

引用Thoughtful@thoughtfullab
http://x.com/i/article/2078175024880795648
在 X 查看被引用的帖子

来源:Karina · x.com