跳到正文
Rohan Paul· @rohanpaul_ai · X·· 2026-08-06AI 评分37
AI 导读

金融 AI 智能体系统 Primer 在 BigFinanceBench(928 道真实分析师任务题)上以 79.1% 的准确率登顶,而同一 GPT-5.5 模型裸测仅得 55.8%。16.3 分的提升来自检索(智能体从实际文件中定位数据),9.3 分来自计算(Primer 内置公司自定义指标逻辑)。该评测现已被列入 OpenAI GPT-5.6 发布页的唯一金融基准。

正文 · 原文

This is great news showing the power that agentic harness brings in the world of finance.

Primer scored 79.1% on BigFinanceBench, a 928-question finance benchmark, using GPT-5.5, the same model that alone scores 55.8%.

BigFinanceBench measures whether AI can complete real financial-analyst tasks, retrieval, calculations, modeling, and reasoning, not just answer finance trivia. You get asked to split a private equity fund's profit between its investors and its managers, or rebuild divisional numbers after a reporting change.

GPT-5.5 leads all models at 55.8%, and inside Primer's harness the same model hits 79.1%.

Primer is a finance-focused AI agent system that wraps a general model like GPT-5.5 with specialist retrieval, calculation tools, and workflow logic to perform analyst tasks more reliably.

Most of the gain, 16.3 points, came from retrieval, because the agent goes and finds the right line in the actual filing instead of reasoning over whatever the benchmark hands it.

The rest, 9.3 points, came from calculation, because Primer already knows how a company defines its own metrics, so it excludes a credit line announced six weeks after the quarter closed rather than counting it as liquidity.

引用Al Smallwood@SmallwoodAl_
Primer tops BigFinanceBench. We ran @primerapp_ on @RogoAI's BigFinanceBench. Primer tops the leaderboard: 79.1% final-answer accuracy vs 55.8% for the best frontier model. BigFinanceBench is the real deal conceptually in terms of a benchmark: 928 questions of actual analyst work, graded on the working as well as a final answer. It's now the only finance eval on @OpenAI GPT-5.6 launch page. This is such a great demonstration of the power of an agent harness. At time of testing, Primer's agent was powered by GPT-5.5 which when tested 'naked', scored 55.8% but inside Primer's harness: 79.1%. As we saw from the BigFinanceBench scores of Fable, Opus 4.8 and GPT-5.6, next generational models are not closing this gap in finance, which is why we are laser focused on improving our harness to deliver the highest performing finance agent globally. While verifying our results and understanding our errors, we found errors in 12% of the benchmark's questions, which we have detailed in our blog post here: https://www.primerapp.com/blog/primer-tops-bigfinancebench/
在 X 查看被引用的帖子

来源:Rohan Paul · x.com