跳到正文
Rohan Paul· @rohanpaul_ai · X·· 1 小时前AI 评分53

Google 与 Johns Hopkins 论文:Pro² Agent 用问题状态追踪提升 MLE-Bench 成绩

AI 导读

Google 与 Johns Hopkins 的论文 Pro² Agent 提出,让 AI 研究智能体先构建显式 Problem State,记录疑似瓶颈、文献候选修复和置信度,再通过单变量实验更新信念,而不是只循环改代码保留最高分。

正文 · 原文

New Google and Johns Hopkins paper shows that AI research agents do better when they track what limits performance, not just which code scored best.

Agents that do ML research usually loop on code: change it, score it, keep the best. On hard tasks they can get stuck tweaking a solution that is wrong at its core.

Pro2 Agent first builds a "Problem State": the bottlenecks it suspects, candidate fixes from the literature, and how confident it is in each. It then runs single-variable experiments that update those beliefs before committing changes.

On all 75 MLE-Bench tasks, it reached a 76.0% medal rate with 48 hours, the highest reported, using Gemini 3.5 Flash for coding. On MLE-Bench Lite, its first solution already medaled on 57.6% of tasks, against 28.8% for MARS.

If you build research agents, make them write down and update what is blocking progress, and test 1 change per experiment.

来源:Rohan Paul · x.com