AIDE2 论文展示 AI 研究智能体的递归自我改进

HuggingFace Daily Papers(社区热门论文)·2026-09-22 08:00·1天前
AI 导读

论文提出 AIDE²,一个让前沿 AI 研究智能体递归自我改进的系统:智能体提出对自身代码的修改,在 AI R&D 任务套件上基准测试修改版本,只保留隐藏评估表现最好的改动。

HuggingFace Daily Papers(社区热门论文)
74AI 编辑部评分,满分 100

AIDE2 论文展示 AI 研究智能体的递归自我改进

2026-09-22 08:00· 1天前
AI 导读

论文提出 AIDE²,一个让前沿 AI 研究智能体递归自我改进的系统:智能体提出对自身代码的修改,在 AI R&D 任务套件上基准测试修改版本,只保留隐藏评估表现最好的改动。

AI agents are beginning to automate research and development across the AI stack, from improving training efficiency to optimizing inference. A natural next step is to improve the research efficiency of the agents themselves. When an AI research agent's own code is the object of optimization, each accepted rewrite becomes the agent that the next round edits. We refer to this loop as recursive self-improvement. Its significance lies in a long-standing trend, in which increased cumulative spending on R&D yields diminishing returns. Sustained self-improvement offers a way to counter this trend.

We present AIDE^2, a system that implements this loop for a frontier AI research agent. It proposes changes to its own code, benchmarks modified versions of itself on a suite of AI R&D tasks, and keeps the changes that perform best on hidden evaluations. In an autonomous 8-day run, AIDE^2 discovered seven successive improvements, ranging from a new search policy to memory mechanisms that compress and manage the agent's growing context. These gains generalize to four held-out benchmarks spanning machine learning engineering, heuristic algorithm engineering, and physics-based weather forecasting, the last of which is out of distribution from the selection tasks.

On all four, the strongest discovered agent matches or exceeds a human-engineered production research agent that ranks among the strongest on FML-Bench. On a separate held-out task family, the discovered agents also exhibit reduced reward hacking, a property the loop never explicitly optimized for: the rate falls from 55% to 32% during the run, 7 percentage points below the human-engineered agent. Together, these results show that an AI research agent can improve its own research efficiency through recursive self-improvement, and that these gains transfer to tasks and domains the loop never encountered.

来源:HuggingFace Daily Papers(社区热门论文)· arxiv.org