模型与执行框架协同进化:在策略专家纠错让弱模型在模仿失效处追赶

HuggingFace Daily Papers(社区热门论文)·2026-09-08 08:00·2天前
AI 导读

研究提出一种在策略专家纠错流程,由元级 MLE 智能体自动定位弱模型自身 rollout 中的失败轮次,仅让专家重写该轮,从而在保留模型原生规划风格的同时结合 harness 进化与模型适配的收益。在七项企业智能体任务上,用专家完整轨迹对 Qwen3-Coder 和 Gemma 4 做模仿训练反而使全部七项任务性能下降 4 至 30 分,原因是模仿破坏了模型与 harness 的匹配。

HuggingFace Daily Papers(社区热门论文)
48AI 编辑部评分,满分 100

模型与执行框架协同进化:在策略专家纠错让弱模型在模仿失效处追赶

2026-09-08 08:00· 2天前
AI 导读

研究提出一种在策略专家纠错流程,由元级 MLE 智能体自动定位弱模型自身 rollout 中的失败轮次,仅让专家重写该轮,从而在保留模型原生规划风格的同时结合 harness 进化与模型适配的收益。在七项企业智能体任务上,用专家完整轨迹对 Qwen3-Coder 和 Gemma 4 做模仿训练反而使全部七项任务性能下降 4 至 30 分,原因是模仿破坏了模型与 harness 的匹配。

Agent harnesses (the system prompt, tool set, execution hooks, and context-management scaffolding around a model) are a critical determinant of agentic task success. Automated harness evolution can enable smaller models to perform well on domain-specific tasks at a fraction of frontier-model cost. Since both the harness and model weights shape behavior, we ask how harness evolution and lightweight fine-tuning should be combined. Across seven enterprise agent tasks, we first evolve a harness with the weaker model, then find that a stronger expert often uses it more effectively, suggesting expert supervision could close the remaining gap. However, training the weaker model on the expert's complete trajectories under the evolved harness backfires: performance regresses on all seven tasks by 4 to 30 points across Qwen3-Coder and Gemma 4, even though the same procedure helps under the unevolved harness. Our analysis shows that imitation transfers knowledge and increases scaffold usage, but disrupts model-harness fit: the weaker model adopts the expert's planning strategy without the competence to execute it and no longer matches the harness evolved around its native planning style. We therefore develop an on-policy expert-correction pipeline, automated by a meta-level MLE agent, that localizes the failing turn in the weaker model's own rollout and asks the expert to rewrite only that turn. This preserves the model's planning style and combines the gains of harness evolution and model adaptation. Our results identify and resolve a source of contention between harness and weight updates, yielding a compatibility-preserving recipe for economical co-evolution on domain-specific enterprise tasks.

来源:HuggingFace Daily Papers(社区热门论文)· arxiv.org