Harness-Zero:通过 Agent-as-Harness 实现智能体框架蒸馏

HuggingFace Daily Papers(社区热门论文)·2026-09-21 08:00·1天前
AI 导读

Harness-Zero 提出"agent-as-harness"方法,将领域或实例优化的智能体框架作为训练期指导,把其带来的行为迁移进模型权重,使收益在部署时单一固定框架下依然保留。实验显示,移除专用框架后,该方法将基座模型的宏平均任务成功率从 23.3% 提升至 44.3%,超过仍挂载该框架时的 41.7%。在知识工作、工具使用和科学三个领域的 28 种行为模式上,平均恢复率达 82.3%。

HuggingFace Daily Papers(社区热门论文)
50AI 编辑部评分,满分 100

Harness-Zero:通过 Agent-as-Harness 实现智能体框架蒸馏

2026-09-21 08:00· 1天前
AI 导读

Harness-Zero 提出"agent-as-harness"方法,将领域或实例优化的智能体框架作为训练期指导,把其带来的行为迁移进模型权重,使收益在部署时单一固定框架下依然保留。实验显示,移除专用框架后,该方法将基座模型的宏平均任务成功率从 23.3% 提升至 44.3%,超过仍挂载该框架时的 41.7%。在知识工作、工具使用和科学三个领域的 28 种行为模式上,平均恢复率达 82.3%。

Agent harnesses, the external systems that mediate model-environment interaction, can substantially improve agent performance, but their gains remain tied to the harness at deployment. Because the best harness varies across domains, instances, and models, a general-purpose agent must either settle for a suboptimal shared harness or route among an ever-growing set of specialized ones. We therefore study agent harness distillation: using a domain- or instance-optimized harness as training-time guidance and transferring the behaviors it induces into model weights, so that its gains survive under a single fixed target harness.

The challenge is that the two harnesses differ in action space and available information, so guidance from the optimized harness cannot serve directly as supervision for the target one. We introduce Harness-Zero, which enables harness distillation through agent-as-harness. Guided by the optimized harness, a harnessing agent corrects student responses before execution in the target harness's action space, turning harness guidance into training demonstrations. Fine-tuning on the resulting trajectories internalizes harness-induced behavior into the model, so the specialized harness can be removed at deployment.

Our experiments spanning knowledge work, tool use, and science domains show that: (1) For frontier LLMs using the same evolved harness, agent-as-harness outperforms code-as-harness. (2) With the specialized harness removed at deployment, Harness-Zero improves the base model's macro-average task success from 23.3% to 44.3%, even exceeding the 41.7% it reaches with that harness still attached. (3) Harness-Zero recovers harness-induced behaviors absent from the base model, with 82.3% average recovery across 28 patterns in the three domains.

来源:HuggingFace Daily Papers(社区热门论文)· arxiv.org