# Stanford 与 MIT 论文提出 Meta-Harness，同一模型换 harness 可拉开最高 6 倍性能差距

- 来源：Rohan Paul (@rohanpaul_ai)
- 发布时间：2026-09-13 12:04
- AIHOT 分数：54
- AIHOT 链接：https://aihot.news/items/cmtzasmyg04krro2owev69mn9
- 原文链接：https://x.com/rohanpaul_ai/status/2098986025397977287

## AI 摘要

Stanford 与 MIT 论文《Meta-Harness: End-to-End Optimization of Model Harnesses》（arxiv. org/abs/2603.28052）指出模型性能还取决于周边系统代码 harness，同一 LLM 换 harness 在同一基准上可出现最高 6 倍性能差距。

## 正文

Stanford + MIT paper on Model Harnesses shows that AI performance depends not just on the model itself, but on the surrounding system code — the “harness”.

This is what decides what to store, retrieve, show to the model, and how the workflow runs. With the same underlying LLM, changing the harness can create up to a 6× performance gap on the same benchmark.

They conclude the harness around a model matters as much as the model itself.

The paper introduces Meta-Harness, an outer-loop system that automatically improves harness code. Instead of giving the optimizing agent only a score or a short summary of past attempts, it gives the agent rich access to prior code, logs, and execution traces through a filesystem-like setup.

The idea is that better diagnostic visibility lets the system improve the harness more intelligently.

What it found is pretty significant.

• On online text classification, a 7.7-point improvement over a strong SOTA context management, while using 4X fewer context tokens.

• On retrieval-augmented math reasoning, an average gain of 4.7 points across five held-out models on 200 IMO-level problems. On agentic coding, the discovered harnesses beat strong hand-engineered baselines on TerminalBench-2.

The paper shifts attention from “which model is best?” to “how is the whole AI system designed?”

For real deployments, harness design affects reliability, tool usage, context management, and failure recovery.

----

Paper – arxiv. org/abs/2603.28052

Paper Title: "Meta-Harness: End-to-End Optimization of Model Harnesses"