# Nvidia SoL-Pi 系统优化 agent harness，编码任务 token 用量减少近一半

- 来源：The Decoder：AI News（RSS）
- 作者：Jonathan Kemper
- 发布时间：2026-09-26 18:30
- AIHOT 分数：61
- AIHOT 链接：https://aihot.news/items/cmuia3dtr0b2jrov0w9x40faf
- 原文链接：https://the-decoder.com/nvidias-sol-pi-system-cuts-coding-agent-token-usage-nearly-in-half-by-optimizing-the-harness

## AI 摘要

Nvidia 研究人员提出 SoL-Pi 系统，用研究 agent 自动优化编码 agent 的控制层（harness），在 EdgeBench 上相比 Codex 节省 50%、相比 Claude Code 节省 54.3% 的 token，性能与原 Pi harness 大致持平。

## 正文

Nano Banana Pro prompted by THE DECODER

A new Nvidia paper describes a system that automatically optimizes the control layer of coding agents, known as the harness. Token usage drops by almost half while performance stays roughly the same, according to the researchers.

The longer AI agents work unsupervised, the more expensive they get. Single predictions turn into long chains of reasoning, tool calls, and feedback loops, and token usage balloons along the way.

A new study from Nvidia researchers tackles these costs not at the model level but at the harness, the control layer between the model and its environment used by systems like Codex, Claude Code, or OpenClaw.

A research AI analyzes agent traces, proposes harness changes, and keeps only those that maintain performance while cutting costs. SoL-Pi saves 50 percent compared to Codex and 54.3 percent compared to Claude Code on EdgeBench. | Image: Nvidia

The harness controls how an agent sees states, runs actions, and processes feedback. Most efficiency methods so far have focused on cutting the cost per token through faster attention kernels and serving infrastructure, model compression like quantization, or swapping in cheaper models.

AI explores 152 directions to find leaner control logic

Optimizing the harness is hard in practice because tool usage, context management, verification, and abort logic are all tightly coupled. A change that saves tokens in one place can trigger errors elsewhere or just push costs into a later phase. Typically, humans sift through long execution traces and translate recurring failure patterns into code.

The system, called SoL-Pi, automates that work. A research agent watches another agent's traces, proposes changes, and tests them in prepared environments. Capability and efficiency checks determine which candidates survive. The approach draws on recursive self-improvement, according to the authors.

The held-out evaluation happens only after the harness is frozen and doesn't feed back into the search process. | Image: Nvidia

Across 535 executable environments, the system explored 152 directions, including 495 tasks derived from GitHub issue-pull-request pairs and 40 synthetic test cases. In total, the process generated more than 3,000 runs and over 60,000 agent-environment interactions. According to the researchers, this scale shows how broadly the system searched, but more search doesn't automatically yield better results. That's a risk here, because earlier work showed that automatically optimized harnesses tend to overfit to their training tasks and offer little benefit on unfamiliar ones.

SoL-Pi addresses this by strictly separating search feedback from evaluation. The researchers used EdgeBench as their test benchmark and walled it off from the search process entirely. Of its 51 public tasks, they used 11 for one-time validation of finished candidates. The remaining 40 were reserved for final evaluation, and those results never fed back into the search.

Four mechanisms that eliminate wasted work

The search produced four mechanisms. Action Fusion merges two consecutive steps into one, such as a code edit followed by a test run, which eliminates an entire language model call. Online Context Compact runs after each planning step and trims accumulated context whenever it can do so without losing important information.

ObservationPack archives long tool outputs and drops in a short summary on later steps rather than resending the full text each time. The Evidence-Preserving Reducer routes large error and test logs to a cheaper model that boils them down to the key findings, with an automatic verification step catching any critical clues that slip through.

Nvidia searches across 535 executable environments for mechanisms and holds EdgeBench back for final evaluation. | Image: Nvidia

On EdgeBench's 51 public tasks, SoL-Pi performs about as well as the original Pi harness, according to the researchers. How much token usage drops depends on the configuration. The most efficient variant combines all four mechanisms, uses 49 percent fewer tokens, and reaches 93.7 percent of Pi's score. Users who prioritize performance and pick only the strongest single mechanism beat Pi's score by 5.3 percent while still saving tokens. Across both variants, token usage drops by 44.7 to 49 percent.

SoL-Pi's efficiency variant cuts token usage in half compared to Pi and costs $894 instead of $1,339, with a slightly lower score. | Image: Nvidia

In dollar terms, the authors estimate savings of $8.75 to $13.50 per hour compared to native Codex and Claude Code harnesses, and $4.36 to $5.71 per hour compared to Pi, based on current API prices.

The researchers built the system with GPT-5.6 Sol only and then applied it to Opus 5 without any changes. There, it retained 94.3 percent of Pi's performance with similar savings. But the mechanisms triggered less often and less aggressively under Opus 5, which the researchers attribute to the harness being optimized solely on GPT-5.6 Sol trajectories.

Results get messier on other benchmarks

Beyond EdgeBench, the picture is more mixed. On 63 CPU tasks from Terminal-Bench 4, SoL-Pi solves only 15 tasks while Codex and Pi each solve 18. Total costs still came in about a quarter lower than Pi's.

On the formally verified Lean 4 tasks from the 2026 Math Olympiad (IMO 2026), the system cracked three of six problems at the lowest cost per solved problem. In a kernel optimization experiment, a swarm of 20 SoL-Pi workers cut costs by 26.8 percent compared to a comparable Pi swarm.

In the kernel optimization test, the swarm with SoL-Pi workers achieves the best result and costs about a quarter less than the swarm with Pi workers. | Image: Nvidia

The efficiency gains come with trade-offs, because shorter context can reduce prompt cache reuse. Total costs in one test run still dropped from $1,339 to $894. Looking ahead, the authors suggest pretraining the harness across many tasks, similar to how models are pretrained, and using an already lean harness to make searching for its successor cheaper. They call this recursive efficiency improvement a vision, not a finding from the current study.

How much the harness shapes an agent's costs became clear in an August test by tooling company Composio, which ran Deepseek V4 Flash across four agent frameworks including Claude Code and the Pi-based Oh My Pi. The cost per solved task varied by nearly 3x even though the same model was doing the work.

The pricing and optimization pressure keeps growing because agents consume ever more tokens. According to OpenRouter analyst Peter Walker, agentic token usage has grown 14x since February 2026, and nearly 70 percent of that comes from cached prompts.

Context compression of the kind SoL-Pi uses can have side effects, though. One study found that compression preserves only 17 percent of user instructions on average. Parallel agents drive up costs too. Codex developer Eric Provencher recently warned that more than two sub-agents almost always burn tokens without improving quality, since they spend most of their time checking each other's work.