VHD-Play:从已解机制生成智能体 RL 环境,训练 Qwen3.6-35B-A3B 智能体得分从 0.204 升至 0.815

HuggingFace Daily Papers(社区热门论文)·2026-09-23 08:00·1天前
AI 导读

VHD-Play 提出先采样并求解数学模型、再由 corpus-grounded setter 将决策过程渲染为有状态工具的环境生成流程,可执行动态与轨迹评分标准均继承自同一已解模型,以每个几美分的成本生成 3,300 个智能体环境。

HuggingFace Daily Papers(社区热门论文)
47AI 编辑部评分,满分 100

VHD-Play:从已解机制生成智能体 RL 环境,训练 Qwen3.6-35B-A3B 智能体得分从 0.204 升至 0.815

2026-09-23 08:00· 1天前
AI 导读

VHD-Play 提出先采样并求解数学模型、再由 corpus-grounded setter 将决策过程渲染为有状态工具的环境生成流程,可执行动态与轨迹评分标准均继承自同一已解模型,以每个几美分的成本生成 3,300 个智能体环境。

Language-model agents increasingly face long-horizon tasks with evolving state, interdependent decisions, and delayed outcomes. Scaling their training requires diverse agentic environments, dependable outcome signals, and low extension cost. Existing generation pipelines commonly construct an environment before defining its outcome rule or annotating its trajectories, leaving dynamics and evaluation to be aligned post hoc. VHD-Play reverses this dependency by sampling and solving a mathematical model before a corpus-grounded setter renders its decision process as stateful tools.

The executable dynamics and trajectory-scoring reference are inherited from the same solved model. The pipeline produces 3,300 diverse agentic environments at a cost of a few cents each. Training Qwen3.6-35B-A3B on three families raises its mean agentic score from 0.204 to 0.815 in a five-family diagnostic. Gains also appear on held-out instances from all three training families and eight unseen mechanism families, then extend beyond the generated substrate to external benchmarks for general function calling, travel planning, and 365-day e-commerce.

On E-Commerce Bench, the trained checkpoint completes every run without bankruptcy and exceeds Qwen3.7-Max. We compare written-out problems with stateful versions that reveal or hide their parameters. The comparison shows that most of the learnable gap lies in stateful interaction rather than underlying problem solving. A frozen 35B setter realizes larger environments, and scale-matched training retains gains as mechanism size and horizon grow, indicating the potential for an evolving training substrate.

来源:HuggingFace Daily Papers(社区热门论文)· arxiv.org