无需显式轨迹的 3D 扩散策略前瞻学习:Movement Trend Guidance 提升 DP3

HuggingFace Daily Papers(社区热门论文)·2026-09-17 08:00·4天前
AI 导读

研究者提出 Movement Trend Guidance,让 3D 扩散策略从短观测历史中学习交互演化的紧凑隐表示,训练时用稀疏未来夹爪状态监督,推理时仅保留该隐表示作为面向未来的条件,且只在 UNet 瓶颈处加一个门控 FiLM 分支。

HuggingFace Daily Papers(社区热门论文)
37AI 编辑部评分,满分 100

无需显式轨迹的 3D 扩散策略前瞻学习:Movement Trend Guidance 提升 DP3

2026-09-17 08:00· 4天前
AI 导读

研究者提出 Movement Trend Guidance,让 3D 扩散策略从短观测历史中学习交互演化的紧凑隐表示,训练时用稀疏未来夹爪状态监督,推理时仅保留该隐表示作为面向未来的条件,且只在 UNet 瓶颈处加一个门控 FiLM 分支。

3D diffusion policies are strong at generating geometrically grounded actions from current observations, but successful manipulation requires not only knowing what motion is feasible now, but also anticipating where the interaction is heading. Existing policies largely leave such foresight to emerge implicitly from action learning. We introduce Movement Trend Guidance, a simple but effective way to provide this foresight without introducing an explicit plan. From a short observation history, the policy learns a compact latent representation of interaction evolution.

During training, sparse future gripper states supervise this representation; at inference, only the latent is retained as future-oriented conditioning alongside the current observation. The latent provides global conditioning for action generation, while an additional gated FiLM branch is used only at the UNet bottleneck. Despite adding only 3.52% more parameters to DP3, our method preserves the original dense-action and receding-horizon formulation and consistently improves upon DP3 across RoboTwin2.0, LIBERO-40, and DexArt. It reaches 62.8% vs.

56.1% in 50-task RoboTwin2.0 mixed training, 71.93% vs. 37.08% on LIBERO-40, and 72.0% vs. 49.0% on five real-robot tasks. These results show that a diffusion policy can benefit substantially from knowing where an interaction is heading, without being told exactly where to move.

来源:HuggingFace Daily Papers(社区热门论文)· arxiv.org