像世界模型一样思考,像 VLA 一样行动:将世界模型表征蒸馏进紧凑机器人策略

HuggingFace Daily Papers(社区热门论文)·2026-09-21 08:00·1天前
AI 导读

研究者提出一种把世界模型表征蒸馏进 VLA 策略的方法:冻结的世界模型只需对训练帧跑一次并缓存特征,学生模型在常规 VLA 训练中增加一个特征对齐项即可继承其物理场景理解,训练时无需加载教师模型。

HuggingFace Daily Papers(社区热门论文)
48AI 编辑部评分,满分 100

像世界模型一样思考,像 VLA 一样行动:将世界模型表征蒸馏进紧凑机器人策略

2026-09-21 08:00· 1天前
AI 导读

研究者提出一种把世界模型表征蒸馏进 VLA 策略的方法:冻结的世界模型只需对训练帧跑一次并缓存特征,学生模型在常规 VLA 训练中增加一个特征对齐项即可继承其物理场景理解,训练时无需加载教师模型。

Vision-Language-Action (VLA) models map observations to actions with no objective that accounts for how the world responds, so their robustness is bounded primarily by data coverage. World models carry precisely that missing objective and are better grounded for it, yet rolling the future forward costs seconds per decision and rules them out of the control loop. We show the two can be separated. What a world model knows about physical scenes lives in its internal features; generating the future is merely the objective that produced them, so the grounding can be inherited while the generative machinery is left behind. We add one feature-alignment term to ordinary VLA training: a frozen world model is run over the training frames once and cached, and the student learns to agree with that cache. No teacher is loaded during training, the projector is discarded after it, and the deployed policy is identical to the undistilled baseline, running in 32ms and 1.86GB on a consumer RTX~5090, so every gain is attributable to the representation rather than to added capacity or test-time compute. A 0.8B student reaches 97.9% on LIBERO, improves from 48.2% to 50.5% on RoboCasa-GR1 humanoid manipulation, and the same objective carries over to real hardware, on both a single-arm and a bimanual platform. The gain survives changes of student scale, backbone, alignment layer, and teacher, indicating a broad representational prior rather than a fragile alignment between two particular networks. Project page: https://thaw-vla.trung-dt.com/.

来源:HuggingFace Daily Papers(社区热门论文)· arxiv.org