一篇关于世界动作模型(WAM)的综述论文指出,WAM 正推动机器人从“对当前做出反应”转向“在行动前预测后果”。只有预测的未来能直接用于生成、评分、验证或训练动作的模型才算 WAM。趋势是“少做梦,多行动”:完整视频生成对实时控制回路太慢且占用内存,因此许多新系统改用潜在特征、几何、可通行性图或运动表征,而非渲染视频。
A survey paper on World Action Models.
WAMs are moving robotics from reacting to the present toward predicting consequences before acting.
A model only counts as a WAM when its predicted future directly helps produce, score, verify, or train the action.
The trend is “dream less, act more”: full video generation is often too slow and memory-heavy for real control loops.
Many newer systems skip rendered video and use latent features, geometry, affordance maps, or motion representations instead.
Photorealistic futures are not necessarily the most useful; flow, masks, tactile signals, and physically grounded latents may constrain action better.
There is no single winning architecture because every design trades predictive richness against latency, memory, action-label cost, and physical reliability.
The biggest open question is whether robots can spend heavy predictive compute only when uncertainty, contact, or irreversible error makes it necessary.
– arxiv. org/abs/2606.20781
Title: "World Action Models: A Survey"
来源:Rohan Paul · x.com