MemBodied:为视觉-语言-动作模型打造循环联想记忆

HuggingFace Daily Papers(社区热门论文)·2026-09-23 08:00·1天前
AI 导读

MemBodied 是一种固定大小的情景记忆机制,为 Vision-Language-Action 模型提供跨策略调用的联想状态和保留初始场景的 episode anchor,避免直接堆叠历史观测。

HuggingFace Daily Papers(社区热门论文)
43AI 编辑部评分,满分 100

MemBodied:为视觉-语言-动作模型打造循环联想记忆

2026-09-23 08:00· 1天前
AI 导读

MemBodied 是一种固定大小的情景记忆机制,为 Vision-Language-Action 模型提供跨策略调用的联想状态和保留初始场景的 episode anchor,避免直接堆叠历史观测。

Vision-Language-Action models provide a strong foundation for general-purpose robot control, yet a vast majority of policies do not preserve and leverage episode-level information beyond the current observation. This limitation is consequential in history-dependent manipulation tasks that depend on information available only in past observations. Retaining past observations in context can aid in recovering this information, but at the significant cost of ever-growing, bloated context and inference latency. We thus introduce MemBodied, a fixed-size episodic memory with two complementary components: an associative state that records interactions across policy calls and an episode anchor that preserves a compact representation of the initial scene as a reference.

At each policy call, the model conditions action generation on the current input and the memory components, rather than directly using past observations. Across five evaluated RMBench tasks requiring memory, MemBodied achieves 7.81times the mean success rate of a stateless policy and 2.98times of vanilla recurrent memory, while outperforming the strongest memory-augmented baseline by 1.3times with 10times fewer added parameters. On the fully observable LIBERO-Long suite, it reached 90.6%, a 5.4% improvement over the stateless π_0 policy. These findings support MemBodied as a practical alternative to expanding the policy context for history-dependent manipulation.

来源:HuggingFace Daily Papers(社区热门论文)· arxiv.org