MA-VLA:面向协作与组合泛化的多臂视觉-语言-动作模型

HuggingFace Daily Papers(社区热门论文)·2026-08-26 08:00·32天前
AI 导读

MA-VLA提出统一的多臂协作框架,将协作行为分解为中层原子提示并分配给各机械臂,实现显式子目标指定与跨任务组合复用。其引入训练时置换机制Arm Shuffle,强制角色无关的指令跟随,支持重组为未见过的协作模式。在仿真与真实世界评估中,先前SOTA VLA模型在未见协作下大多失败,MA-VLA则持续成功,代码、模型与数据已开源。

HuggingFace Daily Papers(社区热门论文)
49AI 编辑部评分,满分 100

MA-VLA:面向协作与组合泛化的多臂视觉-语言-动作模型

2026-08-26 08:00· 32天前
AI 导读

MA-VLA提出统一的多臂协作框架,将协作行为分解为中层原子提示并分配给各机械臂,实现显式子目标指定与跨任务组合复用。其引入训练时置换机制Arm Shuffle,强制角色无关的指令跟随,支持重组为未见过的协作模式。在仿真与真实世界评估中,先前SOTA VLA模型在未见协作下大多失败,MA-VLA则持续成功,代码、模型与数据已开源。

Multi-arm collaboration is becoming a core capability in embodied manipulation. Recent vision-language-action (VLA) models integrate perception, language, and control, but most represent language as a single global instruction and do not provide an explicit mechanism for assigning and composing arm-specific behaviors. This design limits transfer to collaboration patterns that differ from those observed during training. We present MA-VLA, a unified framework for multi-arm collaboration via atomic action assignment. MA-VLA decomposes cooperative behavior into mid-level atomic prompts and allocates them to individual arms, enabling explicit subgoal specification and compositional reuse across tasks. To reduce reliance on fixed execution roles, we introduce Arm Shuffle, a training-time permutation of the observation, state, and assigned atomic prompts for each arm. This permutation enforces role-agnostic instruction following and supports recomposition into unseen coordination patterns, which we term multi-arm compositional generalization. We also construct a benchmark in which test-time collaboration patterns are absent in training set. Across simulation and real-world evaluations, prior state-of-the-art VLAs largely fail under these unseen collaborations, while MA-VLA consistently succeeds. These results indicate that structured, per-arm atomic action assignment offers a practical route to scalable generalization in multi-arm embodied systems. Code, models, and data are available at https://github.com/zhangzaibin/future-robots

来源:HuggingFace Daily Papers(社区热门论文)· arxiv.org