Latent visual reasoning aims to perform multimodal reasoning through hidden-state computation rather than explicit textual chains of thought. However, visual information being present in a latent state does not imply that the model actually relies on that state when producing its answer, especially when alternative image-conditioned paths remain available. We introduce Causal Visual Recurrent Reasoning (CVRR), which preserves pretrained visual competence while making recurrent computation the required image-conditioned path to prediction. CVRR initializes recurrence from the question hidden state after the pretrained vision-language model has incorporated the image, then repeatedly updates this state while re-reading the same fixed visual evidence. Before decoding, visual states and the original multimodal KV cache are removed so that only the final recurrent state carries image-conditioned information to the answer. Across the V^*, MMVP, BLINK, and MME-RealWorld-Lite benchmarks, CVRR retains strong performance under this strict interface, while compatible latent reasoners fail to recover comparable visual competence even when retrained under the same constraint. Causal interventions further show that predictions remain sensitive to recurrent content when the question is held fixed, and that persistent visual evidence causally revises the recurrent trajectory. These results distinguish latent informativeness from latent computation that is actually used for prediction.
CVRR:让潜在视觉推理成为预测的必要路径
AI 导读
CVRR通过从问题隐藏状态初始化循环计算并反复重读固定视觉证据,在解码前移除视觉状态和原始多模态KV cache,使循环计算成为唯一携带图像信息的预测路径。在V^*、MMVP、BLINK和MME-RealWorld-Lite基准上,CVRR保持强性能,而兼容的潜在推理器在相同约束下重训仍无法恢复同等视觉能力。因果干预表明预测对循环内容敏感,持久视觉证据会因果性地修正循环轨迹。
HuggingFace Daily Papers(社区热门论文)
42
AI 编辑部评分,满分 100CVRR:让潜在视觉推理成为预测的必要路径
CVRR通过从问题隐藏状态初始化循环计算并反复重读固定视觉证据,在解码前移除视觉状态和原始多模态KV cache,使循环计算成为唯一携带图像信息的预测路径。在V^*、MMVP、BLINK和MME-RealWorld-Lite基准上,CVRR保持强性能,而兼容的潜在推理器在相同约束下重训仍无法恢复同等视觉能力。因果干预表明预测对循环内容敏感,持久视觉证据会因果性地修正循环轨迹。
原文 · 保持原样,未翻译原文 · 未翻译
来源:HuggingFace Daily Papers(社区热门论文)· arxiv.org