In this paper, we propose ReactVAU, a Slow-Fast Decoupled Framework for real-time streaming Video Anomaly Understanding (VAU). Existing VAU methods rely on offline inference with global temporal sampling, which violates causality and prevents deployment in live surveillance streams. Conversely, general streaming video models satisfy causal access but dilute rare transient anomalies during memory compression and often invoke heavyweight MLLMs uniformly over long normal intervals. React VAU addresses this gap with three synergistic components: a lightweight Fast Detection Module based on Spatial Grid Folding (SGF) for continuous anomaly filtering; an Anomaly-Aware Persistent Memory (AAPM) that protects critical visual cues from temporal decay; and a heavyweight Slow Reasoning Module that remains dormant during normal streams and is awakened only by suspicious events for semantic verification and causal description. Extensive experiments on multiple benchmarks demonstrate that ReactVAU operates under strict streaming constraints while simultaneously achieving competitive performance in both anomaly detection and causal reasoning, alongside significantly enhanced computational efficiency by minimizing heavyweight MLLM invocations. Project page is available at https://huiyuiui.github.io/React_VAU/
ReactVAU:面向流式视频异常理解的慢-快解耦框架
AI 导读
ReactVAU提出一种慢-快解耦框架,用于实时流式视频异常理解(VAU)。其轻量级快检测模块基于Spatial Grid Folding(SGF)持续过滤异常,异常感知持久记忆(AAPM)保护关键视觉线索,重型慢推理模块仅在可疑事件触发时激活。在多个基准上,ReactVAU在严格流式约束下实现检测与因果推理的竞争性能,并通过减少重型MLLM调用显著提升计算效率。
HuggingFace Daily Papers(社区热门论文)
34
AI 编辑部评分,满分 100ReactVAU:面向流式视频异常理解的慢-快解耦框架
ReactVAU提出一种慢-快解耦框架,用于实时流式视频异常理解(VAU)。其轻量级快检测模块基于Spatial Grid Folding(SGF)持续过滤异常,异常感知持久记忆(AAPM)保护关键视觉线索,重型慢推理模块仅在可疑事件触发时激活。在多个基准上,ReactVAU在严格流式约束下实现检测与因果推理的竞争性能,并通过减少重型MLLM调用显著提升计算效率。
原文 · 保持原样,未翻译原文 · 未翻译
来源:HuggingFace Daily Papers(社区热门论文)· arxiv.org