WanPE:面向现代文生视频的电影级提示词增强

HuggingFace Daily Papers(社区热门论文)·2026-09-24 08:00·1天前
AI 导读

WanPE 是一个 397B 参数的提示词增强模型,基于 1.05M 真实视频训练,通过镜头级电影化规划与 SC-GRPO 保持跨镜头语义一致。驱动 Wan3.0 时,它将 5-15 秒人类偏好提升 10.66-18.84 分,30 秒场景提升 50.86 分。团队还构建了覆盖 5 至 30 秒、约 11K 盲测对比的 WanPEval 基准。

HuggingFace Daily Papers(社区热门论文)
41AI 编辑部评分,满分 100

WanPE:面向现代文生视频的电影级提示词增强

2026-09-24 08:00· 1天前
AI 导读

WanPE 是一个 397B 参数的提示词增强模型,基于 1.05M 真实视频训练,通过镜头级电影化规划与 SC-GRPO 保持跨镜头语义一致。驱动 Wan3.0 时,它将 5-15 秒人类偏好提升 10.66-18.84 分,30 秒场景提升 50.86 分。团队还构建了覆盖 5 至 30 秒、约 11K 盲测对比的 WanPEval 基准。

Video generation begins in text space by authoring a cinematic screenplay, then materializes into pixels. As contemporary video generators scale to 30 seconds and faithfully follow complex conditions, the textual prompt largely directs the production, planning how actions, camera trajectories, lighting, and sound unfold across multi-shot sequences. In this paper, we present WanPE, a 397B-parameter prompt enhancement model trained on 1.05M real-world videos to master director-level cinematic planning. WanPE formulates shot-level cinematic plans via video-grounded reverse construction and employs Semantic-Consistency GRPO (SC-GRPO) to faithfully preserve user requirements across shots and over time.

To benchmark this capability, we curate WanPEval, a human-annotated testbed covering durations from 5 to 30 seconds across varying intent granularities, supported by approximately 11K blind pairwise assessments. When powering Wan3.0's video generator, WanPE-397B boosts human preference over raw user prompts by 10.66-18.84 points at 5-15 seconds and by a dramatic 50.86 points in the 30-second arena. Ablation studies show that reverse construction demonstrates clear superiority over forward rewriting, while SC-GRPO robustly preserves semantic fidelity across model scales.

Ultimately, WanPE leads all evaluated commercial offerings at 5-15 seconds and remains competitive with Seedance 2.5 at 30 seconds.

来源:HuggingFace Daily Papers(社区热门论文)· arxiv.org