RULER:面向 SVG 生成的实例感知评分标准奖励

HuggingFace Daily Papers(社区热门论文)·2026-09-21 08:00·2天前
AI 导读

RULER 用实例感知评分标准为 SVG 生成提供强化学习奖励,无需配对 SVG 真值或人工偏好标注。它把每条指令转成覆盖语义、视觉、风格三个维度的六项评分标准,由 judge VLM 对渲染结果逐项打分,加权满意度经 GRPO 优化。

HuggingFace Daily Papers(社区热门论文)
45AI 编辑部评分,满分 100

RULER:面向 SVG 生成的实例感知评分标准奖励

2026-09-21 08:00· 2天前
AI 导读

RULER 用实例感知评分标准为 SVG 生成提供强化学习奖励,无需配对 SVG 真值或人工偏好标注。它把每条指令转成覆盖语义、视觉、风格三个维度的六项评分标准,由 judge VLM 对渲染结果逐项打分,加权满意度经 GRPO 优化。

Generating Scalable Vector Graphics (SVG) code from natural-language instructions is an open-ended task without absolute visual ground truth, leaving both evaluation and policy optimization without a faithful signal. Scalar metrics (CLIP, Aesthetic) calibrated on natural images transfer poorly to stylized vector content, and reusing them as RL rewards triggers reward hacking. We address both limitations with rubric-based scoring. We first establish empirically that prompting a vision-language judge with a multi-axis rubric correlates with human judgments far better than scalar metrics, both across samples and within instructions. Building on this finding, we introduce RULER (Instance-aware Rubric Rewards for Reinforcement Learning), which converts each instruction into an instance-aware rubric of six items spanning semantic, visual, and stylistic axes; a judge VLM scores rendered rollouts item-by-item, and the weighted satisfactions form a fine-grained reward optimized via Group Relative Policy Optimization. Because the rubric is derived from text alone, RULER requires neither paired SVG ground truth nor human preference labels. On MMSVG-Illustration and MMSVG-Icon, RULER lifts the rubric score from 0.432/0.395 to 0.693/0.683, surpassing dedicated SVG specialists and matching the substantially larger DeepSeek-V3, with ablations identifying rubric design as the active lever for RL on open-ended SVG generation. The project page is available at https://hangyuran.github.io/RULER/.

来源:HuggingFace Daily Papers(社区热门论文)· arxiv.org