RefineEdit:基于生成式细化网络的无训练 Prompt-to-Prompt 图像编辑

HuggingFace Daily Papers(社区热门论文)·2026-09-17 08:00·4天前
AI 导读

RefineEdit 是一个无需训练的 Prompt-to-Prompt 图像编辑框架,基于生成式细化网络,通过对二值图像码的全局细化将编辑定位与内容生成耦合。在 PIE-Bench 九类编辑任务上,它取得最优的 PSNR、LPIPS、MSE、SSIM 背景保持分数以及最高的整图与编辑区域 CLIP 分数。

HuggingFace Daily Papers(社区热门论文)
32AI 编辑部评分,满分 100

RefineEdit:基于生成式细化网络的无训练 Prompt-to-Prompt 图像编辑

2026-09-17 08:00· 4天前
AI 导读

RefineEdit 是一个无需训练的 Prompt-to-Prompt 图像编辑框架,基于生成式细化网络,通过对二值图像码的全局细化将编辑定位与内容生成耦合。在 PIE-Bench 九类编辑任务上,它取得最优的 PSNR、LPIPS、MSE、SSIM 背景保持分数以及最高的整图与编辑区域 CLIP 分数。

Text-guided image editing must introduce the requested changes while preserving unrelated source content. Diffusion-based editors rely on spatial controls whose inaccuracies can leave edits incomplete or alter unrelated regions. Causal autoregressive editors face a further constraint: their fixed decoding order limits revision of earlier decisions. We introduce RefineEdit, a training-free prompt-to-prompt image editing framework built on a Generative Refinement Network. Our key idea is to couple edit localization with content generation through the global refinement of binary image codes, allowing editing evidence to be reassessed as the image evolves.

RefineEdit initializes an editing branch from an intermediate source state, reusing the emerging layout. We compare the probabilities assigned by the two branches to the same source-sampled bits, using their signed differences to select editable positions and bits. Selected bits follow editing refinement, while the remaining bits copy the evolving source state. To stabilize editing across refinement steps, adaptive spatial freezing limits unnecessary mask expansion, while finite bit locking keeps recently selected bits editable. The framework requires no additional training, external masks, or attention control.

Across nine editing categories of PIE-Bench, RefineEdit achieves the best background-preservation scores in PSNR, LPIPS, MSE and SSIM, together with the highest whole-image and edited-region CLIP scores among the evaluated methods.

来源:HuggingFace Daily Papers(社区热门论文)· arxiv.org