LLaDA-UI:把块级扩散引入视觉语言 GUI 智能体

HuggingFace Daily Papers(社区热门论文)·2026-09-09 08:00·6天前
AI 导读

LLaDA-UI 是一个 16.7B 参数的 MoE 块级扩散视觉语言 GUI 智能体,通过通用多模态预训练对齐原生分辨率视觉编码器与 LLaDA2.0-mini-base 扩散语言骨干,再进行 GUI 智能体监督微调。在多个平台的 grounding 与导航基准上,它大幅超越 Qwen2.5-VL-7B,并在六项 GUI 基准中的四项上超过 Qwen3-VL-8B。

HuggingFace Daily Papers(社区热门论文)
49AI 编辑部评分,满分 100

LLaDA-UI:把块级扩散引入视觉语言 GUI 智能体

2026-09-09 08:00· 6天前
AI 导读

LLaDA-UI 是一个 16.7B 参数的 MoE 块级扩散视觉语言 GUI 智能体,通过通用多模态预训练对齐原生分辨率视觉编码器与 LLaDA2.0-mini-base 扩散语言骨干,再进行 GUI 智能体监督微调。在多个平台的 grounding 与导航基准上,它大幅超越 Qwen2.5-VL-7B,并在六项 GUI 基准中的四项上超过 Qwen3-VL-8B。

Diffusion large language models (dLLMs) achieve high decoding efficiency through block-parallel, arbitrary-order generation, making them attractive for latency-sensitive applications. GUI agents represent a natural testbed for this paradigm, as they must repeatedly perceive screen states and emit structured, spatially grounded actions in real time. However, whether dLLMs can be extended into capable multimodal GUI agents while preserving their parallel decoding advantage remains an open question. We present LLaDA-UI, a 16.7B-parameter MoE-based, block-wise diffusion vision-language GUI agent.

LLaDA-UI follows a two-stage training pipeline: general multimodal pre-training aligns a native-resolution vision encoder with the LLaDA2.0-mini-base diffusion language backbone, followed by GUI-agent supervised fine-tuning on diverse mobile, desktop, web, and grounding data. Across widely adopted grounding benchmarks and navigation benchmarks spanning multiple platforms, LLaDA-UI substantially outperforms Qwen2.5-VL-7B and surpasses Qwen3-VL-8B on four of six reported GUI benchmarks. These results establish block-wise diffusion as a practical generative paradigm for multimodal GUI agents.

来源:HuggingFace Daily Papers(社区热门论文)· arxiv.org