LLaDA-UI: Bringing Block-wise Diffusion to Vision-Language GUI Agents
On the map: LLM agents and tool use → GUI and mobile agents
Abstract (arXiv)
Diffusion large language models (dLLMs) achieve high decoding efficiency through block-parallel, arbitrary-order generation, making them attractive for latency-sensitive applications. GUI agents represent a natural testbed for this paradigm, as they must repeatedly perceive screen states and emit structured, spatially grounded actions in real time. However, whether dLLMs can be extended into capable multimodal GUI agents while preserving their parallel decoding advantage remains an open question. We present LLaDA-UI, a 16.7B-parameter MoE-based, block-wise diffusion vision-language GUI agent. LLaDA-UI follows a two-stage training pipeline: general multimodal pre-training aligns a native-resolution vision encoder with the LLaDA2.0-mini-base diffusion language backbone, followed by GUI-agent supervised fine-tuning on diverse mobile, desktop, web, and grounding data. Across widely adopted grounding benchmarks and navigation benchmarks spanning multiple platforms, LLaDA-UI substantially outperforms Qwen2.5-VL-7B and surpasses Qwen3-VL-8B on four of six reported GUI benchmarks. These results establish block-wise diffusion as a practical generative paradigm for multimodal GUI agents.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 44 of its 57 references that are in the map. First posted on arXiv 9 Sep 2026.
Builds on
44 of 57 references.
Closest ancestors · 12
Same direction, newest first
- 2026Towards GUI Agents: Vision-Language Diffusion Models for GUI Grounding27 Mar
- 2026UI-Venus-1.5 Technical Report9 Feb
- 2025MAI-UI Technical Report: Real-World Centric Foundation GUI Agents26 Dec
- 2025MobileWorld: Benchmarking Autonomous Mobile Agents in Agent-User Interactive and MCP-Augmented Environments22 Dec
- 2025Step-GUI Technical Report17 Dec
- 2025Mobile-Agent-v3: Fundamental Agents for GUI Automation21 Aug
- 2025UI-Venus Technical Report: Building High-performance UI Agents with RFT14 Aug
- 2025Scaling Computer-Use Grounding via User Interface Decomposition and Synthesis19 May
- 2025ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Use4 Apr
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agents21 Jan
- 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agents30 Oct
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments11 Apr
Other references · 32
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
- 2016Modeling Context in Referring Expressionscited by 1,063
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
- 2025Large Language Diffusion Modelscited by 912
- 2016A Diagram Is Worth A Dozen Imagescited by 804
20 more
- 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 586
- 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 583
- 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 526
- 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 512
- 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 476
- 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 468
- 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 438
- 2025Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Modelscited by 409
- 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?cited by 286
- 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 234
- 2023Teaching CLIP to Count to Tencited by 198
- 2025LLaDA2.0: Scaling Up Diffusion Language Models to 100Bcited by 166
- 2025LLaDA-V: Large Language Diffusion Models with Visual Instruction Tuningcited by 148
- 2024VL-RewardBench: A Challenging Benchmark for Vision-Language Generative Reward Modelscited by 86
- 2025SimpleVQA: Multimodal Factuality Evaluation for Multimodal Large Language Modelscited by 66
- 2025GUI-G2: Gaussian Reward Modeling for GUI Groundingcited by 63
- 2025Every Activation Boosted: Scaling General Reasoner to 1 Trillion Open Language Foundationcited by 34
- 2025VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoocited by 20
- 2025SDAR-VL: Stable and Efficient Block-wise Diffusion for Vision-Language Understandingcited by 13
- 2026LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Modelcited by 13
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025LaViDa: A Large Diffusion Language Model for Multimodal Understanding
- 2025VLN-MME: Diagnosing MLLMs as Language-guided Visual Navigation agents
- 2025Discrete Diffusion VLA: Bringing Discrete Diffusion to Action Decoding in Vision-Language-Action Policies
- 2026MMaDA-VLA: Large Diffusion Vision-Language-Action Model with Unified Multi-Modal Instruction and Generation
- 2025Rethinking Visual Information Processing in Multimodal LLMs
- 2025LLaDA-VLA: Vision Language Diffusion Action Models
- 2025DiffusionVL: Translating Any Autoregressive Models into Diffusion Vision Language Models
- 2025dVLA: Diffusion Vision-Language-Action Model with Multimodal Chain-of-Thought