mlsanityData to 14 Oct 2026

LLaDA-UI: Bringing Block-wise Diffusion to Vision-Language GUI Agents

arXiv 2609.13287 ↗First posted 9 Sep 2026cs.CV cs.AIcited by 0

On the map: LLM agents and tool use → GUI and mobile agents

Abstract (arXiv)

Diffusion large language models (dLLMs) achieve high decoding efficiency through block-parallel, arbitrary-order generation, making them attractive for latency-sensitive applications. GUI agents represent a natural testbed for this paradigm, as they must repeatedly perceive screen states and emit structured, spatially grounded actions in real time. However, whether dLLMs can be extended into capable multimodal GUI agents while preserving their parallel decoding advantage remains an open question. We present LLaDA-UI, a 16.7B-parameter MoE-based, block-wise diffusion vision-language GUI agent. LLaDA-UI follows a two-stage training pipeline: general multimodal pre-training aligns a native-resolution vision encoder with the LLaDA2.0-mini-base diffusion language backbone, followed by GUI-agent supervised fine-tuning on diverse mobile, desktop, web, and grounding data. Across widely adopted grounding benchmarks and navigation benchmarks spanning multiple platforms, LLaDA-UI substantially outperforms Qwen2.5-VL-7B and surpasses Qwen3-VL-8B on four of six reported GUI benchmarks. These results establish block-wise diffusion as a practical generative paradigm for multimodal GUI agents.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 44 of its 57 references that are in the map. First posted on arXiv 9 Sep 2026.

Builds on

44 of 57 references.

Closest ancestors · 12

Same direction, newest first

  1. 2026Towards GUI Agents: Vision-Language Diffusion Models for GUI Grounding27 Mar
  2. 2026UI-Venus-1.5 Technical Report9 Feb
  3. 2025MAI-UI Technical Report: Real-World Centric Foundation GUI Agents26 Dec
  4. 2025MobileWorld: Benchmarking Autonomous Mobile Agents in Agent-User Interactive and MCP-Augmented Environments22 Dec
  5. 2025Step-GUI Technical Report17 Dec
  6. 2025Mobile-Agent-v3: Fundamental Agents for GUI Automation21 Aug
  7. 2025UI-Venus Technical Report: Building High-performance UI Agents with RFT14 Aug
  8. 2025Scaling Computer-Use Grounding via User Interface Decomposition and Synthesis19 May
  9. 2025ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Use4 Apr
  10. 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agents21 Jan
  11. 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agents30 Oct
  12. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments11 Apr

Other references · 32

  1. 2025Qwen2.5-VL Technical Reportcited by 5,587
  2. 2024GPT-4o System Cardcited by 4,588
  3. 2025Qwen3-VL Technical Reportcited by 2,793
  4. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
  5. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  6. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
  7. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
  8. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
  9. 2016Modeling Context in Referring Expressionscited by 1,063
  10. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
  11. 2025Large Language Diffusion Modelscited by 912
  12. 2016A Diagram Is Worth A Dozen Imagescited by 804
20 more
  1. 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 586
  2. 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 583
  3. 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 526
  4. 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 512
  5. 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 476
  6. 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 468
  7. 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 438
  8. 2025Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Modelscited by 409
  9. 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?cited by 286
  10. 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 234
  11. 2023Teaching CLIP to Count to Tencited by 198
  12. 2025LLaDA2.0: Scaling Up Diffusion Language Models to 100Bcited by 166
  13. 2025LLaDA-V: Large Language Diffusion Models with Visual Instruction Tuningcited by 148
  14. 2024VL-RewardBench: A Challenging Benchmark for Vision-Language Generative Reward Modelscited by 86
  15. 2025SimpleVQA: Multimodal Factuality Evaluation for Multimodal Large Language Modelscited by 66
  16. 2025GUI-G2: Gaussian Reward Modeling for GUI Groundingcited by 63
  17. 2025Every Activation Boosted: Scaling General Reasoner to 1 Trillion Open Language Foundationcited by 34
  18. 2025VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoocited by 20
  19. 2025SDAR-VL: Stable and Efficient Block-wise Diffusion for Vision-Language Understandingcited by 13
  20. 2026LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Modelcited by 13

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025LaViDa: A Large Diffusion Language Model for Multimodal Understanding
  2. 2025VLN-MME: Diagnosing MLLMs as Language-guided Visual Navigation agents
  3. 2025Discrete Diffusion VLA: Bringing Discrete Diffusion to Action Decoding in Vision-Language-Action Policies
  4. 2026MMaDA-VLA: Large Diffusion Vision-Language-Action Model with Unified Multi-Modal Instruction and Generation
  5. 2025Rethinking Visual Information Processing in Multimodal LLMs
  6. 2025LLaDA-VLA: Vision Language Diffusion Action Models
  7. 2025DiffusionVL: Translating Any Autoregressive Models into Diffusion Vision Language Models
  8. 2025dVLA: Diffusion Vision-Language-Action Model with Multimodal Chain-of-Thought