mlsanityData to 7 Oct 2026

SCA: Spatial Credit Assignment for Reinforcement Learning of GUI Agents

arXiv 2609.36939 ↗First posted 29 Sep 2026cs.AIcited by 0

On the map: LLM agents and tool use → GUI and mobile agents

Abstract (arXiv)

GUI agents automate tasks on digital devices by grounding language instructions in visual interfaces. Existing group-relative reinforcement learning improves GUI action prediction by comparing the rewards of multiple responses sampled from the same GUI state. However, binary evaluation treats spatially different failed clicks as identical and provides no relative signal when all sampled clicks fail. To address these limitations, we propose Spatial Credit Assignment (SCA), which uses the screen coordinates of sampled clicks to refine group-relative credit. Specifically, SCA predicts each held-out response's reward from the other responses in groups containing both successes and failures, then uses the prediction residual to adjust credit. When all sampled clicks fail, SCA instead orders them by distance to the annotated target. These spatial references are used only to construct the training update; the deployed policy remains unchanged. We evaluate whether this correction improves the policy update itself by comparing its error and directional alignment with the exact return gradient in a controlled synthetic study. Across GUI grounding and offline action-prediction benchmarks, SCA improves grounding across professional domains and achieves the strongest results among reinforcement-fine-tuned models on most action-prediction metrics, with consistent gains across the reported GUI suites.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 29 of its 38 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

29 of 38 references.

Closest ancestors · 11

Same direction, newest first

  1. 2025Enhancing Visual Grounding for GUI Agents via Self-Evolutionary Reinforcement Learning18 May
  2. 2025GUI-R1 : A Generalist R1-Style Vision-Language Action Model For GUI Agents14 Apr
  3. 2025ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Use4 Apr
  4. 2025UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learning27 Mar
  5. 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agents30 Oct
  6. 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agents7 Oct
  7. 2024GUICourse: From General Vision Language Models to Versatile GUI Agents17 Jun
  8. 2024On the Effects of Data Scale on UI Control Agents6 Jun
  9. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments11 Apr
  10. 2024OmniACT: A Dataset and Benchmark for Enabling Multimodal Generalist Autonomous Agents for Desktop and Web27 Feb
  11. 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents17 Jan

Other references · 18

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
  4. 2025REINFORCE++: Stabilizing Critic-Free Policy Optimization with Global Advantage Normalizationcited by 233
  5. 2024ShowUI: One Vision-Language-Action Model for GUI Visual Agentcited by 226
  6. 2024GUIOdyssey: A Comprehensive Dataset for Cross-App GUI Navigation on Mobile Devicescited by 190
  7. 2016Q-Prop: Sample-Efficient Policy Gradient with An Off-Policy Criticcited by 77
  8. 2018Variance Reduction for Policy Gradient with Action-Dependent Factorized Baselinescited by 65
  9. 2025GUI-G2: Gaussian Reward Modeling for GUI Groundingcited by 60
  10. 2018The Mirage of Action-Dependent Baselines in Reinforcement Learningcited by 46
  11. 2026RSGround-R1: Rethinking Remote Sensing Visual Grounding through Spatial Reasoningcited by 8
  12. 2026PhGPO: Pheromone-Guided Policy Optimization for Long-Horizon Tool Planningcited by 6
6 more
  1. 2026Progress-conditioned Group Policy Optimization for Long-Horizon Agentic Taskscited by 6
  2. 2026Beyond Next-Observation Prediction: Agent-Authored World Modeling for Sequential Decision Makingcited by 5
  3. 2026Phase-Aware Mixture of Experts for Agentic Reinforcement Learningcited by 4
  4. 2026AgentBrew: Offline Tool-Use Agent Learning from Raw Real-World Trajectoriescited by 2
  5. 2026PlatformBid: An Auto-Bidding Benchmark from a Unified Advertising Platform's Perspectivecited by 1
  6. 2026Reinforcement Learning Enhanced LLM Agents for Complex Vehicle Routing Problemscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025CRAFT-GUI: Curriculum-Reinforced Agent For GUI Tasks
  2. 2025UI-S1: Advancing GUI Automation via Semi-online Reinforcement Learning
  3. 2026GUI-Eyes: Tool-Augmented Perception for Visual Grounding in GUI Agents
  4. 2025Test-Time Reinforcement Learning for GUI Grounding via Region Consistency
  5. 2026MagicGUI-RMS: A Multi-Agent Reward Model System for Self-Evolving GUI Agents via Automated Feedback Reflux
  6. 2026GUI Agents with Reinforcement Learning: Toward Digital Inhabitants
  7. 2025GUI-Bee: Align GUI Action Grounding to Novel Environments via Autonomous Exploration
  8. 2025UI-AGILE: Advancing GUI Agents with Effective Reinforcement Learning and Precise Inference-Time Grounding