mlsanityData to 14 Oct 2026

Task-Adaptive Rubrics for GUI Reward Modeling

arXiv 2608.24174 ↗First posted 25 Aug 2026cs.AIcited by 1

On the map: LLM reasoning → Reinforcement learning for reasoning

also in 2 more
Abstract (arXiv)

Recent studies on GUI agents have increasingly focused on outcome reward modeling, which assigns outcome rewards by judging whether an executed trajectory satisfies the success criteria implied by the user instruction. Existing GUI reward verifiers, however, often under-specify how these criteria should be constructed for each task instance. Whether using generic rubric structures or implicit model reasoning, their judging criteria are not sufficiently task-adaptive: they can transfer checks across tasks, overlook concrete constraints in the current instruction, or become overly strict by enforcing unstated requirements. To address this limitation, we propose AdaptRubric, a Coarse-to-Fine Rubrics Framework that constructs task-adaptive judging criteria through a category-level coarse stage and an instance-level fine stage. AdaptRubric performs category-level coarse rubric retrieval by routing the instruction to a GUI task family and retrieving reusable task-family criteria, then conducts instance-level fine rubric generation to surface compact cues for concrete values, scopes, and constraints in the current instruction. Across offline reward evaluation and online reinforcement learning optimization, AdaptRubric consistently outperforms prior reward agents, improving F1 by 3.6 points over the baseline average under a matched image budget and yielding a 4.23-point task-success gain.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reinforcement learning for reasoning, one of 17 directions in LLM reasoning. Builds on 25 of its 52 references that are in the map. First posted on arXiv 25 Aug 2026.

Builds on

25 of 52 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025ProRe: A Proactive Reward System for GUI Agents via Reasoner-Actor Collaboration26 Sep

Other references · 24

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
  3. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
  4. 2023CogAgent: A Visual Language Model for GUI Agentscited by 704
  5. 2025Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domainscited by 366
  6. 2024WebRL: Training LLM Web Agents via Self-Evolving Online Curriculum Reinforcement Learningcited by 256
  7. 2024Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scalecited by 223
  8. 2024DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learningcited by 214
  9. 2024On the Effects of Data Scale on UI Control Agentscited by 194
  10. 2025InfiGUI-R1: Advancing Multimodal GUI Agents from Reactive Actors to Deliberative Reasonerscited by 140
  11. 2024Autonomous Evaluation and Refinement of Digital Agentscited by 137
  12. 2025MAI-UI Technical Report: Real-World Centric Foundation GUI Agentscited by 91
12 more
  1. 2026Mobile-Agent-v3.5: Multi-platform Fundamental GUI Agentscited by 79
  2. 2025MobileWorld: Benchmarking Autonomous Mobile Agents in Agent-User Interactive and MCP-Augmented Environmentscited by 72
  3. 2024DistRL: An Asynchronous Distributed Reinforcement Learning Framework for On-Device Control Agentscited by 68
  4. 2025InfiGUIAgent: A Multimodal Generalist GUI Agent with Native Reasoning and Reflectioncited by 67
  5. 2018Learning to Navigate the Webcited by 60
  6. 2025ZeroGUI: Automating Online GUI Learning at Zero Human Costcited by 44
  7. 2025AgentRM: Enhancing Agent Generalization with Reward Modelingcited by 27
  8. 2024CARMO: Dynamic Criteria Generation for Context-Aware Reward Modellingcited by 22
  9. 2026ClawGUI: A Unified Framework for Training, Evaluating, and Deploying GUI Agentscited by 14
  10. 2025STEP: Success-Rate-Aware Trajectory-Efficient Policy Optimizationcited by 12
  11. 2026Adaptive Milestone Reward for GUI Agentscited by 12
  12. 2026OS-Themis: A Scalable Critic Framework for Generalist GUI Rewardscited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026MagicGUI-RMS: A Multi-Agent Reward Model System for Self-Evolving GUI Agents via Automated Feedback Reflux
  2. 2026Adaptive-Group Process Rewards for GUI Agents
  3. 2025OpenRubrics: Towards Scalable Synthetic Rubric Generation for Reward Modeling and LLM Alignment
  4. 2025CRAFT-GUI: Curriculum-Reinforced Agent For GUI Tasks
  5. 2026AdaRubric: Task-Adaptive Rubrics for Reliable LLM Agent Evaluation and Reward Learning
  6. 2026GUI Agents with Reinforcement Learning: Toward Digital Inhabitants
  7. 2026Open Rubric System: Scaling Reinforcement Learning with Pairwise Adaptive Rubric
  8. 2025Orcust: Stepwise-Feedback Reinforcement Learning for GUI Agent