mlsanityData to 7 Oct 2026

One Rollout Is All You Get: Fully Test-Time Adaptation for GUI Agents

arXiv 2609.34321 ↗First posted 28 Sep 2026cs.LGcited by 0

On the map: LLM agents and tool use → GUI and mobile agents

Abstract (arXiv)

GUI agents are deployed with frozen weights and discard everything they experience on the job. Existing ways to update an agent's weights assume something deployment withholds: ground truth, rollouts beyond the single attempt (retries, samples, practice runs), or a learning phase other than deployment. Because GUI actions can be irreversible, a deployed agent gets one attempt per task occurrence, in arrival order, and every attempt counts. No ground truth is available at any point. We define fully test-time adaptation for GUI agents by these constraints and pair it with a minimal weight-space method, SOLO. Auxiliary models read each episode: a judge selects the episodes it deems successful, and a proposer-verifier pair relabels a failed episode's prefix with the subtask that prefix completed. Admitted episodes enter a short sliding window, and each admission updates a small adapter by top-K self-distillation on the agent's own predictions, provided the window holds a judged success. On recurring task streams built from WebArena, VisualWebArena and MobileWorld, SOLO improves on the frozen agent with both UI-TARS-7B and Qwen3-VL-8B, by three to six points of success rate, and exceeds two in-setting memory methods on the web streams.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 47 of its 115 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

47 of 115 references.

Closest ancestors · 16

Same direction, newest first

  1. 2026SE-GA: Memory-Augmented Self-Evolution for GUI Agents16 May
  2. 2026UI-Voyager: A Self-Evolving GUI Agent Learning via Failed Experience25 Mar
  3. 2026Generalization in Online Reinforcement Learning for Mobile Agents8 Mar
  4. 2026Darwinian Memory: A Training-Free Self-Regulating Memory System for GUI Agent Evolution30 Jan
  5. 2026MAGNET: Towards Adaptive GUI Agents with Memory-Driven Knowledge Evolution27 Jan
  6. 2026MagicGUI-RMS: A Multi-Agent Reward Model System for Self-Evolving GUI Agents via Automated Feedback Reflux19 Jan
  7. 2025EchoTrail-GUI: Building Actionable Memory for GUI Agents via Critic-Guided Self-Exploration22 Dec
  8. 2025ScaleCUA: Scaling Open-Source Computer Use Agents with Cross-Platform Data18 Sep
  9. 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learning2 Sep
  10. 2025UI-Genie: A Self-Improving Approach for Iteratively Boosting MLLM-based Mobile GUI Agents27 May
  11. 2025GUI-Shift: Enhancing VLM-Based GUI Agents through Self-supervised Reinforcement Learning18 May
  12. 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agents21 Jan
4 more
  1. 2025Mobile-Agent-E: Self-Evolving Mobile Assistant for Complex Tasks20 Jan
  2. 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agents30 Oct
  3. 2024DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learning14 Jun
  4. 2023AppAgent: Multimodal Agents as Smartphone Users21 Dec

Other references · 31

  1. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  2. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
  3. 2017Hindsight Experience Replaycited by 1,096
  4. 2022STaR: Bootstrapping Reasoning With Reasoningcited by 895
  5. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
  6. 2022Continual Test-Time Domain Adaptationcited by 520
  7. 2019Neural Text Generation with Unlikelihood Trainingcited by 489
  8. 2022Efficient Test-Time Model Adaptation without Forgettingcited by 467
  9. 2023Scaling Relationship on Learning Mathematical Reasoning with Large Language Modelscited by 417
  10. 2023A Comprehensive Survey on Test-Time Adaptation under Distribution Shiftscited by 353
  11. 2024Agent Workflow Memorycited by 342
  12. 2023Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Modelscited by 325
19 more
  1. 2024KTO: Model Alignment as Prospect Theoretic Optimizationcited by 256
  2. 2025TTRL: Test-Time Reinforcement Learningcited by 253
  3. 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memorycited by 253
  4. 2024WebRL: Training LLM Web Agents via Self-Evolving Online Curriculum Reinforcement Learningcited by 243
  5. 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 155
  6. 2024Autonomous Evaluation and Refinement of Digital Agentscited by 136
  7. 2018Self-Imitation Learningcited by 135
  8. 2025GTA1: GUI Test-time Scaling Agentcited by 102
  9. 2024The Surprising Effectiveness of Test-Time Training for Few-Shot Learningcited by 88
  10. 2025Agent Learning via Early Experiencecited by 79
  11. 2025AgentEvolver: Towards Efficient Self-Evolving Agent Systemcited by 77
  12. 2023The Wisdom of Hindsight Makes Language Models Better Instruction Followerscited by 59
  13. 2025Scaling Agent Learning via Experience Synthesiscited by 40
  14. 2025EvoTest: Evolutionary Test-Time Learning for Self-Improving Agentic Systemscited by 34
  15. 2025Test-Time Adaptation for LLM Agents via Environment Interactioncited by 17
  16. 2026Just-In-Time Reinforcement Learning: Continual Learning in LLM Agents Without Gradient Updatescited by 17
  17. 2026AgentHER: Hindsight Experience Replay for LLM Agent Trajectory Relabelingcited by 13
  18. 2026Position: Modular Memory is the Key to Continual Learning Agentscited by 7
  19. 2026Contextual Agentic Memory is a Memo, Not True Memorycited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Reflect, Revise, Reuse: Training-Free Skill Evolution for GUI Agents
  2. 2026No Time Like the Present: Agentic Test-Time Training for LLM Agents
  3. 2026SEAGym: An Evaluation Environment for Self-Evolving LLM Agents
  4. 2026TTHE: Test-Time Harness Evolution
  5. 2026Not All Experience Belongs in the Weights: Component Routing for Self-Improving GUI Agents
  6. 2026GUI-GENESIS: Automated Synthesis of Efficient Environments with Verifiable Rewards for GUI Agent Post-Training
  7. 2026SWE-Replay: Efficient Test-Time Scaling for Software Engineering Agents
  8. 2026Learning Reliable GUI Agents under Imperfect Priors