mlsanityData to 7 Oct 2026

Reuse Before You Retrieve: Diagnosing Headroom and Complementarity for Test-Time Augmentation of Embodied Multimodal Policies

arXiv 2608.17484 ↗First posted 18 Aug 2026cs.ROcited by 0

On the map: Vision-language-action models → Failure recovery and robustness

Abstract (arXiv)

Frozen vision-language-action (VLA) policies are increasingly improved at test time by sampling additional policy behaviors or introducing external demonstrations. Yet there is little guidance for deciding which intervention a deployed policy actually needs. Additional sampling is useful only when better behavior already exists within the policy's stochastic rollouts and can be identified, whereas retrieval is most useful when the relevant action prior is not reliably represented by the policy. We study this decision through two measurable factors, recoverable headroom and retrieval complementarity, which characterize how much useful behavior is already available to recover and whether an external action prior fills a measurable gap. We evaluate an episode-level retry selector under retryable or parallel execution, together with retrieval across multiple frozen VLA policies and environments. The selector consistently recovers substantial latent capability across all tested VLA backbones on LIBERO, with gains of up to 21.0 success-rate points that closely track recoverable headroom. It also transfers to a different robot and simulator and remains effective under degraded observations, while experiments with autoregressive OpenVLA illustrate the distinction between available headroom and the ability to rank candidate rollouts. Retrieval behaves differently, improving the policy with the largest measured action-prior gap and providing further gains when combined with selection. Together, these results provide an empirical basis for characterizing test-time augmentation opportunities by separating capability that can be recovered from the frozen policy from behavioral priors that may need to be introduced externally.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Failure recovery and robustness, one of 13 directions in Vision-language-action models. Builds on 23 of its 23 references that are in the map. First posted on arXiv 18 Aug 2026.

Builds on

23 of 23 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026LIBERO-Occ: Evaluating and Improving Vision-Language-Action Models under Scene-Induced Occlusion via Viewpoint Imagination9 Jun
  2. 2025RoVer: Robot Reward Model as Test-Time Verifier for Vision-Language-Action Model13 Oct

Other references · 21

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  2. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  3. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  4. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  5. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
  6. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  7. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  8. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
  9. 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
  10. 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
  11. 2021The Surprising Effectiveness of Representation Learning for Visual Imitationcited by 149
  12. 2023Behavior Retrieval: Few-Shot Imitation Learning by Querying Unlabeled Datasetscited by 56
9 more
  1. 2025RoboMonkey: Scaling Test-Time Sampling and Verification for Vision-Language-Action Modelscited by 56
  2. 2024STRAP: Robot Sub-Trajectory Retrieval for Augmented Policy Learningcited by 42
  3. 2024FlowRetrieval: Flow-Guided Data Retrieval for Few-Shot Imitation Learningcited by 32
  4. 2025MAP-VLA: Memory-Augmented Prompting for Vision-Language-Action Model in Robotic Manipulationcited by 28
  5. 2025Verifier-free Test-Time Sampling for Vision-Language-Action Modelscited by 21
  6. 2026VLA-ATTC: Adaptive Test-Time Compute for VLA Models with Relative Action Critic Modelcited by 9
  7. 2025COLLAGE: Adaptive Fusion-based Retrieval for Augmented Policy Learningcited by 5
  8. 2026TapSampling: Inference-Time Sampling with a Task-Progress-Understanding Verifier for Robotic Manipulationcited by 4
  9. 2026Retrieve, Don't Retrain: Extending Vision Language Action Models to New Tasks at Test Timecited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Reflective VLA: In-Context Action Consequences Make VLAs Generalize
  2. 2026Imagining Recovery: Inference-Time Counterfactual Realignment for Vision-Language-Action Models
  3. 2026Look Before You Leap: Distilling Tree Search into Action Evaluation for Frozen VLA Models
  4. 2026When Instructions Retrieve Trajectories: Diagnosing and Mitigating Generalization Failures in VLA Models
  5. 2026Training-Free Action Correction for VLA Model Failures via Language Feedback
  6. 2026FATE-VLA:Failue-aware test generation for vision-language-action models
  7. 2026Retrieve-then-Steer: Online Success Memory for Test-Time Adaptation of Generative VLAs
  8. 2026Scaling Verification Can Be More Effective than Scaling Policy Learning for Vision-Language-Action Alignment