mlsanityData to 7 Oct 2026

Learning to Act under Visual Interruptions with Vision-Language-Action Models

arXiv 2609.35003 ↗First posted 28 Sep 2026cs.RO cs.AIcited by 0

On the map: Vision-language-action models → Failure recovery and robustness

Abstract (arXiv)

Vision-language-action (VLA) models have demonstrated strong capabilities in robotic manipulation, but they are typically developed and evaluated with all camera streams available throughout task execution. When a camera stops delivering frames during task execution, the policy must continue acting without access to subsequent observations from the missing view. Despite its practical importance, how such interruptions affect closed-loop manipulation remains insufficiently understood. To investigate this problem, we introduce MAIL-Bench, a benchmark that evaluates visual interruptions with VLA models. By interrupting different cameras at multiple stages of each policy's successful reference trajectory, MAIL-Bench measures how well policies retain their capabilities when visual inputs become unavailable. Building on this benchmark, we propose MINT, which first trains VLA policies to remain functional under missing visual inputs. At inference time, MINT selectively supplements missing observations using optical-flow extrapolation or an action-conditioned world model, and withdraws predicted views when they become unreliable. Experiments on π0.5 and GR00T N1.5 show that MINT significantly improves task success under camera loss over the original models. Experiments on AgiBot G2 further demonstrate the real-robot deployment under camera loss. The benchmark is available at https://minglejiang.github.io/Mail-Bench/

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Failure recovery and robustness, one of 13 directions in Vision-language-action models. Builds on 30 of its 39 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

30 of 39 references.

References · 30

  1. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  2. 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
  3. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  4. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  5. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  6. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  7. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  8. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  9. 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 669
  10. 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
  11. 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
  12. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
18 more
  1. 2023Multi-modal Learning with Missing Modality via Shared-Specific Feature Modellingcited by 159
  2. 2025Ctrl-World: A Controllable Generative World Model for Robot Manipulationcited by 149
  3. 2024THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulationcited by 128
  4. 2019Imitation Learning from Imperfect Demonstrationcited by 112
  5. 2026RoboCasa365: A Large-Scale Simulation Framework for Training and Benchmarking Generalist Robotscited by 65
  6. 2024VLATest: Testing and Evaluating Vision-Language-Action Models for Robotic Manipulationcited by 43
  7. 2026Do World Action Models Generalize Better than VLAs? A Robustness Studycited by 35
  8. 2025Affordance Field Intervention: Enabling VLAs to Escape Memory Traps in Robotic Manipulationcited by 12
  9. 2025Distilled Prompt Learning for Incomplete Multimodal Survival Predictioncited by 10
  10. 2025RoboPanoptes: The All-seeing Robot with Whole-body Dexteritycited by 9
  11. 2026Persistent Robot World Models: Stabilizing Multi-Step Rollouts via Reinforcement Learningcited by 9
  12. 2026See What Matters: Differentiable Grid Sample Pruning for Generalizable Vision-Language-Action Modelcited by 5
  13. 2023Unlabeled Imperfect Demonstrations in Adversarial Imitation Learningcited by 3
  14. 2026RA-SOD: Reliability-Aware RGB-T Salient Object Detection under Modality Degradationcited by 2
  15. 2026When Sensors Fail: Temporal Sequence Models for Robust PPO under Sensor Driftcited by 1
  16. 2026MUST: Modality-Specific Representation-Aware Transformer for Diffusion-Enhanced Survival Prediction with Missing Modalitycited by 1
  17. 2026Reinforcement Learning-Guided Retrieval with Soft Fusion for Robust Multimodal Imitation Learning under Missing Modalitiescited by 1
  18. 2026StellaVLA: In-Context Structured Demonstration for Generalizable Vision-Language-Action Modelscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026ReViP: Mitigating False Completion in Vision-Language-Action Models with Vision-Proprioception Rebalance
  2. 2026Restoring Linguistic Grounding in VLA Models via Train-Free Attention Recalibration
  3. 2026Imagining Recovery: Inference-Time Counterfactual Realignment for Vision-Language-Action Models
  4. 2026Benchmarking Vision-Language-Action Models on SO-101: Failure and Recovery Analysis
  5. 2026VLA-Corrector: Stage-Aware Observable State Understanding for Prompt-Based Closed-Loop Recovery of Vision-Language-Action Policies
  6. 2026Drop-Then-Recovery: How Redundant Are Vision-Language-Action Models?
  7. 2026MIKASA-Robo-VLA: Benchmarking Memory in VLA Models for Long-Horizon Manipulation
  8. 2026ActFovea: Runtime Safeguarding for VLA Policies via Spatiotemporal Visual-Action Consistency