ActFovea: Runtime Safeguarding for VLA Policies via Spatiotemporal Visual-Action Consistency
On the map: Vision-language-action models → Failure recovery and robustness
Abstract (arXiv)
Vision-language-action (VLA) policies achieve strong performance in robotic manipulation but remain vulnerable to runtime disturbances that break the temporal alignment among visual observations, robot states, and executed actions. We introduce ActFovea, a plug-and-play safeguarding framework that detects and mitigates such failures without retraining or modifying the underlying VLA policy. ActFovea uses robot kinematics, proprioceptive states, and recent actions to construct action-conditioned foveated regions that retain contact-relevant areas and predicted motion corridors while suppressing task-irrelevant visual content. It detects runtime risks by evaluating whether visual motion and observation freshness remain consistent with geometric, proprioceptive, and action transitions. For recoverable disturbances, ActFovea constructs disturbance-specific candidate observations and accepts a recovery only after verifying the resulting action chunk. When stale or replayed observations make reliable recovery impossible, it invokes a bounded safe-failure procedure. In closed-loop evaluations of π0 across multiple LIBERO suites, ActFovea increases success under localized visual overlays from 49.3% to 90.3%, closing 93.7% of the gap to clean performance. It further improves success under action drift and visual delay by 7.0 and 9.8 percentage points, respectively, while preserving clean-task performance. Under frozen-observation replay, ActFovea triggers timely safe failure in all trials, with no unprotected failures. These results demonstrate that spatiotemporal visual-action consistency provides an effective basis for runtime safeguarding of VLA policies.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Failure recovery and robustness, one of 13 directions in Vision-language-action models. Builds on 8 of its 10 references that are in the map. First posted on arXiv 31 Jul 2026.
Builds on
8 of 10 references.
References · 8
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2025SafeVLA: Towards Safety Alignment of Vision-Language-Action Model via Constrained Learningcited by 72
- 2025BadVLA: Towards Backdoor Attacks on Vision-Language-Action Models via Objective-Decoupled Optimizationcited by 38
- 2025VLSA: Vision-Language-Action Models with Plug-and-Play Safety Constraint Layercited by 34
- 2024Run-time Observation Interventions Make Vision-Language-Action Models More Visually Robustcited by 33
- 2025Eva-VLA: Evaluating Vision-Language-Action Models' Robustness Under Real-World Physical Variationscited by 24
- 2025Phantom Menace: Exploring and Enhancing the Robustness of VLA Models Against Physical Sensor Attackscited by 9
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026ActionGround: Training-Free Runtime Refinement of Frozen VLA Policies
- 2026VLA-Corrector: Stage-Aware Observable State Understanding for Prompt-Based Closed-Loop Recovery of Vision-Language-Action Policies
- 2026VeriSpace: Spatially Grounded Action Verification for Vision-Language-Action Models
- 2026SafeVLA-Bench: A Benchmark for the Success-Safety Gap in Vision-Language-Action Models
- 2026Learning to Act under Visual Interruptions with Vision-Language-Action Models
- 2026Benchmarking Vision-Language-Action Models on SO-101: Failure and Recovery Analysis
- 2026Learning from Runtime Feedback through Failure-Bank Self-Evolution for Vision-Language-Action Models
- 2026ProbeAct: Probe-Guided Training-Free Failure Recovery in Vision-Language-Action Models