Overcoming Visual Clutter in Vision Language Action Models via Concept-Gated Visual Distillation
On the map: Vision-language-action models → Failure recovery and robustness
Abstract (arXiv)
Vision-Language-Action (VLA) models demonstrate impressive zero-shot generalization but frequently suffer from a "Precision-Reasoning Gap" in cluttered environments. This failure is driven by background-induced feature dilution, where high-frequency semantic noise corrupts the geometric grounding required for precise manipulation. To bridge this gap, we propose Concept-Gated Visual Distillation (CGVD), a training-free, model-agnostic inference framework that stabilizes VLA policies. CGVD operates by parsing instructions into safe and distractor sets, utilizing a two-layer target refinement process--combining cross-validation and spatial disambiguation--to explicitly penalize false positives and isolate genuine manipulation targets. We then process the scene via Fourier-based inpainting, generating a clean observation that actively suppresses semantic distractors while preserving critical spatial geometry and visual proprioception. Extensive evaluations in highly cluttered manipulation tasks demonstrate that CGVD prevents performance collapse. In environments with dense semantic distractors, our method significantly outperforms state-of-the-art baselines, achieving a 77.5% success rate compared to the baseline's 43.0%. By enforcing strict attribute adherence, CGVD establishes inference-time visual distillation as a critical prerequisite for robust robotic manipulation in the clutter.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Failure recovery and robustness, one of 13 directions in Vision-language-action models. Builds on 30 of its 32 references that are in the map. First posted on arXiv 11 Mar 2026.
Builds on
30 of 32 references.
References · 30
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2025SAM 3: Segment Anything with Conceptscited by 835
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 733
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
- 2021Do Vision Transformers See Like Convolutional Neural Networks?cited by 671
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
18 more
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
- 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
- 2021Intriguing Properties of Vision Transformerscited by 446
- 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 391
- 2023ConceptFusion: Open-set Multimodal 3D Mappingcited by 302
- 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 206
- 2023Scaling Robot Learning with Semantically Imagined Experiencecited by 175
- 2024THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulationcited by 128
- 2021Coarse-to-Fine Q-attention: Efficient Learning for Visual Robotic Manipulation via Discretisationcited by 120
- 2023GenAug: Retargeting behaviors to unseen situations via Generative Augmentationcited by 103
- 2024Run-time Observation Interventions Make Vision-Language-Action Models More Visually Robustcited by 33
- 2025Eva-VLA: Evaluating Vision-Language-Action Models' Robustness Under Real-World Physical Variationscited by 24
- 2025Robotic Visual Instructioncited by 21
- 2025Rethinking Latent Redundancy in Behavior Cloning: An Information Bottleneck Approach for Robot Manipulationcited by 10
- 2025Clutter-Robust Vision-Language-Action Models through Object-Centric and Geometry Groundingcited by 10
- 2025Distracted Robot: How Visual Clutter Undermine Robotic Manipulationcited by 5
- 2026DTP: A Simple yet Effective Distracting Token Pruning Framework for Vision-Language Action Modelscited by 5
- 2025Improving Robotic Manipulation Robustness via NICE Scene Surgerycited by 3
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Look Before Acting: Enhancing Vision Foundation Representations for Vision-Language-Action Models
- 2026Grounded Semantic Re-Binding for Robust Instruction Generalization in Vision-Language-Action Models
- 2026HSC-VLA: Hierarchical Scene-Clearing for Robust Bimanual Manipulation in Dense Clutter ↗
- 2026CofactVLA: Deconfounding Vision-Language-Action Models via Counterfactual Intervention
- 2026V-Link: Recovering Lost Visual Representations in Action DiT for Vision-Language-Action Models
- 2026Restoring Linguistic Grounding in VLA Models via Train-Free Attention Recalibration
- 2026M2-VLA: Boosting Vision-Language Models for Generalizable Manipulation via Layer Mixture and Meta-Skills
- 2026AnchorVLA4D: an Anchor-Based Spatial-Temporal Vision-Language-Action Model for Robotic Manipulation