mlsanityData to 7 Oct 2026

Overcoming Visual Clutter in Vision Language Action Models via Concept-Gated Visual Distillation

arXiv 2603.10340 ↗First posted 11 Mar 2026cs.CV cs.AI cs.ROcited by 2

On the map: Vision-language-action models → Failure recovery and robustness

Abstract (arXiv)

Vision-Language-Action (VLA) models demonstrate impressive zero-shot generalization but frequently suffer from a "Precision-Reasoning Gap" in cluttered environments. This failure is driven by background-induced feature dilution, where high-frequency semantic noise corrupts the geometric grounding required for precise manipulation. To bridge this gap, we propose Concept-Gated Visual Distillation (CGVD), a training-free, model-agnostic inference framework that stabilizes VLA policies. CGVD operates by parsing instructions into safe and distractor sets, utilizing a two-layer target refinement process--combining cross-validation and spatial disambiguation--to explicitly penalize false positives and isolate genuine manipulation targets. We then process the scene via Fourier-based inpainting, generating a clean observation that actively suppresses semantic distractors while preserving critical spatial geometry and visual proprioception. Extensive evaluations in highly cluttered manipulation tasks demonstrate that CGVD prevents performance collapse. In environments with dense semantic distractors, our method significantly outperforms state-of-the-art baselines, achieving a 77.5% success rate compared to the baseline's 43.0%. By enforcing strict attribute adherence, CGVD establishes inference-time visual distillation as a critical prerequisite for robust robotic manipulation in the clutter.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Failure recovery and robustness, one of 13 directions in Vision-language-action models. Builds on 30 of its 32 references that are in the map. First posted on arXiv 11 Mar 2026.

Builds on

30 of 32 references.

References · 30

  1. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  2. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  3. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  4. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  5. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  6. 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
  7. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  8. 2025SAM 3: Segment Anything with Conceptscited by 835
  9. 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 733
  10. 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
  11. 2021Do Vision Transformers See Like Convolutional Neural Networks?cited by 671
  12. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
18 more
  1. 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
  2. 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
  3. 2021Intriguing Properties of Vision Transformerscited by 446
  4. 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 391
  5. 2023ConceptFusion: Open-set Multimodal 3D Mappingcited by 302
  6. 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 206
  7. 2023Scaling Robot Learning with Semantically Imagined Experiencecited by 175
  8. 2024THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulationcited by 128
  9. 2021Coarse-to-Fine Q-attention: Efficient Learning for Visual Robotic Manipulation via Discretisationcited by 120
  10. 2023GenAug: Retargeting behaviors to unseen situations via Generative Augmentationcited by 103
  11. 2024Run-time Observation Interventions Make Vision-Language-Action Models More Visually Robustcited by 33
  12. 2025Eva-VLA: Evaluating Vision-Language-Action Models' Robustness Under Real-World Physical Variationscited by 24
  13. 2025Robotic Visual Instructioncited by 21
  14. 2025Rethinking Latent Redundancy in Behavior Cloning: An Information Bottleneck Approach for Robot Manipulationcited by 10
  15. 2025Clutter-Robust Vision-Language-Action Models through Object-Centric and Geometry Groundingcited by 10
  16. 2025Distracted Robot: How Visual Clutter Undermine Robotic Manipulationcited by 5
  17. 2026DTP: A Simple yet Effective Distracting Token Pruning Framework for Vision-Language Action Modelscited by 5
  18. 2025Improving Robotic Manipulation Robustness via NICE Scene Surgerycited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Look Before Acting: Enhancing Vision Foundation Representations for Vision-Language-Action Models
  2. 2026Grounded Semantic Re-Binding for Robust Instruction Generalization in Vision-Language-Action Models
  3. 2026HSC-VLA: Hierarchical Scene-Clearing for Robust Bimanual Manipulation in Dense Clutter ↗
  4. 2026CofactVLA: Deconfounding Vision-Language-Action Models via Counterfactual Intervention
  5. 2026V-Link: Recovering Lost Visual Representations in Action DiT for Vision-Language-Action Models
  6. 2026Restoring Linguistic Grounding in VLA Models via Train-Free Attention Recalibration
  7. 2026M2-VLA: Boosting Vision-Language Models for Generalizable Manipulation via Layer Mixture and Meta-Skills
  8. 2026AnchorVLA4D: an Anchor-Based Spatial-Temporal Vision-Language-Action Model for Robotic Manipulation