Robust Bimanual Vision-Language-Action Models via Embarrassingly Simple Modality Masking
On the map: Vision-language-action models → Human-video and latent-action pretraining
Abstract (arXiv)
Query-based Vision-Language-Action (VLA) models offer low-latency inference that is attractive for bimanual robotic manipulation, but we observe that they can still exhibit discontinuous actions and execution failures in complex dual-arm tasks. We hypothesize that unstable multi-view and language fusion is one contributing factor in these failures, often coinciding with attention spreading to distracting regions. To improve robustness, we introduce the Modality Masking Mechanism (M3), an embarrassingly simple, training-only strategy that requires no architectural changes or large-scale robot pretraining. M3 stochastically masks subsets of modality channels during training, exposing the policy to controlled partial observations and encouraging it to rely less on distracting cues and more on evidence that remains reliable. We evaluate M3 on ten bimanual tasks from RoboTwin 2.0 and on three long-horizon real-world tasks. Compared with the Adapter baseline, M3 improves average success by 21.7% in the Clean setting and 11.4% in Clean2Rand, where policies are trained on clean demonstrations and evaluated on randomized scenes, while also improving averaged real-world full-task success by over 30%. These results suggest that structured training-time masking is a practical way to improve the robustness of query-based VLA policies for bimanual manipulation.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Human-video and latent-action pretraining, one of 13 directions in Vision-language-action models. Builds on 40 of its 47 references that are in the map. First posted on arXiv 23 Aug 2026.
Builds on
40 of 47 references.
References · 40
- 2017Attention Is All You Needcited by 60,361
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
28 more
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2016Deep Networks with Stochastic Depthcited by 979
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
- 2023LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attentioncited by 781
- 2024PaliGemma: A versatile 3B VLM for transfercited by 696
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
- 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 391
- 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 339
- 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 163
- 2025SimpleVLA-RL: Scaling VLA Training via Reinforcement Learningcited by 151
- 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Modelcited by 145
- 2024ALOHA Unleashed: A Simple Recipe for Robot Dexteritycited by 134
- 2025A Survey on Vision-Language-Action Models: An Action Tokenization Perspectivecited by 96
- 2022Partially Observable Markov Decision Processes in Robotics: A Surveycited by 86
- 2025ReconVLA: Reconstructive Vision-Language-Action Model as Effective Robot Perceivercited by 81
- 20243D-ViTac: Learning Fine-Grained Manipulation with Visuo-Tactile Sensingcited by 72
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Surveycited by 69
- 2025OTTER: A Vision-Language-Action Model with Text-Aware Visual Feature Extractioncited by 54
- 2022A System for Imitation Learning of Contact-Rich Bimanual Manipulation Policiescited by 26
- 2026Light-WAM: Efficient World Action Models with State-Fusion Action Decodingcited by 23
- 2025You Only Teach Once: Learn One-Shot Bimanual Robotic Manipulation from Video Demonstrationscited by 21
- 20253D FlowMatch Actor: Unified 3D Policy for Single- and Dual-Arm Manipulationcited by 20
- 2024ScrewMimic: Bimanual Imitation from Human Videos with Screw Space Projectioncited by 19
- 2026DTP: A Simple yet Effective Distracting Token Pruning Framework for Vision-Language Action Modelscited by 8
- 2025BiNoMaP: Learning Category-Level Bimanual Non-Prehensile Manipulation Primitivescited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025TwinVLA: Data-Efficient Bimanual Manipulation with Twin Single-Arm Vision-Language-Action Models
- 2026LangForce: Bayesian Decomposition of Vision Language Action Models via Latent Action Queries
- 2026Global Prior Meets Local Consistency: Dual-Memory Augmented Vision-Language-Action Model for Efficient Robotic Manipulation
- 2026When Does Language Matter? Multilingual Instructions Reveal Step-wise Language Sensitivity in Vision-Language-Action Models
- 2026Decoupling Vision, Language, and Action for Efficient Multi-Task Robot Policies
- 2026Restoring Linguistic Grounding in VLA Models via Train-Free Attention Recalibration
- 2026Sensing Which Modality Matters: Evidence-Gated Regularization for Robust VLA Policies
- 2026EmbodiedMidtrain: Bridging the Gap between Vision-Language Models and Vision-Language-Action Models via Mid-training