CoFreeVLA: Short-Horizon Collision-Free Dual-Arm Manipulation via Vision-Language-Action Model and Risk Estimation
On the map: Vision-language-action models → Human-video and latent-action pretraining
Abstract (arXiv)
Vision Language Action (VLA) models enable instruction-following manipulation, yet their deployment on coordinated dual-arm platforms remains severely constrained by under-modeled self-collisions between manipulators and grasped objects. To address this critical safety gap, we propose CoFreeVLA, a novel framework that augments end-to-end VLA policies with a lightweight, short-horizon self-collision risk estimator. The estimator predicts collision likelihoods directly from proprioceptive states, visual embeddings, and candidate action sequences. Deeply integrated into the closed-loop control system, this estimator proactively gates risky commands, autonomously synthesizes recovery trajectories to safe states via risk-guided adjustments, and biases policy refinement for safer rollouts. To ensure robust calibration, the estimator utilizes a two-stage training pipeline, pre-training with model-based synthetic collision labels, followed by post-training on real-robot rollouts. Across five bimanual tasks, six VLA backbones, and 30 trials per variant, the task-averaged collision rate decreases from 0.54 to 0.23, while the task-averaged success rate increases from 0.45 to 0.61. Compared to representative baselines, CoFreeVLA substantially reduces self-collision frequencies and improves overall task success rates, providing a crucial step toward the safe deployment of foundational models in multi-arm continuous control.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Human-video and latent-action pretraining, one of 13 directions in Vision-language-action models. Builds on 26 of its 41 references that are in the map. First posted on arXiv 29 Jan 2026.
Builds on
26 of 41 references.
Closest ancestors · 1
Same direction, newest first
Other references · 25
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
- 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 377
- 2019Control Barrier Functions: Theory and Applicationscited by 332
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 331
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
13 more
- 2025π*0.6: a VLA That Learns From Experiencecited by 280
- 2016Control Barrier Function Based Quadratic Programs for Safety Critical Systemscited by 261
- 2025PD-VLA: Accelerating Vision-Language-Action Model Integrated with Action Chunking via Parallel Decodingcited by 88
- 2024PerAct2: Benchmarking and Learning for Robotic Bimanual Manipulation Taskscited by 37
- 2025VLA-Touch: Enhancing Vision-Language-Action Models with Dual-Level Tactile Feedbackcited by 37
- 2025Spatial-Temporal Graph Diffusion Policy with Kinematic Modeling for Bimanual Robotic Manipulationcited by 24
- 2022A Collision-Free MPC for Whole-Body Dynamic Locomotion and Manipulationcited by 15
- 2025VFP: Variational Flow-Matching Policy for Multi-Modal Robot Manipulationcited by 9
- 2024APEX: Ambidextrous Dual-Arm Robotic Manipulation Using Collision-Free Generative Diffusion Modelscited by 7
- 2024ManiPose: A Comprehensive Benchmark for Pose-aware Object Manipulation in Roboticscited by 6
- 2025ManiDP: Manipulability-Aware Diffusion Policy for Posture-Dependent Bimanual Manipulationcited by 4
- 2024Efficient Collision Detection Framework for Enhancing Collision-Free Robot Motioncited by 3
- 2025VLM-SFD: VLM-Assisted Siamese Flow Diffusion Framework for Dual-Arm Cooperative Manipulationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SimVLA: A Simple VLA Baseline for Robotic Manipulation
- 2026Co-VLA: Coordination-Aware Structured Action Modeling for Dual-Arm Vision-Language-Action Systems
- 2025TwinVLA: Data-Efficient Bimanual Manipulation with Twin Single-Arm Vision-Language-Action Models
- 2025RationalVLA: A Rational Vision-Language-Action Model with Dual System
- 2026AtomVLA: Scalable Post-Training for Robotic Manipulation via Predictive Latent World Models
- 2025VLSA: Vision-Language-Action Models with Plug-and-Play Safety Constraint Layer
- 2026VLPSA: Vision-Language-Poisson-Safe Actions for Full-Body Safety of Learned Policies
- 2026Reflex: Enabling Fast and Predictive Vision-Language-Action Models for Reaction-Critical Manipulation