DeMaVLA: A Vision-Language-Action Foundation Model for Generalizable Deformable Manipulation
On the map: Vision-language-action models → 3D and spatial-aware VLA
Abstract (arXiv)
Real-world household robots require Vision-Language-Action (VLA) foundation models that can acquire reusable manipulation skills across diverse objects, task conditions, and household environments. Deformable-object folding is a representative challenge, requiring robots to handle clothing items from random initial states across varying categories, geometries, materials, and scenes. However, existing VLA systems commonly train separate policies for different object categories, while naively mixed multi-task training often suffers from task interference and degraded performance. To move beyond category-specific folding policies, we introduce DeMaVLA, a VLA foundation model for generalizable Deformable Manipulation. DeMaVLA adopts a VLM backbone with an action expert and formulates continuous action generation using flow matching. To improve efficiency, the action expert is constructed by pruning every other transformer layer while preserving layer-wise alignment with the VLM backbone, reducing training and inference cost. DeMaVLA is first pre-trained on approximately 5,000 hours of selected real-world dual-arm demonstrations to acquire general manipulation priors. It is then post-trained on mixed folding data that aggregates self-collected demonstrations and corrective trajectories from real-robot failures across multiple folding tasks through a human-in-the-loop Data Aggregation~(DAgger) pipeline. Experiments show that DeMaVLA achieves competitive performance on RoboTwin 2.0 and strong real-world results on our household folding benchmark. These results highlight the value of scalable real-world data, efficient action generation, and corrective learning for general-purpose VLA policies in deformable-object manipulation.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in 3D and spatial-aware VLA, one of 13 directions in Vision-language-action models. Builds on 36 of its 38 references that are in the map. First posted on arXiv 29 May 2026.
Builds on
36 of 38 references.
References · 36
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2024PaliGemma: A versatile 3B VLM for transfercited by 679
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
- 2020Reinforcement Learning with Augmented Datacited by 452
- 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 377
24 more
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
- 2025π*0.6: a VLA That Learns From Experiencecited by 280
- 2018HG-DAgger: Interactive Imitation Learning with Human Expertscited by 245
- 2025Real-Time Execution of Action Chunking Flow Policiescited by 199
- 2025GR-3 Technical Reportcited by 110
- 2020Human-in-the-Loop Imitation Learning using Remote Teleoperationcited by 103
- 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developingcited by 103
- 2021ThriftyDAgger: Budget-Aware Novelty and Risk Gating for Interactive Imitation Learningcited by 98
- 2026A Pragmatic VLA Foundation Modelcited by 97
- 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 94
- 2025Galaxea Open-World Dataset and G0 Dual-System VLA Modelcited by 90
- 2025RynnVLA-002: A Unified Vision-Language-Action and World Modelcited by 70
- 2025Training-Time Action Conditioning for Efficient Real-Time Chunkingcited by 61
- 2026Being-H0.5: Scaling Human-Centric Robot Learning for Cross-Embodiment Generalizationcited by 61
- 2025Igniting VLMs toward the Embodied Spacecited by 53
- 2022Interactive Imitation Learning in Robotics: A Surveycited by 51
- 2022Efficient Learning of Safe Driving Policy via Human-AI Copilot Optimizationcited by 44
- 2026Xiaomi-Robotics-0: An Open-Sourced Vision-Language-Action Model with Real-Time Executioncited by 42
- 2025GR-RL: Going Dexterous and Precise for Long-Horizon Robotic Manipulationcited by 41
- 2025RaC: Robot Learning for Long-Horizon Tasks by Scaling Recovery and Correctioncited by 35
- 2025RoboCopilot: Human-in-the-loop Interactive Imitation Learning for Robot Manipulationcited by 22
- 2026JoyAI-RA 0.1: A Foundation Model for Robotic Autonomycited by 21
- 2026HoloBrain-0 Technical Reportcited by 20
- 2026chi0: Resource-Aware Robust Manipulation via Taming Distributional Inconsistenciescited by 11
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026Learning 4D Geometric Priors for Inference-Efficient World Action Modelscited by 14
- 2026DSWAM: A Dual-System World Action Foundation Model for Fine-Grained Robot Manipulationcited by 8
- 2026SoftVTBench: A Safety-Aware Visuo-Tactile Benchmark for Physically Constrained Robotic Manipulation of Deformable Objects (Early Version)cited by 2
- 2026Breaking Structural Isolation: Scalable Graph Clustering via Community-Aware Sampling and Structural Entropycited by 0
- 2026One Policy, Many Embodiments: Unified Camera-Centric Action Geometry Pre-training for Heterogeneous Embodied Manipulationcited by 0
- 2026CSWAM: Better Causal Semantic Representations for Out-of-Distribution Generalization in World Action Modelscited by 0
- 2026MaskHarness-WAM: Instance-Grounded Harnessing for Long-Horizon Robot Manipulationcited by 0
- 2026DualManip: Agentic Dynamic Manipulation via Dual-Path Semantic Reasoning and Geometric Adaptationcited by 0
- 2026DualManip: Agentic Dynamic Manipulation via Dual-Path Semantic Reasoning and Geometric Adaptation25 Sep 2026
- 2026MaskHarness-WAM: Instance-Grounded Harnessing for Long-Horizon Robot Manipulation17 Sep 2026
- 2026CSWAM: Better Causal Semantic Representations for Out-of-Distribution Generalization in World Action Models16 Sep 2026
- 2026One Policy, Many Embodiments: Unified Camera-Centric Action Geometry Pre-training for Heterogeneous Embodied Manipulation26 Aug 2026
- 2026Breaking Structural Isolation: Scalable Graph Clustering via Community-Aware Sampling and Structural Entropy6 Jul 2026
- 2026Learning 4D Geometric Priors for Inference-Efficient World Action Models6 Jul 2026
- 2026DSWAM: A Dual-System World Action Foundation Model for Fine-Grained Robot Manipulation6 Jul 2026
- 2026SoftVTBench: A Safety-Aware Visuo-Tactile Benchmark for Physically Constrained Robotic Manipulation of Deformable Objects (Early Version)5 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026SG-VLA: Learning Spatially-Grounded Vision-Language-Action Models for Mobile Manipulation
- 2025Language-Guided Long Horizon Manipulation with LLM-based Planning and Visual Perception
- 2026HiVLA: A Visual-Grounded-Centric Hierarchical Embodied Manipulation System
- 2025REALM: A Real-to-Sim Validated Benchmark for Generalization in Robotic Manipulation
- 2026Scaling World Model for Hierarchical Manipulation Policies
- 2026GEAR-VLA: Learning Geometry-Aware Action Representations for Generalizable Robotic Manipulation
- 2026DAM-VLA: A Dynamic Action Model-Based Vision-Language-Action Framework for Robot Manipulation
- 2025ManualVLA: A Unified VLA Model for Chain-of-Thought Manual Generation and Robotic Manipulation