D-CODA: Diffusion for Coordinated Dual-Arm Data Augmentation
On the map: Offline RL and imitation learning from data → Robot manipulation imitation learning
Abstract (arXiv)
Learning bimanual manipulation is challenging due to its high dimensionality and tight coordination required between two arms. Eye-in-hand imitation learning, which uses wrist-mounted cameras, simplifies perception by focusing on task-relevant views. However, collecting diverse demonstrations remains costly, motivating the need for scalable data augmentation. While prior work has explored visual augmentation in single-arm settings, extending these approaches to bimanual manipulation requires generating viewpoint-consistent observations across both arms and producing corresponding action labels that are both valid and feasible. In this work, we propose Diffusion for COordinated Dual-arm Data Augmentation (D-CODA), a method for offline data augmentation tailored to eye-in-hand bimanual imitation learning that trains a diffusion model to synthesize novel, viewpoint-consistent wrist-camera images for both arms while simultaneously generating joint-space action labels. It employs constrained optimization to ensure that augmented states involving gripper-to-object contacts adhere to constraints suitable for bimanual coordination. We evaluate D-CODA on 5 simulated and 3 real-world tasks. Our results across 2250 simulation trials and 300 real-world trials demonstrate that it outperforms baselines and ablations, showing its potential for scalable data augmentation in eye-in-hand bimanual manipulation. Our project website is at: https://dcodaaug.github.io/D-CODA/.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Robot manipulation imitation learning, one of 13 directions in Offline RL and imitation learning from data. Builds on 66 of its 80 references that are in the map. First posted on arXiv 8 May 2025.
Builds on
66 of 80 references.
Closest ancestors · 17
Same direction, newest first
- 2025RoboEngine: Plug-and-Play Robot Data Augmentation with Semantic Robot Segmentation and Background Generation24 Mar
- 2024DexMimicGen: Automated Data Generation for Bimanual Dexterous Manipulation via Imitation Learning31 Oct
- 2024SkillMimicGen: Automated Demonstration Generation for Efficient Skill Learning and Deployment24 Oct
- 2024ALOHA Unleashed: A Simple Recipe for Robot Dexterity17 Oct
- 2024Bunny-VisionPro: Real-Time Bimanual Dexterous Teleoperation for Imitation Learning3 Jul
- 2024DexCap: Scalable and Portable Mocap Data Collection System for Dexterous Manipulation12 Mar
- 2024Diffusion Meets DAgger: Supercharging Eye-in-hand Imitation Learning27 Feb
- 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperation4 Jan
- 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrations26 Oct
- 2023GELLO: A General, Low-Cost, and Intuitive Teleoperation Framework for Robot Manipulators22 Sep
- 2023Waypoint-Based Imitation Learning for Robotic Manipulation26 Jul
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware23 Apr
5 more
- 2023Learning Robot Manipulation from Cross-Morphology Demonstration7 Apr
- 2023NeRF in the Palm of Your Hand: Corrective Augmentation for Robotics via Novel-View Synthesis18 Jan
- 2022Interactive Imitation Learning of Bimanual Movement Primitives28 Oct
- 2020Deep Imitation Learning for Bimanual Robotic Manipulation11 Oct
- 2020Visual Imitation Made Easy11 Aug
Other references · 49
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
- 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 689
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
- 2020Image Augmentation Is All You Need: Regularizing Deep Reinforcement Learning from Pixelscited by 585
- 2020Reinforcement Learning with Augmented Datacited by 468
- 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 218
- 2017DART: Noise Injection for Robust Imitation Learningcited by 191
37 more
- 2023RoboAgent: Generalization and Efficiency in Robot Manipulation via Semantic Augmentations and Action Chunkingcited by 169
- 2023GenSim: Generating Robotic Simulation Tasks via Large Language Modelscited by 125
- 2022Towards Human-Level Bimanual Dexterous Manipulation with Reinforcement Learningcited by 119
- 2024HumanoidBench: Simulated Humanoid Benchmark for Whole-Body Locomotion and Manipulationcited by 112
- 2023ZeroNVS: Zero-Shot 360-Degree View Synthesis from a Single Imagecited by 111
- 2023Affordance Diffusion: Synthesizing Hand-Object Interactionscited by 110
- 2023Long-Term Photometric Consistent Novel View Synthesis with Diffusion Modelscited by 76
- 2024Learning Visuotactile Skills with Two Multifingered Handscited by 76
- 2023Gen2Sim: Scaling up Robot Learning in Simulation with Generative Modelscited by 64
- 2021FabricFlowNet: Bimanual Cloth Manipulation with a Flow-based Policycited by 54
- 2022SpeedFolding: Learning Efficient Bimanual Folding of Garmentscited by 52
- 2024GenSim2: Scaling Robot Data Generation with Multi-modal and Reasoning LLMscited by 52
- 2022Vision-Based Manipulators Need to Also See from Their Handscited by 47
- 2024RoVi-Aug: Robot and Viewpoint Augmentation for Cross-Embodiment Robot Learningcited by 46
- 2019Efficient Bimanual Manipulation Using Learned Task Schemascited by 45
- 2024Twisting Lids Off with Two Handscited by 42
- 2023Stabilize to Act: Learning to Coordinate for Bimanual Manipulationcited by 39
- 2024PerAct2: Benchmarking and Learning for Robotic Bimanual Manipulation Taskscited by 37
- 2024View-Invariant Policy Learning via Zero-Shot Novel View Synthesiscited by 35
- 2023RoboPianist: Dexterous Piano Playing with Deep Reinforcement Learningcited by 30
- 2024BiGym: A Demo-Driven Mobile Bi-Manual Manipulation Benchmarkcited by 30
- 2023CCIL: Continuity-based Data Augmentation for Corrective Imitation Learningcited by 29
- 2022Cloth Funnels: Canonicalized-Alignment for Multi-Purpose Garment Manipulationcited by 28
- 2024VoxAct-B: Voxel-Based Acting and Stabilizing Policy for Bimanual Manipulationcited by 21
- 2025You Only Teach Once: Learn One-Shot Bimanual Robotic Manipulation from Video Demonstrationscited by 21
- 2022Learning Bimanual Scooping Policies for Food Acquisitioncited by 20
- 2024ScrewMimic: Bimanual Imitation from Human Videos with Screw Space Projectioncited by 19
- 2024Semantically Controllable Augmentations for Generalizable Robot Learningcited by 18
- 2022Data Augmentation for Manipulationcited by 16
- 2024AnyBimanual: Transferring Unimanual Policy for General Bimanual Manipulationcited by 16
- 2024KALIE: Fine-Tuning Vision-Language Models for Open-World Manipulation without Robot Datacited by 15
- 2024Learning Diverse Bimanual Dexterous Manipulation Skills from Human Demonstrationscited by 15
- 2022AutoBag: Learning to Open Plastic Bags and Insert Objectscited by 14
- 2022Bag All You Need: Learning a Generalizable Bagging Strategy for Heterogeneous Objectscited by 12
- 2023Bagging by Learning to Singulate Layers Using Interactive Perceptioncited by 7
- 2017Compliant Movement Primitives in a Bimanual Settingcited by 6
- 2023Giving Robots a Hand: Learning Generalizable Manipulation with Eye-in-Hand Human Video Demonstrationscited by 6
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2026CRAFT: Video Diffusion for Bimanual Robot Data Generationcited by 4
- 2025ROPA: Synthetic Robot Pose Generation for RGB-D Bimanual Data Augmentationcited by 3
- 2026See Selectively, Act Adaptively: Dual-Level Structural Decomposition for Bimanual Robot Manipulationcited by 1
- 2026RoTri-Diff: A Spatial Robot-Object Triadic Interaction-Guided Diffusion Model for Bimanual Manipulationcited by 0
- 2026StereoEngine: Scaling Stereo Bimanual Robot Data without Stereo Camerascited by 0
- 2026StereoEngine: Scaling Stereo Bimanual Robot Data without Stereo Cameras8 Oct 2026
- 2026See Selectively, Act Adaptively: Dual-Level Structural Decomposition for Bimanual Robot Manipulation11 Jun 2026
- 2026CRAFT: Video Diffusion for Bimanual Robot Data Generation4 Apr 2026
- 2026RoTri-Diff: A Spatial Robot-Object Triadic Interaction-Guided Diffusion Model for Bimanual Manipulation7 Mar 2026
- 2025ROPA: Synthetic Robot Pose Generation for RGB-D Bimanual Data Augmentation23 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2025TwinVLA: Data-Efficient Bimanual Manipulation with Twin Single-Arm Vision-Language-Action Models
- 2025Ag2x2: Robust Agent-Agnostic Visual Representations for Zero-Shot Bimanual Manipulation ↗
- 2025Learning Bimanual Manipulation via Action Chunking and Inter-Arm Coordination with Transformers
- 2024Bi-KVIL: Keypoints-based Visual Imitation Learning of Bimanual Manipulation Tasks
- 2024InterACT: Inter-dependency Aware Action Chunking with Hierarchical Attention Transformers for Bimanual Manipulation
- 2025H-RDT: Human Manipulation Enhanced Bimanual Robotic Manipulation
- 2025Tenma: Robust Cross-Embodiment Robot Manipulation with Diffusion Transformer
- 2026JAMB: Joint Action-Motion Diffusion for Bimanual Manipulation