mlsanityData to 14 Oct 2026

D-CODA: Diffusion for Coordinated Dual-Arm Data Augmentation

arXiv 2505.04860 ↗First posted 8 May 2025cs.RO cs.AI cs.CVcited by 5

On the map: Offline RL and imitation learning from data → Robot manipulation imitation learning

Abstract (arXiv)

Learning bimanual manipulation is challenging due to its high dimensionality and tight coordination required between two arms. Eye-in-hand imitation learning, which uses wrist-mounted cameras, simplifies perception by focusing on task-relevant views. However, collecting diverse demonstrations remains costly, motivating the need for scalable data augmentation. While prior work has explored visual augmentation in single-arm settings, extending these approaches to bimanual manipulation requires generating viewpoint-consistent observations across both arms and producing corresponding action labels that are both valid and feasible. In this work, we propose Diffusion for COordinated Dual-arm Data Augmentation (D-CODA), a method for offline data augmentation tailored to eye-in-hand bimanual imitation learning that trains a diffusion model to synthesize novel, viewpoint-consistent wrist-camera images for both arms while simultaneously generating joint-space action labels. It employs constrained optimization to ensure that augmented states involving gripper-to-object contacts adhere to constraints suitable for bimanual coordination. We evaluate D-CODA on 5 simulated and 3 real-world tasks. Our results across 2250 simulation trials and 300 real-world trials demonstrate that it outperforms baselines and ablations, showing its potential for scalable data augmentation in eye-in-hand bimanual manipulation. Our project website is at: https://dcodaaug.github.io/D-CODA/.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Robot manipulation imitation learning, one of 13 directions in Offline RL and imitation learning from data. Builds on 66 of its 80 references that are in the map. First posted on arXiv 8 May 2025.

Builds on

66 of 80 references.

Closest ancestors · 17

Same direction, newest first

  1. 2025RoboEngine: Plug-and-Play Robot Data Augmentation with Semantic Robot Segmentation and Background Generation24 Mar
  2. 2024DexMimicGen: Automated Data Generation for Bimanual Dexterous Manipulation via Imitation Learning31 Oct
  3. 2024SkillMimicGen: Automated Demonstration Generation for Efficient Skill Learning and Deployment24 Oct
  4. 2024ALOHA Unleashed: A Simple Recipe for Robot Dexterity17 Oct
  5. 2024Bunny-VisionPro: Real-Time Bimanual Dexterous Teleoperation for Imitation Learning3 Jul
  6. 2024DexCap: Scalable and Portable Mocap Data Collection System for Dexterous Manipulation12 Mar
  7. 2024Diffusion Meets DAgger: Supercharging Eye-in-hand Imitation Learning27 Feb
  8. 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperation4 Jan
  9. 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrations26 Oct
  10. 2023GELLO: A General, Low-Cost, and Intuitive Teleoperation Framework for Robot Manipulators22 Sep
  11. 2023Waypoint-Based Imitation Learning for Robotic Manipulation26 Jul
  12. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware23 Apr
5 more
  1. 2023Learning Robot Manipulation from Cross-Morphology Demonstration7 Apr
  2. 2023NeRF in the Palm of Your Hand: Corrective Augmentation for Robotics via Novel-View Synthesis18 Jan
  3. 2022Interactive Imitation Learning of Bimanual Movement Primitives28 Oct
  4. 2020Deep Imitation Learning for Bimanual Robotic Manipulation11 Oct
  5. 2020Visual Imitation Made Easy11 Aug

Other references · 49

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  4. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  5. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  6. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
  7. 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 689
  8. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
  9. 2020Image Augmentation Is All You Need: Regularizing Deep Reinforcement Learning from Pixelscited by 585
  10. 2020Reinforcement Learning with Augmented Datacited by 468
  11. 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 218
  12. 2017DART: Noise Injection for Robust Imitation Learningcited by 191
37 more
  1. 2023RoboAgent: Generalization and Efficiency in Robot Manipulation via Semantic Augmentations and Action Chunkingcited by 169
  2. 2023GenSim: Generating Robotic Simulation Tasks via Large Language Modelscited by 125
  3. 2022Towards Human-Level Bimanual Dexterous Manipulation with Reinforcement Learningcited by 119
  4. 2024HumanoidBench: Simulated Humanoid Benchmark for Whole-Body Locomotion and Manipulationcited by 112
  5. 2023ZeroNVS: Zero-Shot 360-Degree View Synthesis from a Single Imagecited by 111
  6. 2023Affordance Diffusion: Synthesizing Hand-Object Interactionscited by 110
  7. 2023Long-Term Photometric Consistent Novel View Synthesis with Diffusion Modelscited by 76
  8. 2024Learning Visuotactile Skills with Two Multifingered Handscited by 76
  9. 2023Gen2Sim: Scaling up Robot Learning in Simulation with Generative Modelscited by 64
  10. 2021FabricFlowNet: Bimanual Cloth Manipulation with a Flow-based Policycited by 54
  11. 2022SpeedFolding: Learning Efficient Bimanual Folding of Garmentscited by 52
  12. 2024GenSim2: Scaling Robot Data Generation with Multi-modal and Reasoning LLMscited by 52
  13. 2022Vision-Based Manipulators Need to Also See from Their Handscited by 47
  14. 2024RoVi-Aug: Robot and Viewpoint Augmentation for Cross-Embodiment Robot Learningcited by 46
  15. 2019Efficient Bimanual Manipulation Using Learned Task Schemascited by 45
  16. 2024Twisting Lids Off with Two Handscited by 42
  17. 2023Stabilize to Act: Learning to Coordinate for Bimanual Manipulationcited by 39
  18. 2024PerAct2: Benchmarking and Learning for Robotic Bimanual Manipulation Taskscited by 37
  19. 2024View-Invariant Policy Learning via Zero-Shot Novel View Synthesiscited by 35
  20. 2023RoboPianist: Dexterous Piano Playing with Deep Reinforcement Learningcited by 30
  21. 2024BiGym: A Demo-Driven Mobile Bi-Manual Manipulation Benchmarkcited by 30
  22. 2023CCIL: Continuity-based Data Augmentation for Corrective Imitation Learningcited by 29
  23. 2022Cloth Funnels: Canonicalized-Alignment for Multi-Purpose Garment Manipulationcited by 28
  24. 2024VoxAct-B: Voxel-Based Acting and Stabilizing Policy for Bimanual Manipulationcited by 21
  25. 2025You Only Teach Once: Learn One-Shot Bimanual Robotic Manipulation from Video Demonstrationscited by 21
  26. 2022Learning Bimanual Scooping Policies for Food Acquisitioncited by 20
  27. 2024ScrewMimic: Bimanual Imitation from Human Videos with Screw Space Projectioncited by 19
  28. 2024Semantically Controllable Augmentations for Generalizable Robot Learningcited by 18
  29. 2022Data Augmentation for Manipulationcited by 16
  30. 2024AnyBimanual: Transferring Unimanual Policy for General Bimanual Manipulationcited by 16
  31. 2024KALIE: Fine-Tuning Vision-Language Models for Open-World Manipulation without Robot Datacited by 15
  32. 2024Learning Diverse Bimanual Dexterous Manipulation Skills from Human Demonstrationscited by 15
  33. 2022AutoBag: Learning to Open Plastic Bags and Insert Objectscited by 14
  34. 2022Bag All You Need: Learning a Generalizable Bagging Strategy for Heterogeneous Objectscited by 12
  35. 2023Bagging by Learning to Singulate Layers Using Interactive Perceptioncited by 7
  36. 2017Compliant Movement Primitives in a Bimanual Settingcited by 6
  37. 2023Giving Robots a Hand: Learning Generalizable Manipulation with Eye-in-Hand Human Video Demonstrationscited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 4.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025TwinVLA: Data-Efficient Bimanual Manipulation with Twin Single-Arm Vision-Language-Action Models
  2. 2025Ag2x2: Robust Agent-Agnostic Visual Representations for Zero-Shot Bimanual Manipulation ↗
  3. 2025Learning Bimanual Manipulation via Action Chunking and Inter-Arm Coordination with Transformers
  4. 2024Bi-KVIL: Keypoints-based Visual Imitation Learning of Bimanual Manipulation Tasks
  5. 2024InterACT: Inter-dependency Aware Action Chunking with Hierarchical Attention Transformers for Bimanual Manipulation
  6. 2025H-RDT: Human Manipulation Enhanced Bimanual Robotic Manipulation
  7. 2025Tenma: Robust Cross-Embodiment Robot Manipulation with Diffusion Transformer
  8. 2026JAMB: Joint Action-Motion Diffusion for Bimanual Manipulation