mlsanityData to 14 Oct 2026

RoboCousin: Build Your Own Simulation Playground for Robust Bimanual Robotic Manipulation

arXiv 2609.08339 ↗First posted 8 Sep 2026cs.RO cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Bimanual manipulation policies require large and diverse training datasets, yet collecting demonstrations on physical robots is expensive and difficult to scale. Simulation can generate data efficiently, but existing pipelines typically operate within closed asset libraries and predefined scenes: adding a newly observed object or environment still requires substantial effort to reconstruct geometry, specify physical and semantic properties, annotate interactions, and integrate the result into executable tasks. We present RoboCousin, an extensible simulation-based data-generation platform that turns user-provided observations into reusable assets, scenes, and expert trajectories for bimanual manipulation. Built on RoboTwin~2.0, RoboCousin converts object images into simulation-ready assets with visual and collision geometry, semantic and physical metadata, and automatically generated grasp-contact candidates. It further constructs digital cousins that vary compatible objects, backgrounds, layouts, and language instructions while preserving task-relevant affordances and spatial relations. The same asset system supports tabletop and room-level scene construction, with collision-aware base control for interaction beyond a fixed workspace. We release RoboCousin-OBD, containing more than 3,000 annotated object instances and 50 background environments, and use RoboCousin to generate over one million expert trajectories across 50 tasks. Simulation and real-robot experiments show that the automatically generated interaction annotations are comparable to curated annotations, generated assets provide effective sim-to-real supervision, and tabletop cousins can improve transfer beyond training on a single reconstructed scene. RoboCousin therefore provides a practical path for expanding both the scale and coverage of synthetic bimanual manipulation data.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 34 references that are in the map. First posted on arXiv 8 Sep 2026.

Builds on

30 of 34 references.

References · 30

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2023Segment Anythingcited by 8,234
  3. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  4. 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
  5. 2025SAM 3: Segment Anything with Conceptscited by 906
  6. 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 689
  7. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
  8. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
  9. 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 511
  10. 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 407
  11. 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 380
  12. 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 327
18 more
  1. 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 327
  2. 2025SAM 3D: 3Dfy Anything in Imagescited by 247
  3. 2024ManiSkill3: GPU Parallelized Robotics Simulation and Rendering for Generalizable Embodied AIcited by 229
  4. 2024Reconciling Reality through Simulation: A Real-to-Sim-to-Real Approach for Robust Manipulationcited by 144
  5. 2024THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulationcited by 133
  6. 2023GenSim: Generating Robotic Simulation Tasks via Large Language Modelscited by 125
  7. 2025GraspVLA: a Grasping Foundation Model Pre-trained on Billion-scale Synthetic Action Datacited by 123
  8. 2025RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twinscited by 121
  9. 2024DexMimicGen: Automated Data Generation for Bimanual Dexterous Manipulation via Imitation Learningcited by 116
  10. 2024Automated Creation of Digital Cousins for Robust Policy Learningcited by 91
  11. 2024SplatSim: Zero-Shot Sim2Real Transfer of RGB Manipulation Policies Using Gaussian Splattingcited by 69
  12. 2023Gen2Sim: Scaling up Robot Learning in Simulation with Generative Modelscited by 64
  13. 2024GenSim2: Scaling Robot Data Generation with Multi-modal and Reasoning LLMscited by 52
  14. 2024Dream to Manipulate: Compositional World Models Empowering Robot Imitation Learning with Imaginationcited by 45
  15. 2025EmbodiedGen: Towards a Generative 3D World Engine for Embodied Intelligencecited by 36
  16. 2025High-Fidelity Simulated Data Generation for Real-World Zero-Shot Robotic Manipulation Learning with Gaussian Splattingcited by 14
  17. 2025MoMaGen: Generating Demonstrations under Soft and Hard Constraints for Multi-Step Bimanual Mobile Manipulationcited by 7
  18. 2026From Seeing to Simulating: Generative High-Fidelity Simulation with Digital Cousins for Generalizable Robot Learning and Evaluationcited by 1

Built on by

Not cited yet.