ManiTwin: Scaling Data-Generation-Ready Digital Object Dataset to 100K
Not on the map. Why?
Abstract (arXiv)
Learning in simulation provides a useful foundation for scaling robotic manipulation capabilities. However, this paradigm often suffers from a lack of data-generation-ready digital assets, in both scale and diversity. In this work, we present ManiTwin, an automated and efficient pipeline for generating data-generation-ready digital object twins. Our pipeline transforms a single image into simulation-ready and semantically annotated 3D asset, enabling large-scale robotic manipulation data generation. Using this pipeline, we construct ManiTwin-100K, a dataset containing 100K high-quality annotated 3D assets. Each asset is equipped with physical properties, language descriptions, functional annotations, and verified manipulation proposals. Experiments demonstrate that ManiTwin provides an efficient asset synthesis and annotation workflow, and that ManiTwin-100K offers high-quality and diverse assets for manipulation data generation, random scene synthesis, and VQA data generation, establishing a strong foundation for scalable simulation data synthesis and policy learning. Our webpage is available at https://manitwin.github.io/.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 30 of its 31 references that are in the map. First posted on arXiv 17 Mar 2026.
Builds on
30 of 31 references.
References · 30
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 411
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
- 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 262
- 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 206
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 135
- 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Roboticscited by 125
18 more
- 2025RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twinscited by 117
- 2024RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twins (early version)cited by 68
- 2026RoboCasa365: A Large-Scale Simulation Framework for Training and Benchmarking Generalist Robotscited by 65
- 2025InternData-A1: Pioneering High-Fidelity Synthetic Data for Pre-training Generalist Policycited by 46
- 2025PhysX-3D: Physical-Grounded 3D Asset Generationcited by 40
- 2026RMBench: Memory-Dependent Robotic Manipulation Benchmark with Insights into Policy Designcited by 40
- 2024D(R,O) Grasp: A Unified Representation of Robot and Object Interaction for Cross-Embodiment Dexterous Graspingcited by 38
- 2024G3Flow: Generative 3D Semantic Flow for Pose-aware and Generalizable Object Manipulationcited by 35
- 2025GraspGen: A Diffusion-based Framework for 6-DOF Grasping with On-Generator Trainingcited by 32
- 2025Vlaser: Vision-Language-Action Model with Synergistic Embodied Reasoningcited by 22
- 2025Objaverse++: Curated 3D Object Dataset with Quality Annotationscited by 20
- 2025CordViP: Correspondence-based Visuomotor Policy for Dexterous Manipulation in Real-Worldcited by 16
- 2026UniVTAC: A Unified Simulation Platform for Visuo-Tactile Manipulation Data Generation, Learning, and Benchmarkingcited by 15
- 2025HumanoidGen: Data Generation for Bimanual Dexterous Manipulation via LLM Reasoningcited by 12
- 2025Towards Spatial Trace with Reasoning in Vision-Language Models for Roboticscited by 12
- 2025Benchmarking Generalizable Bimanual Manipulation: RoboTwin Dual-Arm Collaboration Challenge at CVPR 2025 MEIS Workshopcited by 8
- 2024ModelNet-O: A Large-Scale Synthetic Dataset for Occlusion-Aware Point Cloud Classificationcited by 3
- 2025PASG: A Closed-Loop Framework for Automated Geometric Primitive Extraction and Semantic Anchoring in Robotic Manipulationcited by 1
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026RoboDojo: A Unified Sim-and-Real Benchmark for Comprehensive Evaluation of Generalist Robot Manipulation Policiescited by 35
- 2026EmbodiedGen V2: An Agentic, Simulation-Ready 3D World Engine for Embodied AIcited by 4
- 2026Data Pyramid for Embodied Manipulation: A Surveycited by 4
- 2026A Cross-Model VLM-Judge Protocol for Single-Image 3D Mesh Quality (and Why Cheap Proxies Fall Short)cited by 2
- 20263D Generation for Embodied AI and Robotic Simulation: A Surveycited by 0
- 2026Data Pyramid for Embodied Manipulation: A Survey27 Jul 2026
- 2026EmbodiedGen V2: An Agentic, Simulation-Ready 3D World Engine for Embodied AI8 Jul 2026
- 2026RoboDojo: A Unified Sim-and-Real Benchmark for Comprehensive Evaluation of Generalist Robot Manipulation Policies5 Jul 2026
- 2026A Cross-Model VLM-Judge Protocol for Single-Image 3D Mesh Quality (and Why Cheap Proxies Fall Short)16 Jun 2026
- 20263D Generation for Embodied AI and Robotic Simulation: A Survey29 Apr 2026