SIM1: Physics-Aligned Simulator as Zero-Shot Data Scaler in Deformable Worlds
Not on the map. Why?
Abstract (arXiv)
Robotic manipulation with deformable objects represents a data-intensive regime in embodied learning, where shape, contact, and topology co-evolve in ways that far exceed the variability of rigids. Although simulation promises relief from the cost of real-world data acquisition, prevailing sim-to-real pipelines remain rooted in rigid-body abstractions, producing mismatched geometry, fragile soft dynamics, and motion primitives poorly suited for cloth interaction. We posit that simulation fails not for being synthetic, but for being ungrounded. To address this, we introduce SIM1, a physics-aligned real-to-sim-to-real data engine that grounds simulation in the physical world. Given limited demonstrations, the system digitizes scenes into metric-consistent twins, calibrates deformable dynamics through elastic modeling, and expands behaviors via diffusion-based trajectory generation with quality filtering. This pipeline transforms sparse observations into scaled synthetic supervision with near-demonstration fidelity. Experiments show that policies trained on purely synthetic data achieve parity with real-data baselines at a 1:15 equivalence ratio, while delivering 90% zero-shot success and 50% generalization gains in real-world deployment. These results validate physics-aligned simulation as scalable supervision for deformable manipulation and a practical pathway for data-efficient policy learning.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 46 of its 60 references that are in the map. First posted on arXiv 9 Apr 2026.
Builds on
46 of 60 references.
References · 46
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 657
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
- 2026World Action Models are Zero-shot Policiescited by 465
34 more
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 410
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
- 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 327
- 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 327
- 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 296
- 2024Reconciling Reality through Simulation: A Real-to-Sim-to-Real Approach for Robust Manipulationcited by 144
- 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videoscited by 135
- 2025GraspVLA: a Grasping Foundation Model Pre-trained on Billion-scale Synthetic Action Datacited by 123
- 2024DexMimicGen: Automated Data Generation for Bimanual Dexterous Manipulation via Imitation Learningcited by 116
- 2026EgoScale: Scaling Dexterous Manipulation with Diverse Egocentric Human Datacited by 94
- 2025PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videoscited by 87
- 2025InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policycited by 84
- 2026RoboCasa365: A Large-Scale Simulation Framework for Training and Benchmarking Generalist Robotscited by 79
- 2026LeRobot: An Open-Source Library for End-to-End Robot Learningcited by 73
- 2024GRUtopia: Dream General Robots in a City at Scalecited by 59
- 2025InternData-A1: Pioneering High-Fidelity Synthetic Data for Pre-training Generalist Policycited by 50
- 2026InternVLA-A1: Unifying Understanding, Generation and Action for Robotic Manipulationcited by 50
- 2025Novel Demonstration Generation with Gaussian Splatting Enables Robust One-Shot Manipulationcited by 48
- 2024DexGraspNet 2.0: Learning Generative Dexterous Grasping in Large-scale Synthetic Cluttered Scenescited by 44
- 2026RISE: Self-Improving Robot Policy with Compositional World Modelcited by 40
- 2025SimScale: Learning to Drive via Real-World Simulation at Scalecited by 36
- 2025VIRAL: Visual Sim-to-Real at Scale for Humanoid Loco-Manipulationcited by 25
- 2025Dex1B: Learning with 1B Demonstrations for Dexterous Manipulationcited by 24
- 2024GarmentLab: A Unified Simulation and Benchmark for Garment Manipulationcited by 22
- 2026ForceVLA2: Unleashing Hybrid Force-Position Control with Force Awareness for Contact-Rich Manipulationcited by 22
- 2025GENMANIP: LLM-driven Simulation for Generalizable Instruction-Following Manipulationcited by 18
- 2025Opening the Sim-to-Real Door for Humanoid Pixel-to-Action Policy Transfercited by 15
- 2026Genie Sim 3.0 : A High-Fidelity Comprehensive Simulation Platform for Humanoid Robotcited by 14
- 2026chi0: Resource-Aware Robust Manipulation via Taming Distributional Inconsistenciescited by 12
- 2026EMPM: Embodied MPM for Modeling and Simulation of Deformable Objectscited by 9
- 2024Vertex Block Descentcited by 6
- 2024StiffGIPC: Advancing GPU IPC for stiff affine-deformable simulationcited by 6
- 2026SoMA: A Real-to-Sim Neural Simulator for Robotic Soft-body Manipulationcited by 4
- 2025Right-Side-Out: Learning Zero-Shot Sim-to-Real Garment Reversalcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.