mlsanityData to 14 Oct 2026

SIM1: Physics-Aligned Simulator as Zero-Shot Data Scaler in Deformable Worlds

arXiv 2604.08544 ↗First posted 9 Apr 2026cs.RO cs.AI cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Robotic manipulation with deformable objects represents a data-intensive regime in embodied learning, where shape, contact, and topology co-evolve in ways that far exceed the variability of rigids. Although simulation promises relief from the cost of real-world data acquisition, prevailing sim-to-real pipelines remain rooted in rigid-body abstractions, producing mismatched geometry, fragile soft dynamics, and motion primitives poorly suited for cloth interaction. We posit that simulation fails not for being synthetic, but for being ungrounded. To address this, we introduce SIM1, a physics-aligned real-to-sim-to-real data engine that grounds simulation in the physical world. Given limited demonstrations, the system digitizes scenes into metric-consistent twins, calibrates deformable dynamics through elastic modeling, and expands behaviors via diffusion-based trajectory generation with quality filtering. This pipeline transforms sparse observations into scaled synthetic supervision with near-demonstration fidelity. Experiments show that policies trained on purely synthetic data achieve parity with real-data baselines at a 1:15 equivalence ratio, while delivering 90% zero-shot success and 50% generalization gains in real-world deployment. These results validate physics-aligned simulation as scalable supervision for deformable manipulation and a practical pathway for data-efficient policy learning.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 46 of its 60 references that are in the map. First posted on arXiv 9 Apr 2026.

Builds on

46 of 60 references.

References · 46

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  4. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  5. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  6. 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
  7. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  8. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
  9. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
  10. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 657
  11. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
  12. 2026World Action Models are Zero-shot Policiescited by 465
34 more
  1. 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 410
  2. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
  3. 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 327
  4. 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 327
  5. 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 296
  6. 2024Reconciling Reality through Simulation: A Real-to-Sim-to-Real Approach for Robust Manipulationcited by 144
  7. 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videoscited by 135
  8. 2025GraspVLA: a Grasping Foundation Model Pre-trained on Billion-scale Synthetic Action Datacited by 123
  9. 2024DexMimicGen: Automated Data Generation for Bimanual Dexterous Manipulation via Imitation Learningcited by 116
  10. 2026EgoScale: Scaling Dexterous Manipulation with Diverse Egocentric Human Datacited by 94
  11. 2025PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videoscited by 87
  12. 2025InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policycited by 84
  13. 2026RoboCasa365: A Large-Scale Simulation Framework for Training and Benchmarking Generalist Robotscited by 79
  14. 2026LeRobot: An Open-Source Library for End-to-End Robot Learningcited by 73
  15. 2024GRUtopia: Dream General Robots in a City at Scalecited by 59
  16. 2025InternData-A1: Pioneering High-Fidelity Synthetic Data for Pre-training Generalist Policycited by 50
  17. 2026InternVLA-A1: Unifying Understanding, Generation and Action for Robotic Manipulationcited by 50
  18. 2025Novel Demonstration Generation with Gaussian Splatting Enables Robust One-Shot Manipulationcited by 48
  19. 2024DexGraspNet 2.0: Learning Generative Dexterous Grasping in Large-scale Synthetic Cluttered Scenescited by 44
  20. 2026RISE: Self-Improving Robot Policy with Compositional World Modelcited by 40
  21. 2025SimScale: Learning to Drive via Real-World Simulation at Scalecited by 36
  22. 2025VIRAL: Visual Sim-to-Real at Scale for Humanoid Loco-Manipulationcited by 25
  23. 2025Dex1B: Learning with 1B Demonstrations for Dexterous Manipulationcited by 24
  24. 2024GarmentLab: A Unified Simulation and Benchmark for Garment Manipulationcited by 22
  25. 2026ForceVLA2: Unleashing Hybrid Force-Position Control with Force Awareness for Contact-Rich Manipulationcited by 22
  26. 2025GENMANIP: LLM-driven Simulation for Generalizable Instruction-Following Manipulationcited by 18
  27. 2025Opening the Sim-to-Real Door for Humanoid Pixel-to-Action Policy Transfercited by 15
  28. 2026Genie Sim 3.0 : A High-Fidelity Comprehensive Simulation Platform for Humanoid Robotcited by 14
  29. 2026chi0: Resource-Aware Robust Manipulation via Taming Distributional Inconsistenciescited by 12
  30. 2026EMPM: Embodied MPM for Modeling and Simulation of Deformable Objectscited by 9
  31. 2024Vertex Block Descentcited by 6
  32. 2024StiffGIPC: Advancing GPU IPC for stiff affine-deformable simulationcited by 6
  33. 2026SoMA: A Real-to-Sim Neural Simulator for Robotic Soft-body Manipulationcited by 4
  34. 2025Right-Side-Out: Learning Zero-Shot Sim-to-Real Garment Reversalcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.