mlsanityData to 14 Oct 2026

StereoEngine: Scaling Stereo Bimanual Robot Data without Stereo Cameras

arXiv 2610.12734 ↗First posted 8 Oct 2026cs.RO cs.CV cs.LGcited by 0

New in Vision-language-action models; no direction yet. Vision-language-action models

Abstract (arXiv)

Stereo vision is increasingly used for robotic manipulation, with a growing body of work incorporating it into Vision-Language-Action (VLA) models. However, the scarcity of large-scale, real-world stereo datasets remains a fundamental bottleneck for scaling such policies. Recent generative monocular-to-stereo methods target settings such as VR content and autonomous driving. No prior work produces realistic synthetic stereo data for robotic manipulation, where stereo supervision has come predominantly from simulation. We propose StereoEngine, which introduces two complementary methods to synthesize stereo data for robotic manipulation. In the first, we warp a monocular (left) video into the right view using estimated depth and inpaint the disoccluded regions with a video diffusion model, lifting monocular demonstrations into stereo pairs without training on real stereo. In the second, we render a stereo pair in simulation and jointly generate both photorealistic views, producing consistent left-right data without any real video as input. StereoEngine outperforms existing baselines in generated stereo quality, and using its synthetic data for policy mid-training or task-specific fine-tuning substantially improves downstream bimanual manipulation. Project website: https://stereoengine.github.io

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 47 of its 56 references that are in the map. First posted on arXiv 8 Oct 2026.

Builds on

47 of 56 references.

References · 47

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  4. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  5. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  6. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  7. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
  8. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
  9. 2026World Action Models are Zero-shot Policiescited by 465
  10. 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 327
  11. 2020Softmax Splatting for Video Frame Interpolationcited by 279
  12. 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 207
35 more
  1. 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Modelscited by 179
  2. 2023Scaling Robot Learning with Semantically Imagined Experiencecited by 177
  3. 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 173
  4. 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 138
  5. 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videoscited by 135
  6. 2025RoboCOIN: An Open-Sourced Bimanual Robotic Data Collection for Integrated Manipulationcited by 78
  7. 2016Deep3D: Fully Automatic 2D-to-3D Video Conversion with Deep Convolutional Neural Networkscited by 73
  8. 2025DemoGen: Synthetic Demonstration Generation for Data-Efficient Visuomotor Policy Learningcited by 69
  9. 2024ALOHA 2: An Enhanced Low-Cost Hardware for Bimanual Teleoperationcited by 63
  10. 2026MolmoAct2: Action Reasoning Models for Real-world Deploymentcited by 50
  11. 2025Novel Demonstration Generation with Gaussian Splatting Enables Robust One-Shot Manipulationcited by 48
  12. 2024Stereo Anywhere: Robust Zero-Shot Deep Stereo Matching Even Where Either Stereo or Mono Failcited by 47
  13. 2025Real2Render2Real: Scaling Robot Data Without Dynamics Simulation or Robot Hardwarecited by 44
  14. 2024StereoCrafter: Diffusion-based Generation of Long and High-fidelity Stereoscopic 3D from Monocular Videoscited by 37
  15. 2024StereoDiffusion: Training-Free Stereo Image Generation Using Latent Diffusion Modelscited by 25
  16. 2024SVG: 3D Stereoscopic Video Generation via Denoising Frame Matrixcited by 20
  17. 2025StereoVLA: Enhancing Vision-Language-Action Models with Stereo Visioncited by 18
  18. 2025Persistent Object Gaussian Splat (POGS) for Tracking Human and Robot Manipulation of Irregularly Shaped Objectscited by 15
  19. 2024D3RoMa: Disparity Diffusion-based Depth Sensing for Material-Agnostic Robotic Manipulationcited by 14
  20. 2024SpatialDreamer: Self-supervised Stereo Video Synthesis from Monocular Inputcited by 12
  21. 2025Mono2Stereo: A Benchmark and Empirical Study for Stereo Conversioncited by 10
  22. 2024ClearDepth: Enhanced Stereo Perception of Transparent Objects for Robotic Manipulationcited by 9
  23. 2026ActiveGlasses: Learning Manipulation with Active Vision from Ego-centric Human Demonstrationcited by 8
  24. 2025Restereo: Diffusion stereo video generation and restorationcited by 7
  25. 2024DissolveStereo: Coarse Depth Injection for Zero-Shot Stereo Video Generationcited by 6
  26. 2025Towards Open-World Generation of Stereo Images and Unsupervised Matchingcited by 6
  27. 2025D-CODA: Diffusion for Coordinated Dual-Arm Data Augmentationcited by 5
  28. 2026CRAFT: Video Diffusion for Bimanual Robot Data Generationcited by 4
  29. 2025ROPA: Synthetic Robot Pose Generation for RGB-D Bimanual Data Augmentationcited by 3
  30. 2025StereoWorld: Geometry-Aware Monocular-to-Stereo Video Generationcited by 3
  31. 2026StereoPolicy: Improving Robotic Manipulation Policies via Stereo Perceptioncited by 3
  32. 2026RoboDream: Compositional World Models for Scalable Robot Data Synthesiscited by 3
  33. 2025DiffuDepGrasp: Diffusion-based Depth Noise Modeling Empowers Sim2Real Robotic Graspingcited by 1
  34. 2026Geometric Reciprocity: Unlocking Self-Supervision for Stereoscopic Video Generationcited by 1
  35. 2026ExStereo: Lifting 2D Vision-Language-Action Models to 3D with Explicit Stereo Representationscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026DepthWorld: 3D World Model for Robot Manipulation
  2. 2026Robotic Manipulation is Vision-to-Geometry Mapping: Vision-Geometry Backbones over Language and Video Models
  3. 2026Robo3R: Enhancing Robotic Manipulation with Accurate Feed-Forward 3D Reconstruction
  4. 2026PointWorld: Scaling 3D World Models for In-The-Wild Robotic Manipulation
  5. 2026StereoPatch: Patch-Aligned RGB-Depth Fusion for Spatial Perception in Robot Manipulation
  6. 2024Manipulate-Anything: Automating Real-World Robots using Vision-Language Models
  7. 2025RoboTransfer: Controllable Geometry-Consistent Video Diffusion for Manipulation Policy Transfer
  8. 2025StereoPilot: Learning Unified and Efficient Stereo Conversion via Generative Priors