StereoEngine: Scaling Stereo Bimanual Robot Data without Stereo Cameras
New in Vision-language-action models; no direction yet. Vision-language-action models
Abstract (arXiv)
Stereo vision is increasingly used for robotic manipulation, with a growing body of work incorporating it into Vision-Language-Action (VLA) models. However, the scarcity of large-scale, real-world stereo datasets remains a fundamental bottleneck for scaling such policies. Recent generative monocular-to-stereo methods target settings such as VR content and autonomous driving. No prior work produces realistic synthetic stereo data for robotic manipulation, where stereo supervision has come predominantly from simulation. We propose StereoEngine, which introduces two complementary methods to synthesize stereo data for robotic manipulation. In the first, we warp a monocular (left) video into the right view using estimated depth and inpaint the disoccluded regions with a video diffusion model, lifting monocular demonstrations into stereo pairs without training on real stereo. In the second, we render a stereo pair in simulation and jointly generate both photorealistic views, producing consistent left-right data without any real video as input. StereoEngine outperforms existing baselines in generated stereo quality, and using its synthetic data for policy mid-training or task-specific fine-tuning substantially improves downstream bimanual manipulation. Project website: https://stereoengine.github.io
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 47 of its 56 references that are in the map. First posted on arXiv 8 Oct 2026.
Builds on
47 of 56 references.
References · 47
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
- 2026World Action Models are Zero-shot Policiescited by 465
- 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 327
- 2020Softmax Splatting for Video Frame Interpolationcited by 279
- 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 207
35 more
- 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Modelscited by 179
- 2023Scaling Robot Learning with Semantically Imagined Experiencecited by 177
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 173
- 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 138
- 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videoscited by 135
- 2025RoboCOIN: An Open-Sourced Bimanual Robotic Data Collection for Integrated Manipulationcited by 78
- 2016Deep3D: Fully Automatic 2D-to-3D Video Conversion with Deep Convolutional Neural Networkscited by 73
- 2025DemoGen: Synthetic Demonstration Generation for Data-Efficient Visuomotor Policy Learningcited by 69
- 2024ALOHA 2: An Enhanced Low-Cost Hardware for Bimanual Teleoperationcited by 63
- 2026MolmoAct2: Action Reasoning Models for Real-world Deploymentcited by 50
- 2025Novel Demonstration Generation with Gaussian Splatting Enables Robust One-Shot Manipulationcited by 48
- 2024Stereo Anywhere: Robust Zero-Shot Deep Stereo Matching Even Where Either Stereo or Mono Failcited by 47
- 2025Real2Render2Real: Scaling Robot Data Without Dynamics Simulation or Robot Hardwarecited by 44
- 2024StereoCrafter: Diffusion-based Generation of Long and High-fidelity Stereoscopic 3D from Monocular Videoscited by 37
- 2024StereoDiffusion: Training-Free Stereo Image Generation Using Latent Diffusion Modelscited by 25
- 2024SVG: 3D Stereoscopic Video Generation via Denoising Frame Matrixcited by 20
- 2025StereoVLA: Enhancing Vision-Language-Action Models with Stereo Visioncited by 18
- 2025Persistent Object Gaussian Splat (POGS) for Tracking Human and Robot Manipulation of Irregularly Shaped Objectscited by 15
- 2024D3RoMa: Disparity Diffusion-based Depth Sensing for Material-Agnostic Robotic Manipulationcited by 14
- 2024SpatialDreamer: Self-supervised Stereo Video Synthesis from Monocular Inputcited by 12
- 2025Mono2Stereo: A Benchmark and Empirical Study for Stereo Conversioncited by 10
- 2024ClearDepth: Enhanced Stereo Perception of Transparent Objects for Robotic Manipulationcited by 9
- 2026ActiveGlasses: Learning Manipulation with Active Vision from Ego-centric Human Demonstrationcited by 8
- 2025Restereo: Diffusion stereo video generation and restorationcited by 7
- 2024DissolveStereo: Coarse Depth Injection for Zero-Shot Stereo Video Generationcited by 6
- 2025Towards Open-World Generation of Stereo Images and Unsupervised Matchingcited by 6
- 2025D-CODA: Diffusion for Coordinated Dual-Arm Data Augmentationcited by 5
- 2026CRAFT: Video Diffusion for Bimanual Robot Data Generationcited by 4
- 2025ROPA: Synthetic Robot Pose Generation for RGB-D Bimanual Data Augmentationcited by 3
- 2025StereoWorld: Geometry-Aware Monocular-to-Stereo Video Generationcited by 3
- 2026StereoPolicy: Improving Robotic Manipulation Policies via Stereo Perceptioncited by 3
- 2026RoboDream: Compositional World Models for Scalable Robot Data Synthesiscited by 3
- 2025DiffuDepGrasp: Diffusion-based Depth Noise Modeling Empowers Sim2Real Robotic Graspingcited by 1
- 2026Geometric Reciprocity: Unlocking Self-Supervision for Stereoscopic Video Generationcited by 1
- 2026ExStereo: Lifting 2D Vision-Language-Action Models to 3D with Explicit Stereo Representationscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026DepthWorld: 3D World Model for Robot Manipulation
- 2026Robotic Manipulation is Vision-to-Geometry Mapping: Vision-Geometry Backbones over Language and Video Models
- 2026Robo3R: Enhancing Robotic Manipulation with Accurate Feed-Forward 3D Reconstruction
- 2026PointWorld: Scaling 3D World Models for In-The-Wild Robotic Manipulation
- 2026StereoPatch: Patch-Aligned RGB-Depth Fusion for Spatial Perception in Robot Manipulation
- 2024Manipulate-Anything: Automating Real-World Robots using Vision-Language Models
- 2025RoboTransfer: Controllable Geometry-Consistent Video Diffusion for Manipulation Policy Transfer
- 2025StereoPilot: Learning Unified and Efficient Stereo Conversion via Generative Priors