StereoPilot: Learning Unified and Efficient Stereo Conversion via Generative Priors
Not on the map. Why?
Abstract (arXiv)
The rapid growth of stereoscopic displays, including VR headsets and 3D cinemas, has led to increasing demand for high-quality stereo video content. However, producing 3D videos remains costly and complex, while automatic Monocular-to-Stereo conversion is hindered by the limitations of the multi-stage ``Depth-Warp-Inpaint'' (DWI) pipeline. This paradigm suffers from error propagation, depth ambiguity, and format inconsistency between parallel and converged stereo configurations. To address these challenges, we introduce UniStereo, the first large-scale unified dataset for stereo video conversion, covering both stereo formats to enable fair benchmarking and robust model training. Building upon this dataset, we propose StereoPilot, an efficient feed-forward model that directly synthesizes the target view without relying on explicit depth maps or iterative diffusion sampling. Equipped with a learnable domain switcher and a cycle consistency loss, StereoPilot adapts seamlessly to different stereo formats and achieves improved consistency. Extensive experiments demonstrate that StereoPilot significantly outperforms state-of-the-art methods in both visual fidelity and computational efficiency. Project page: https://hit-perfect.github.io/StereoPilot/.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 43 of its 54 references that are in the map. First posted on arXiv 18 Dec 2025.
Builds on
43 of 54 references.
References · 43
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2024Depth Anything V2cited by 1,422
- 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 861
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
31 more
- 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 575
- 2018Pyramid Stereo Matching Networkcited by 489
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 460
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 432
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
- 2024ShareGPT4Video: Improving Video Understanding and Generation with Better Captionscited by 388
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 341
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 287
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 173
- 2024Lotus: Diffusion-based Visual Foundation Model for High-quality Dense Predictioncited by 166
- 2023NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Imagescited by 163
- 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Modelscited by 161
- 2024VD3D: Taming Large Video Diffusion Transformers for 3D Camera Controlcited by 156
- 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 154
- 2023DynamicStereo: Consistent Dynamic Depth from Stereo Videoscited by 148
- 2024DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusioncited by 140
- 2025CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Modelscited by 98
- 2024Stereo4D: Learning How Things Move in 3D from Internet Stereo Videoscited by 89
- 2024Fine-Tuning Image-Conditional Diffusion Models is Easier than You Thinkcited by 83
- 2016Deep3D: Fully Automatic 2D-to-3D Video Conversion with Deep Convolutional Neural Networkscited by 73
- 2023Ref-NeuS: Ambiguity-Reduced Neural Implicit Surface Learning for Multi-View Reconstruction with Reflectioncited by 69
- 2025CamCloneMaster: Enabling Reference-based Camera Control for Video Generationcited by 46
- 2024StereoCrafter: Diffusion-based Generation of Long and High-fidelity Stereoscopic 3D from Monocular Videoscited by 37
- 2025EX-4D: EXtreme Viewpoint 4D Video Synthesis via Depth Watertight Meshcited by 32
- 2024StereoDiffusion: Training-Free Stereo Image Generation Using Latent Diffusion Modelscited by 25
- 2024Match-Stereo-Videos: Bidirectional Alignment for Consistent Dynamic Stereo Matchingcited by 24
- 2024SVG: 3D Stereoscopic Video Generation via Denoising Frame Matrixcited by 20
- 2024SpatialDreamer: Self-supervised Stereo Video Synthesis from Monocular Inputcited by 12
- 2025Mono2Stereo: A Benchmark and Empirical Study for Stereo Conversioncited by 10
- 2025M2SVid: End-to-End Inpainting and Refinement for Monocular-to-Stereo Video Conversioncited by 10
- 2025Eye2Eye: A Simple Approach for Monocular-to-Stereo Video Synthesiscited by 6
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026UniFixer: A Universal Reference-Guided Fixer for Diffusion-Based View Synthesiscited by 0
- 2026StereoGenBench: A Synthetic Multi-Camera Benchmark for Stereo Generation under Controlled Baseline Regimescited by 0
- 2026αDepth: Learning Single-Pass Soft Boundary Decomposition for Stereo Conversioncited by 0
- 2026αDepth: Learning Single-Pass Soft Boundary Decomposition for Stereo Conversion29 May 2026
- 2026StereoGenBench: A Synthetic Multi-Camera Benchmark for Stereo Generation under Controlled Baseline Regimes22 May 2026
- 2026UniFixer: A Universal Reference-Guided Fixer for Diffusion-Based View Synthesis12 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Stereo World Model: Camera-Guided Stereo Video Generation
- 2024DissolveStereo: Coarse Depth Injection for Zero-Shot Stereo Video Generation
- 2025Restereo: Diffusion stereo video generation and restoration
- 2025MV-Performer: Taming Video Diffusion Model for Faithful and Synchronized Multi-view Performer Synthesis
- 2025Elastic3D: Controllable Stereo Video Conversion with Guided Latent Decoding
- 2026StereoEngine: Scaling Stereo Bimanual Robot Data without Stereo Cameras
- 2025StereoDiff: Stereo-Diffusion Synergy for Video Depth Estimation
- 2026OrbitNVS: Harnessing Video Diffusion Priors for Novel View Synthesis