Deep3D: Fully Automatic 2D-to-3D Video Conversion with Deep Convolutional Neural Networks
Not on the map. Why?
Abstract (arXiv)
As 3D movie viewing becomes mainstream and Virtual Reality (VR) market emerges, the demand for 3D contents is growing rapidly. Producing 3D videos, however, remains challenging. In this paper we propose to use deep neural networks for automatically converting 2D videos and images to stereoscopic 3D format. In contrast to previous automatic 2D-to-3D conversion algorithms, which have separate stages and need ground truth depth map as supervision, our approach is trained end-to-end directly on stereo pairs extracted from 3D movies. This novel training scheme makes it possible to exploit orders of magnitude more data and significantly increases performance. Indeed, Deep3D outperforms baselines in both quantitative and human subject evaluations.
Key facts. Cited by 72 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Apr 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 20; 2022: 17; 2023: 10; 2024: 9; 2025: 10; 2026: 6.
72 papers.
Sort:
By area:
- 2021The Temporal Opportunist: Self-Supervised Multi-Frame Monocular Depthcited by 190
- 2021MINE: Towards Continuous Depth MPI with NeRF for Novel View Synthesiscited by 133
- 2021Geometry-Free View Synthesis: Transformers and no 3D Priorscited by 99
- 2022LocalBins: Improving Depth Estimation by Learning Local Distributionscited by 92
- 2022OmniFusion: 360 Monocular Depth Estimation via Geometry-Aware Fusioncited by 60
- 2024StereoCrafter: Diffusion-based Generation of Long and High-fidelity Stereoscopic 3D from Monocular Videoscited by 36
- 2022BiFuse++: Self-supervised and Efficient Bi-projection Fusion for 360 Depth Estimationcited by 35
- 2023SCADE: NeRFs from Space Carving with Ambiguity-Aware Depth Estimatescited by 35
- 2021Attention meets Geometry: Geometry Guided Spatial-Temporal Attention for Consistent Self-Supervised Monocular Depth Estimationcited by 27
- 2023On the Importance of Accurate Geometry Data for Dense 3D Vision Taskscited by 26
- 2021Bridging Unsupervised and Supervised Depth from Focus via All-in-Focus Supervisioncited by 23
- 2024SVG: 3D Stereoscopic Video Generation via Denoising Frame Matrixcited by 19
38 more
- 2022Is my Depth Ground-Truth Good Enough? HAMMER -- Highly Accurate Multi-Modal Dataset for DEnse 3D Scene Regressioncited by 18
- 2023MACARONS: Mapping And Coverage Anticipation with RGB Online Self-Supervisioncited by 18
- 2022Depth Map Decomposition for Monocular Depth Estimationcited by 16
- 2024Deep Learning-based Depth Estimation Methods from Monocular Image and Videos: A Comprehensive Surveycited by 15
- 2021Stereo Matching by Self-supervision of Multiscopic Visioncited by 14
- 2021GCNDepth: Self-supervised Monocular Depth Estimation based on Graph Convolutional Networkcited by 12
- 2022Crafting Monocular Cues and Velocity Guidance for Self-Supervised Multi-Frame Depth Learningcited by 12
- 2022A Survey on RGB-D Datasetscited by 11
- 2022Semi-Supervised Learning with Mutual Distillation for Monocular Depth Estimationcited by 10
- 2022CroMo: Cross-Modal Learning for Monocular Depth Estimationcited by 10
- 2025M2SVid: End-to-End Inpainting and Refinement for Monocular-to-Stereo Video Conversioncited by 10
- 2025Mono2Stereo: A Benchmark and Empirical Study for Stereo Conversioncited by 9
- 2021Unsupervised Novel View Synthesis from a Single Imagecited by 8
- 2022Visual Attention-based Self-supervised Absolute Depth Estimation using Geometric Priors in Autonomous Drivingcited by 8
- 2024ImmersePro: End-to-End Stereo Video Synthesis Via Implicit Disparity Learningcited by 8
- 2021On the Sins of Image Synthesis Loss for Self-supervised Depth Estimationcited by 7
- 2024DurLAR: A High-fidelity 128-channel LiDAR Dataset with Panoramic Ambient and Reflectivity Imagery for Multi-modal Autonomous Driving Applicationscited by 7
- 2022Pyramid Frequency Network with Spatial Attention Residual Refinement Module for Monocular Depth Estimationcited by 6
- 2025Eye2Eye: A Simple Approach for Monocular-to-Stereo Video Synthesiscited by 6
- 2021Advancing Autonomous Driving: DepthSense with Radar and Spatial Attentioncited by 5
- 2023Virtual Occlusions Through Implicit Depthcited by 5
- 2024DissolveStereo: Coarse Depth Injection for Zero-Shot Stereo Video Generationcited by 5
- 2021Traffic-Net: 3D Traffic Monitoring Using a Single Cameracited by 4
- 2023Single-View View Synthesis with Self-Rectified Pseudo-Stereocited by 4
- 2021Weakly-Supervised Monocular Depth Estimationwith Resolution-Mismatched Datacited by 3
- 2021Multi-View Motion Synthesis via Applying Rotated Dual-Pixel Blur Kernelscited by 3
- 2022Creating a Forensic Database of Shoeprints from Online Shoe Tread Photoscited by 3
- 2022How Far Can I Go ? : A Self-Supervised Approach for Deterministic Video Depth Forecastingcited by 3
- 2024Less Cybersickness, Please: Demystifying and Detecting Stereoscopic Visual Inconsistencies in Virtual Reality Appscited by 3
- 2025DMS:Diffusion-Based Multi-Baseline Stereo Generation for Improving Self-Supervised Depth Estimationcited by 3
- 2025Elastic3D: Controllable Stereo Video Conversion with Guided Latent Decodingcited by 3
- 2025StereoPilot: Learning Unified and Efficient Stereo Conversion via Generative Priorscited by 3
- 2022Self-supervised 360circ Room Layout Estimationcited by 2
- 2022Efficient Stereo Depth Estimation for Pseudo LiDAR: A Self-Supervised Approach Based on Multi-Input ResNet Encodercited by 2
- 2022Positional Information is All You Need: A Novel Pipeline for Self-Supervised SVDE from Videoscited by 2
- 2023Learning Internal Representations of 3D Transformations from 2D Projected Inputscited by 2
- 2023LoLep: Single-View View Synthesis with Locally-Learned Planes and Self-Attention Occlusion Inferencecited by 2
- 2023ADU-Depth: Attention-based Distillation with Uncertainty Modeling for Depth Estimationcited by 2
50 most cited of 72 All 72 (JSON)
- 2026Faithfulness to Refusal: A Causal Audit of Neuron Selectors6 Jul 2026
- 2026αDepth: Learning Single-Pass Soft Boundary Decomposition for Stereo Conversion29 May 2026
- 2026StereoGenBench: A Synthetic Multi-Camera Benchmark for Stereo Generation under Controlled Baseline Regimes22 May 2026
- 2026DreamStereo: Towards Real-Time Stereo Inpainting for HD Videos14 Apr 2026
- 2026Beyond Geometry: Artistic Disparity Synthesis for Immersive 2D-to-3D6 Mar 2026
- 2026Guardians of the Hair: Rescuing Soft Boundaries in Depth, Stereo, and Novel Views6 Jan 2026
- 2025StereoPilot: Learning Unified and Efficient Stereo Conversion via Generative Priors18 Dec 2025
- 2025Elastic3D: Controllable Stereo Video Conversion with Guided Latent Decoding16 Dec 2025
- 2025StereoSpace: Depth-Free Synthesis of Stereo Geometry via End-to-End Diffusion in a Canonical Space11 Dec 2025
- 2025BoRe-Depth: Self-supervised Monocular Depth Estimation with Boundary Refinement for Embedded Systems6 Nov 2025
- 2025DMS:Diffusion-Based Multi-Baseline Stereo Generation for Improving Self-Supervised Depth Estimation18 Aug 2025
- 2025S^2VG: 3D Stereoscopic and Spatial Video Generation via Denoising Frame Matrix11 Aug 2025
38 more
- 2025Perfecting Depth: Uncertainty-Aware Enhancement of Metric Depth5 Jun 2025
- 2025M2SVid: End-to-End Inpainting and Refinement for Monocular-to-Stereo Video Conversion22 May 2025
- 2025Eye2Eye: A Simple Approach for Monocular-to-Stereo Video Synthesis30 Apr 2025
- 2025Mono2Stereo: A Benchmark and Empirical Study for Stereo Conversion28 Mar 2025
- 2024DissolveStereo: Coarse Depth Injection for Zero-Shot Stereo Video Generation21 Nov 2024
- 2024ImmersePro: End-to-End Stereo Video Synthesis Via Implicit Disparity Learning30 Sep 2024
- 2024Development and Application of a Sentinel-2 Satellite Imagery Dataset for Deep-Learning Driven Forest Wildfire Detection24 Sep 2024
- 2024StereoCrafter: Diffusion-based Generation of Long and High-fidelity Stereoscopic 3D from Monocular Videos11 Sep 2024
- 2024SVG: 3D Stereoscopic Video Generation via Denoising Frame Matrix29 Jun 2024
- 2024Deep Learning-based Depth Estimation Methods from Monocular Image and Videos: A Comprehensive Survey28 Jun 2024
- 2024DurLAR: A High-fidelity 128-channel LiDAR Dataset with Panoramic Ambient and Reflectivity Imagery for Multi-modal Autonomous Driving Applications14 Jun 2024
- 2024Less Cybersickness, Please: Demystifying and Detecting Stereoscopic Visual Inconsistencies in Virtual Reality Apps13 Jun 2024
- 2024Consistency Regularisation for Unsupervised Domain Adaptation in Monocular Depth Estimation27 May 2024
- 2023Novel View Synthesis with View-Dependent Effects from a Single Image13 Dec 2023
- 2023ADU-Depth: Attention-based Distillation with Uncertainty Modeling for Depth Estimation26 Sep 2023
- 2023LoLep: Single-View View Synthesis with Locally-Learned Planes and Self-Attention Occlusion Inference23 Jul 2023
- 2023SVDM: Single-View Diffusion Model for Pseudo-Stereo 3D Object Detection5 Jul 2023
- 2023Virtual Occlusions Through Implicit Depth11 May 2023
- 2023Single-View View Synthesis with Self-Rectified Pseudo-Stereo19 Apr 2023
- 2023Learning Internal Representations of 3D Transformations from 2D Projected Inputs31 Mar 2023
- 2023On the Importance of Accurate Geometry Data for Dense 3D Vision Tasks26 Mar 2023
- 2023SCADE: NeRFs from Space Carving with Ambiguity-Aware Depth Estimates23 Mar 2023
- 2023MACARONS: Mapping And Coverage Anticipation with RGB Online Self-Supervision6 Mar 2023
- 2022MaskingDepth: Masked Consistency Regularization for Semi-supervised Monocular Depth Estimation21 Dec 2022
- 2022BiFuse++: Self-supervised and Efficient Bi-projection Fusion for 360 Depth Estimation7 Sep 2022
- 2022Depth Map Decomposition for Monocular Depth Estimation23 Aug 2022
- 2022Crafting Monocular Cues and Velocity Guidance for Self-Supervised Multi-Frame Depth Learning19 Aug 2022
- 2022How Far Can I Go ? : A Self-Supervised Approach for Deterministic Video Depth Forecasting1 Jul 2022
- 2022Positional Information is All You Need: A Novel Pipeline for Self-Supervised SVDE from Videos18 May 2022
- 2022Visual Attention-based Self-supervised Absolute Depth Estimation using Geometric Priors in Autonomous Driving18 May 2022
- 2022Efficient Stereo Depth Estimation for Pseudo LiDAR: A Self-Supervised Approach Based on Multi-Input ResNet Encoder17 May 2022
- 2022Is my Depth Ground-Truth Good Enough? HAMMER -- Highly Accurate Multi-Modal Dataset for DEnse 3D Scene Regression9 May 2022
- 2022Creating a Forensic Database of Shoeprints from Online Shoe Tread Photos4 May 2022
- 2022Pyramid Frequency Network with Spatial Attention Residual Refinement Module for Monocular Depth Estimation5 Apr 2022
- 2022Self-supervised 360circ Room Layout Estimation30 Mar 2022
- 2022LocalBins: Improving Depth Estimation by Learning Local Distributions28 Mar 2022
- 2022CroMo: Cross-Modal Learning for Monocular Depth Estimation23 Mar 2022
- 2022Semi-Supervised Learning with Mutual Distillation for Monocular Depth Estimation18 Mar 2022
50 newest of 72 All 72 (JSON)
- 2024StereoCrafter: Diffusion-based Generation of Long and High-fidelity Stereoscopic 3D from Monocular Videoscited by 36
- 2024DissolveStereo: Coarse Depth Injection for Zero-Shot Stereo Video Generationcited by 5
- 2025DMS:Diffusion-Based Multi-Baseline Stereo Generation for Improving Self-Supervised Depth Estimationcited by 3
- 2023SVDM: Single-View Diffusion Model for Pseudo-Stereo 3D Object Detectioncited by 0
- 2025DMS:Diffusion-Based Multi-Baseline Stereo Generation for Improving Self-Supervised Depth Estimation18 Aug 2025
- 2024DissolveStereo: Coarse Depth Injection for Zero-Shot Stereo Video Generation21 Nov 2024
- 2024StereoCrafter: Diffusion-based Generation of Long and High-fidelity Stereoscopic 3D from Monocular Videos11 Sep 2024
- 2023SVDM: Single-View Diffusion Model for Pseudo-Stereo 3D Object Detection5 Jul 2023
- 2021The Temporal Opportunist: Self-Supervised Multi-Frame Monocular Depthcited by 190
- 2021MINE: Towards Continuous Depth MPI with NeRF for Novel View Synthesiscited by 133
- 2021Geometry-Free View Synthesis: Transformers and no 3D Priorscited by 99
- 2022LocalBins: Improving Depth Estimation by Learning Local Distributionscited by 92
- 2022OmniFusion: 360 Monocular Depth Estimation via Geometry-Aware Fusioncited by 60
- 2022BiFuse++: Self-supervised and Efficient Bi-projection Fusion for 360 Depth Estimationcited by 35
- 2023SCADE: NeRFs from Space Carving with Ambiguity-Aware Depth Estimatescited by 35
- 2021Attention meets Geometry: Geometry Guided Spatial-Temporal Attention for Consistent Self-Supervised Monocular Depth Estimationcited by 27
- 2023On the Importance of Accurate Geometry Data for Dense 3D Vision Taskscited by 26
- 2021Bridging Unsupervised and Supervised Depth from Focus via All-in-Focus Supervisioncited by 23
- 2024SVG: 3D Stereoscopic Video Generation via Denoising Frame Matrixcited by 19
- 2022Is my Depth Ground-Truth Good Enough? HAMMER -- Highly Accurate Multi-Modal Dataset for DEnse 3D Scene Regressioncited by 18
12 most cited of 68 All 68 (JSON)
- 2026Faithfulness to Refusal: A Causal Audit of Neuron Selectors6 Jul 2026
- 2026αDepth: Learning Single-Pass Soft Boundary Decomposition for Stereo Conversion29 May 2026
- 2026StereoGenBench: A Synthetic Multi-Camera Benchmark for Stereo Generation under Controlled Baseline Regimes22 May 2026
- 2026DreamStereo: Towards Real-Time Stereo Inpainting for HD Videos14 Apr 2026
- 2026Beyond Geometry: Artistic Disparity Synthesis for Immersive 2D-to-3D6 Mar 2026
- 2026Guardians of the Hair: Rescuing Soft Boundaries in Depth, Stereo, and Novel Views6 Jan 2026
- 2025StereoPilot: Learning Unified and Efficient Stereo Conversion via Generative Priors18 Dec 2025
- 2025Elastic3D: Controllable Stereo Video Conversion with Guided Latent Decoding16 Dec 2025
- 2025StereoSpace: Depth-Free Synthesis of Stereo Geometry via End-to-End Diffusion in a Canonical Space11 Dec 2025
- 2025BoRe-Depth: Self-supervised Monocular Depth Estimation with Boundary Refinement for Embedded Systems6 Nov 2025
- 2025S^2VG: 3D Stereoscopic and Spatial Video Generation via Denoising Frame Matrix11 Aug 2025
- 2025Perfecting Depth: Uncertainty-Aware Enhancement of Metric Depth5 Jun 2025
12 newest of 68 All 68 (JSON)