mlsanityData to 14 Oct 2026

MonoNeRF: Learning Generalizable NeRFs from Monocular Videos without Camera Pose

arXiv 2210.07181 ↗First posted 13 Oct 2022cs.CV cs.LG cs.ROcited by 10

Not on the map. Why?

Abstract (arXiv)

We propose a generalizable neural radiance fields - MonoNeRF, that can be trained on large-scale monocular videos of moving in static scenes without any ground-truth annotations of depth and camera poses. MonoNeRF follows an Autoencoder-based architecture, where the encoder estimates the monocular depth and the camera pose, and the decoder constructs a Multiplane NeRF representation based on the depth encoder feature, and renders the input frames with the estimated camera. The learning is supervised by the reconstruction error. Once the model is learned, it can be applied to multiple applications including depth estimation, camera pose estimation, and single-image novel view synthesis. More qualitative results are available at: https://oasisyang.github.io/mononerf .

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 76 of its 90 references that are in the map. First posted on arXiv 13 Oct 2022.

Builds on

76 of 90 references.

References · 76

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  5. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  6. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  7. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,584
  8. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
  9. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
  10. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,232
  11. 2021Volume Rendering of Neural Implicit Surfacescited by 996
  12. 2018MnasNet: Platform-Aware Neural Architecture Search for Mobilecited by 943
38 more
  1. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  2. 2016InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Netscited by 860
  3. 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 820
  4. 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
  5. 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 782
  6. 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 740
  7. 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
  8. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 703
  9. 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 700
  10. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 689
  11. 2021In-Place Scene Labelling and Understanding with Implicit Scene Representationcited by 415
  12. 2018DeepVoxels: Learning Persistent 3D Feature Embeddingscited by 405
  13. 2016Deeper Depth Prediction with Fully Convolutional Residual Networkscited by 403
  14. 2019SynSin: End-to-end View Synthesis from a Single Imagecited by 364
  15. 2017End-to-End Learning of Geometry and Context for Deep Stereo Regressioncited by 360
  16. 2018GeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Posecited by 342
  17. 2018Diverse Image-to-Image Translation via Disentangled Representationscited by 296
  18. 2019Learning Correspondence from the Cycle-Consistency of Timecited by 269
  19. 2020Single-View View Synthesis with Multiplane Imagescited by 263
  20. 2019DRIT++: Diverse Image-to-Image Translation via Disentangled Representationscited by 244
  21. 2020Space-Time Correspondence as a Contrastive Random Walkcited by 239
  22. 2020Learning to Recover 3D Scene Shape from a Single Imagecited by 216
  23. 2020Swapping Autoencoder for Deep Image Manipulationcited by 215
  24. 2020Atlas: End-to-End 3D Scene Reconstruction from Posed Imagescited by 206
  25. 2017Learning a Multi-View Stereo Machinecited by 194
  26. 2019Pushing the Boundaries of View Extrapolation with Multiplane Imagescited by 191
  27. 2021The Temporal Opportunist: Self-Supervised Multi-Frame Monocular Depthcited by 190
  28. 2020GRF: Learning a General Radiance Field for 3D Representation and Renderingcited by 183
  29. 2016Single-Image Depth Perception in the Wildcited by 180
  30. 2018Unsupervised Learning of Depth and Ego-Motion from Monocular Video Using 3D Geometric Constraintscited by 179
  31. 2017Multi-view Supervision for Single-view Reconstruction via Differentiable Ray Consistencycited by 177
  32. 2019Video Representation Learning by Dense Predictive Codingcited by 175
  33. 2016View Synthesis by Appearance Flowcited by 172
  34. 2019Depth from Videos in the Wild: Unsupervised Monocular Depth Learning from Unknown Camerascited by 170
  35. 2020Adversarial Latent Autoencoderscited by 155
  36. 2021GNeRF: GAN-based Neural Radiance Field without Posed Cameracited by 153
  37. 2017Unsupervised Learning of Disentangled Representations from Videocited by 139
  38. 2021NeRS: Neural Reflectance Surfaces for Sparse-view 3D Reconstruction in the Wildcited by 136

50 most cited of 76 All 76 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 4; 2024: 3; 2025: 2; 2026: 1.

10 papers.

  1. 2023COLMAP-Free 3D Gaussian Splattingcited by 193
  2. 2025RayZer: A Self-supervised Large View Synthesis Modelcited by 77
  3. 2024FlowMap: High-Quality Camera Poses, Intrinsics, and Depth via Gradient Descentcited by 61
  4. 2025E-RayZer: Self-supervised 3D Reconstruction as Spatial Visual Pre-trainingcited by 22
  5. 2024VDG: Vision-Only Dynamic Gaussian for Driving Simulationcited by 16
  6. 2023UpFusion: Novel View Diffusion from Unposed Sparse View Observationscited by 14
  7. 2023DyST: Towards Dynamic Neural Scene Representations on Real-World Videoscited by 11
  8. 2024MonoSelfRecon: Purely Self-Supervised Explicit Generalizable 3D Reconstruction of Indoor Scenes from Monocular RGB Viewscited by 6
  9. 2023Pose-Free Generalizable Rendering Transformercited by 4
  10. 2026Self-Improving 4D Perception via Self-Distillationcited by 4