mlsanityData to 7 Oct 2026

Free View Synthesis

arXiv 2008.05511 ↗First posted 12 Aug 2020cs.CVcited by 231

Not on the map. Why?

Abstract (arXiv)

We present a method for novel view synthesis from input images that are freely distributed around a scene. Our method does not rely on a regular arrangement of input views, can synthesize images for free camera movement through the scene, and works for general scenes with unconstrained geometric layouts. We calibrate the input images via SfM and erect a coarse geometric scaffold via MVS. This scaffold is used to create a proxy depth map for a novel view of the scene. Based on this depth map, a recurrent encoder-decoder network processes reprojected features from nearby views and synthesizes the new view. Our network does not need to be optimized for a given scene. After training on a dataset, it works in previously unseen environments with no fine-tuning or per-scene optimization. We evaluate the presented approach on challenging real-world datasets, including Tanks and Temples, where we demonstrate successful view synthesis for the first time and substantially outperform prior and concurrent work.

Key facts. Cited by 231 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Aug 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 56; 2022: 52; 2023: 58; 2024: 43; 2025: 19; 2026: 3.

231 papers.

Sort:

By area:

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  2. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  3. 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 720
  4. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
  5. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
  6. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
  7. 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
  8. 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 611
  9. 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 570
  10. 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 569
  11. 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
  12. 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
38 more
  1. 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 369
  2. 2021NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Imagescited by 336
  3. 2021Dense Depth Priors for Neural Radiance Fields from Sparse Input Viewscited by 301
  4. 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 294
  5. 2023Generative Novel View Synthesis with 3D-Aware Diffusion Modelscited by 273
  6. 2022Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representationcited by 243
  7. 2022NoPe-NeRF: Optimising Neural Radiance Field with No Pose Priorcited by 235
  8. 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
  9. 2021Editing Conditional Radiance Fieldscited by 222
  10. 2024A Survey on 3D Gaussian Splattingcited by 221
  11. 2023BakedSDF: Meshing Neural SDFs for Real-Time View Synthesiscited by 220
  12. 2022NeRF-Editing: Geometry Editing of Neural Radiance Fieldscited by 216
  13. 2023Robust Dynamic Radiance Fieldscited by 193
  14. 2023COLMAP-Free 3D Gaussian Splattingcited by 193
  15. 2021Neural Rays for Occlusion-aware Image-based Renderingcited by 192
  16. 2021NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereocited by 191
  17. 2021Stereo Radiance Fields (SRF): Learning View Synthesis for Sparse Views of Novel Scenescited by 190
  18. 2021Point-Based Neural Rendering with Per-View Optimizationcited by 188
  19. 20244D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenescited by 185
  20. 2023HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Samplingcited by 173
  21. 2023GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesiscited by 170
  22. 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
  23. 2021H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motioncited by 157
  24. 2021NeRF--: Neural Radiance Fields Without Known Camera Parameterscited by 155
  25. 2021Efficient Neural Radiance Fields for Interactive Free-viewpoint Videocited by 150
  26. 2021BACON: Band-limited Coordinate Networks for Multiscale Scene Representationcited by 142
  27. 2022NeuMesh: Learning Disentangled Neural Mesh-based Implicit Field for Geometry and Texture Editingcited by 141
  28. 2022StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learningcited by 140
  29. 20243D Gaussian Ray Tracing: Fast Tracing of Particle Scenescited by 138
  30. 2021NeRS: Neural Reflectance Surfaces for Sparse-view 3D Reconstruction in the Wildcited by 136
  31. 2021Unconstrained Scene Generation with Locally Conditioned Radiance Fieldscited by 130
  32. 2021Hallucinated Neural Radiance Fields in the Wildcited by 130
  33. 2024Reducing the Memory Footprint of 3D Gaussian Splattingcited by 129
  34. 2023CompGS: Smaller and Faster Gaussian Splatting with Vector Quantizationcited by 127
  35. 2022Mixed Neural Voxels for Fast Multi-view Video Synthesiscited by 126
  36. 2022Neural 3D Scene Reconstruction with the Manhattan-world Assumptioncited by 123
  37. 2021NeRFReN: Neural Radiance Fields with Reflectionscited by 121
  38. 2022Generalizable Patch-Based Neural Renderingcited by 121

50 most cited of 231 All 231 (JSON)