mlsanityData to 7 Oct 2026

IBRNet: Learning Multi-View Image-Based Rendering

arXiv 2102.13090 ↗First posted 25 Feb 2021cs.CVcited by 698

Not on the map. Why?

Cited by 49 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We present a method that synthesizes novel views of complex scenes by interpolating a sparse set of nearby views. The core of our method is a network architecture that includes a multilayer perceptron and a ray transformer that estimates radiance and volume density at continuous 5D locations (3D spatial locations and 2D viewing directions), drawing appearance information on the fly from multiple source views. By drawing on source views at render time, our method hearkens back to classic work on image-based rendering (IBR), and allows us to render high-resolution imagery. Unlike neural scene representation work that optimizes per-scene functions for rendering, we learn a generic view interpolation function that generalizes to novel scenes. We render images using classic volume rendering, which is fully differentiable and allows us to train using only multi-view posed images as supervision. Experiments show that our method outperforms recent novel view synthesis methods that also seek to generalize to novel scenes. Further, if fine-tuned on each scene, our method is competitive with state-of-the-art single-scene neural rendering methods. Project page: https://ibrnet.github.io/

Key facts. Cited by 698 papers in the map (data through 7 Oct 2026). Builds on 43 of its 77 references that are in the map. First posted on arXiv 25 Feb 2021.

Builds on

43 of 77 references.

References · 43

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  5. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  6. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  7. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  8. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  9. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  10. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
  11. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
  12. 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,187
31 more
  1. 2020Neural Sparse Voxel Fieldscited by 959
  2. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  3. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  4. 2020Convolutional Occupancy Networkscited by 760
  5. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
  6. 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 699
  7. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
  8. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
  9. 2020NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesiscited by 493
  10. 2019Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoningcited by 420
  11. 2018DeepVoxels: Learning Persistent 3D Feature Embeddingscited by 401
  12. 2020Local Implicit Grid Representations for 3D Scenescited by 372
  13. 2019DISN: Deep Implicit Surface Network for High-quality Single-view 3D Reconstructioncited by 332
  14. 2019Neural Point-Based Graphicscited by 326
  15. 2019DeepView: View Synthesis with Learned Gradient Descentcited by 253
  16. 2020Free View Synthesiscited by 231
  17. 2019Learning to Predict 3D Objects with an Interpolation-based Differentiable Renderercited by 221
  18. 2018Stereo Magnification: Learning View Synthesis using Multiplane Imagescited by 206
  19. 2017Learning a Multi-View Stereo Machinecited by 194
  20. 2019Pushing the Boundaries of View Extrapolation with Multiplane Imagescited by 191
  21. 2015DeepStereo: Learning to Predict New Views from the World's Imagerycited by 185
  22. 2019DIST: Rendering Deep Implicit Signed Distance Function with Differentiable Sphere Tracingcited by 179
  23. 2017Multi-view Supervision for Single-view Reconstruction via Differentiable Ray Consistencycited by 177
  24. 2019SDFDiff: Differentiable Rendering of Signed Distance Fields for 3D Shape Optimizationcited by 159
  25. 2016Learning-Based View Synthesis for Light Field Camerascited by 145
  26. 2019Neural Rerendering in the Wildcited by 121
  27. 2019Controlling Neural Level Setscited by 76
  28. 2019Revealing Scenes by Inverting Structure from Motion Reconstructionscited by 66
  29. 2020Crowdsampling the Plenoptic Functioncited by 62
  30. 2019Learning a Neural 3D Texture Space from 2D Exemplarscited by 53
  31. 2020Adversarial Texture Optimization from RGB-D Scanscited by 30

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 49; 2022: 130; 2023: 219; 2024: 151; 2025: 86; 2026: 63.

698 papers.

Sort:

By area:

  1. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  2. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  3. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
  4. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
  5. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  6. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
  7. 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
  8. 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
  9. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
  10. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
  11. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
  12. 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
38 more
  1. 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 596
  2. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
  3. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
  4. 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
  5. 2021Neural Fields in Visual Computing and Beyondcited by 539
  6. 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
  7. 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 485
  8. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  9. 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 465
  10. 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
  11. 2021Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughscited by 396
  12. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
  13. 2021Advances in Neural Renderingcited by 365
  14. 2023Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fieldscited by 361
  15. 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 359
  16. 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 344
  17. 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 344
  18. 2021NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Imagescited by 336
  19. 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
  20. 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
  21. 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 317
  22. 2021Neural RGB-D Surface Reconstructioncited by 312
  23. 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 305
  24. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 298
  25. 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 278
  26. 2023Generative Novel View Synthesis with 3D-Aware Diffusion Modelscited by 273
  27. 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 241
  28. 2022NoPe-NeRF: Optimising Neural Radiance Field with No Pose Priorcited by 235
  29. 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 234
  30. 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
  31. 2021Scene Representation Transformer: Geometry-Free Novel View Synthesis Through Set-Latent Scene Representationscited by 222
  32. 2023MVImgNet: A Large-scale Dataset of Multi-view Imagescited by 219
  33. 2022NeRF-Editing: Geometry Editing of Neural Radiance Fieldscited by 216
  34. 2022SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstructioncited by 216
  35. 2023DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Modelcited by 213
  36. 2021Neural-PIL: Neural Pre-Integrated Lighting for Reflectance Decompositioncited by 204
  37. 2022DiffRF: Rendering-Guided 3D Radiance Field Diffusioncited by 204
  38. 2021GeoNeRF: Generalizing NeRF with Geometry Priorscited by 195

50 most cited of 698 All 698 (JSON)