mlsanityData to 7 Oct 2026

DINER: Depth-aware Image-based NEural Radiance fields

arXiv 2211.16630 ↗First posted 29 Nov 2022cs.CVcited by 19

Not on the map. Why?

Abstract (arXiv)

We present Depth-aware Image-based NEural Radiance fields (DINER). Given a sparse set of RGB input views, we predict depth and feature maps to guide the reconstruction of a volumetric scene representation that allows us to render 3D objects under novel views. Specifically, we propose novel techniques to incorporate depth information into feature fusion and efficient scene sampling. In comparison to the previous state of the art, DINER achieves higher synthesis quality and can process input views with greater disparity. This allows us to capture scenes more completely without changing capturing hardware requirements and ultimately enables larger viewpoint changes during novel view synthesis. We evaluate our method by synthesizing novel views, both for human heads and for general objects, and observe significantly improved qualitative results and increased perceptual metrics compared to the previous state of the art. The code is publicly available for research purposes.

Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 52 of its 65 references that are in the map. First posted on arXiv 29 Nov 2022.

Builds on

52 of 65 references.

References · 52

  1. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  2. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  3. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  4. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
  5. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  6. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  7. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
  8. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
  9. 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
  10. 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
  11. 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 720
  12. 2020First Order Motion Model for Image Animationcited by 698
38 more
  1. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
  2. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
  3. 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
  4. 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 510
  5. 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
  6. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  7. 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 475
  8. 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 465
  9. 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 438
  10. 2021NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Imagescited by 336
  11. 2021Dense Depth Priors for Neural Radiance Fields from Sparse Input Viewscited by 301
  12. 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
  13. 2020State of the Art on Neural Renderingcited by 276
  14. 2018Deep Video Portraitscited by 265
  15. 2021Urban Radiance Fieldscited by 263
  16. 2019Deferred Neural Rendering: Image Synthesis using Neural Texturescited by 253
  17. 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 230
  18. 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
  19. 2021Scene Representation Transformer: Geometry-Free Novel View Synthesis Through Set-Latent Scene Representationscited by 222
  20. 2021Neural Head Avatars from Monocular RGB Videoscited by 212
  21. 2021HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fieldscited by 210
  22. 2020FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Predictioncited by 196
  23. 2021Neural Rays for Occlusion-aware Image-based Renderingcited by 192
  24. 2019Neural Volumes: Learning Dynamic Renderable Volumes from Imagescited by 173
  25. 2022ARAH: Animatable Volume Rendering of Articulated Human SDFscited by 139
  26. 2022MegaPortraits: One-shot Megapixel Neural Head Avatarscited by 131
  27. 2022Generalizable Patch-Based Neural Renderingcited by 121
  28. 2022Realistic One-shot Mesh-based Head Avatarscited by 119
  29. 2021TransMVSNet: Global Context-aware Multi-view Stereo Network with Transformerscited by 117
  30. 2020Fast Bi-layer Neural Synthesis of One-Shot Realistic Head Avatarscited by 116
  31. 2022EfficientNeRF: Efficient Neural Radiance Fieldscited by 110
  32. 2022Multiface: A Dataset for Neural Face Renderingcited by 87
  33. 2021H3D-Net: Few-Shot High-Fidelity 3D Head Reconstructioncited by 81
  34. 2020Learning Compositional Radiance Fields of Dynamic Human Headscited by 78
  35. 2022KeypointNeRF: Generalizing Image-based Volumetric Avatars using Relative Spatial Encoding of Keypointscited by 77
  36. 2021StylePeople: A Generative Model of Fullbody Human Avatarscited by 62
  37. 2022Neural Strands: Learning Hair Geometry and Appearance from Multi-View Imagescited by 39
  38. 2022VolTeMorph: Realtime, Controllable and Generalisable Animation of Volumetric Representationscited by 36

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 5; 2024: 10; 2025: 3; 2026: 1.

19 papers.

Sort:

By area:

  1. 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 172
  2. 2023Drivable 3D Gaussian Avatarscited by 120
  3. 2023Preface: A Data-driven Volumetric Prior for Few-shot Ultra High-resolution Face Synthesiscited by 37
  4. 2024Morphable Diffusion: 3D-Consistent Diffusion for Single-image Avatar Creationcited by 23
  5. 2024Gaussian Eigen Models for Human Headscited by 21
  6. 2024One2Avatar: Generative Implicit Head Avatar For Few-shot User Adaptationcited by 14
  7. 2025Synthetic Prior for Few-Shot Drivable Head Avatar Inversioncited by 14
  8. 2024CVT-xRF: Contrastive In-Voxel Transformer for 3D Consistent Radiance Fields from Sparse Inputscited by 13
  9. 2024Few-shot Novel View Synthesis using Depth Aware 3D Gaussian Splattingcited by 10
  10. 2023Global Latent Neural Renderingcited by 9
  11. 2024SplatFace: Gaussian Splat Face Reconstruction Leveraging an Optimizable Surfacecited by 7
  12. 2024SAID-NeRF: Segmentation-AIDed NeRF for Depth Completion of Transparent Objectscited by 5
7 more
  1. 2024HashPoint: Accelerated Point Searching and Sampling for Neural Renderingcited by 4
  2. 2024Generalizable Neural Human Renderercited by 3
  3. 2023Reducing Shape-Radiance Ambiguity in Radiance Fields with a Closed-Form Color Estimation Methodcited by 2
  4. 2024Depth-guided NeRF Training via Earth Mover's Distancecited by 2
  5. 2025TalkingPose: Efficient Face and Gesture Animation with Feedback-guided Diffusion Modelcited by 2
  6. 2026Feed-forward Gaussian Registration for Head Avatar Creation and Editingcited by 1
  7. 2025Multi-view dense image matching with similarity learning and geometry priorscited by 0