mlsanityData to 14 Oct 2026

CaesarNeRF: Calibrated Semantic Representation for Few-shot Generalizable Neural Rendering

arXiv 2311.15510 ↗First posted 27 Nov 2023cs.CVcited by 10

Not on the map. Why?

Abstract (arXiv)

Generalizability and few-shot learning are key challenges in Neural Radiance Fields (NeRF), often due to the lack of a holistic understanding in pixel-level rendering. We introduce CaesarNeRF, an end-to-end approach that leverages scene-level CAlibratEd SemAntic Representation along with pixel-level representations to advance few-shot, generalizable neural rendering, facilitating a holistic understanding without compromising high-quality details. CaesarNeRF explicitly models pose differences of reference views to combine scene-level semantic representations, providing a calibrated holistic understanding. This calibration process aligns various viewpoints with precise location and is further enhanced by sequential refinement to capture varying details. Extensive experiments on public datasets, including LLFF, Shiny, mip-NeRF 360, and MVImgNet, show that CaesarNeRF delivers state-of-the-art performance across varying numbers of reference views, proving effective even with a single reference image.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 74 of its 87 references that are in the map. First posted on arXiv 27 Nov 2023.

Builds on

74 of 87 references.

References · 74

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  6. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  7. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
  8. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  9. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,584
  10. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  11. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  12. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
38 more
  1. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,232
  2. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
  3. 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 788
  4. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 746
  5. 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 740
  6. 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 735
  7. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 703
  8. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 689
  9. 2019Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelinescited by 672
  10. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
  11. 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 615
  12. 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 612
  13. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  14. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  15. 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
  16. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  17. 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
  18. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
  19. 2023FreeNeRF: Improving Few-shot Neural Rendering with Free Frequency Regularizationcited by 311
  20. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
  21. 2021Dense Depth Priors for Neural Radiance Fields from Sparse Input Viewscited by 302
  22. 20223D Neural Field Generation using Triplane Diffusioncited by 274
  23. 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
  24. 2021BungeeNeRF: Progressive Neural Radiance Field for Extreme Multi-scale Scene Renderingcited by 229
  25. 2021Learning Object-Compositional Neural Radiance Field for Editable Scene Renderingcited by 228
  26. 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
  27. 2023MVImgNet: A Large-scale Dataset of Multi-view Imagescited by 220
  28. 2021NeX: Real-time View Synthesis with Neural Basis Expansioncited by 216
  29. 2022SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstructioncited by 216
  30. 2021Neural Articulated Radiance Fieldcited by 196
  31. 2021GeoNeRF: Generalizing NeRF with Geometry Priorscited by 196
  32. 2021Neural Rays for Occlusion-aware Image-based Renderingcited by 192
  33. 2021NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereocited by 192
  34. 2021Stereo Radiance Fields (SRF): Learning View Synthesis for Sparse Views of Novel Scenescited by 190
  35. 2020GRF: Learning a General Radiance Field for 3D Representation and Renderingcited by 183
  36. 2021CodeNeRF: Disentangled Neural Radiance Fields for Object Categoriescited by 183
  37. 2022SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Imagecited by 165
  38. 2022NeRDi: Single-View NeRF Synthesis with Language-Guided Diffusion as General Image Priorscited by 156

50 most cited of 74 All 74 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 3; 2025: 5; 2026: 2.

10 papers.

  1. 2025CoMapGS: Covisibility Map-based Gaussian Splatting for Sparse Novel View Synthesiscited by 10
  2. 2024HESSO: Towards Automatic Efficient and User Friendly Any Neural Network Training and Pruningcited by 4
  3. 2025Sparse-View 3D Reconstruction: Recent Advances and Open Challengescited by 4
  4. 2025Generalizable Radio-Frequency Radiance Fields for Spatial Spectrum Synthesiscited by 3
  5. 2024GANESH: Generalizable NeRF for Lensless Imagingcited by 2
  6. 2025GoLF-NRT: Integrating Global Context and Local Geometry for Few-Shot View Synthesiscited by 2
  7. 2024AdaContour: Adaptive Contour Descriptor with Hierarchical Representationcited by 0
  8. 2025RW-Net: Enhancing Few-Shot Point Cloud Classification with a Wavelet Transform Projection-based Networkcited by 0
  9. 2026MU-GeNeRF: Multi-view Uncertainty-guided Generalizable Neural Radiance Fields for Distractor-aware Scenecited by 0
  10. 2026Learning Spectral and Polarimetric Clues for One-to-Multimodal Novel View Synthesiscited by 0