GRF: Learning a General Radiance Field for 3D Representation and Rendering
Not on the map. Why?
Abstract (arXiv)
We present a simple yet powerful neural network that implicitly represents and renders 3D objects and scenes only from 2D observations. The network models 3D geometries as a general radiance field, which takes a set of 2D images with camera poses and intrinsics as input, constructs an internal representation for each point of the 3D space, and then renders the corresponding appearance and geometry of that point viewed from an arbitrary position. The key to our approach is to learn local features for each pixel in 2D images and to then project these features to 3D points, thus yielding general and rich point representations. We additionally integrate an attention mechanism to aggregate pixel features from multiple 2D views, such that visual occlusions are implicitly taken into account. Extensive experiments demonstrate that our method can generate high-quality and realistic novel views for novel objects, unseen categories and challenging real-world scenes.
Key facts. Cited by 183 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 39; 2023: 71; 2024: 45; 2025: 14; 2026: 4.
183 papers.
Sort:
By area:
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
- 2021Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughscited by 396
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
- 2021Advances in Neural Renderingcited by 365
- 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 341
- 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 317
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
- 2022NoPe-NeRF: Optimising Neural Radiance Field with No Pose Priorcited by 235
38 more
- 2023MVImgNet: A Large-scale Dataset of Multi-view Imagescited by 219
- 2022SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstructioncited by 216
- 2021GeoNeRF: Generalizing NeRF with Geometry Priorscited by 195
- 2022SPARF: Neural Radiance Fields from Sparse and Noisy Posescited by 195
- 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 191
- 2023NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusioncited by 179
- 2022SparseNeuS: Fast Generalizable Neural Surface Reconstruction from Sparse Viewscited by 175
- 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
- 2022SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Imagecited by 165
- 2022Fourier PlenOctrees for Dynamic Radiance Field Rendering in Real-timecited by 164
- 2022NeRF: Neural Radiance Field in 3D Vision: A Comprehensive Review (Updated Post-Gaussian Splatting)cited by 156
- 2022NeRDi: Single-View NeRF Synthesis with Language-Guided Diffusion as General Image Priorscited by 156
- 2022NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fieldscited by 151
- 2021Efficient Neural Radiance Fields for Interactive Free-viewpoint Videocited by 150
- 2021Improving neural implicit surfaces geometry with patch warpingcited by 136
- 2022ActiveNeRF: Learning where to See with Uncertainty Estimationcited by 124
- 2022Generalizable Patch-Based Neural Renderingcited by 121
- 2023S-NeRF: Neural Radiance Fields for Street Viewscited by 116
- 2023Diffusion with Forward Models: Solving Stochastic Inverse Problems Without Direct Supervisioncited by 112
- 2023Learning to Render Novel Views from Wide-Baseline Stereo Pairscited by 103
- 2023GNFactor: Multi-Task Real Robot Learning with Generalizable Neural Feature Fieldscited by 99
- 2022Learning Dynamic Facial Radiance Fields for Few-Shot Talking Head Synthesiscited by 97
- 2021NeRF-SR: High-Quality Neural Radiance Fields using Supersamplingcited by 95
- 2024V3D: Video Diffusion Models are Effective 3D Generatorscited by 88
- 2022ViewFormer: NeRF-free Neural Rendering from Few Images Using Transformerscited by 70
- 2023Learning Neural Volumetric Representations of Dynamic Humans in Minutescited by 70
- 2022DM-NeRF: 3D Scene Geometry Decomposition and Manipulation from 2D Imagescited by 69
- 2023Forward Flow for Novel View Synthesis of Dynamic Scenescited by 67
- 2023ViVid-1-to-3: Novel View Synthesis with Video Diffusion Modelscited by 57
- 2023NeRF in the Palm of Your Hand: Corrective Augmentation for Robotics via Novel-View Synthesiscited by 56
- 2024MeshFormer: High-Quality Mesh Generation with 3D-Guided Reconstruction Modelcited by 55
- 2023NeO 360: Neural Fields for Sparse View Synthesis of Outdoor Scenescited by 53
- 2022MPS-NeRF: Generalizable 3D Human Rendering from Multiview Imagescited by 52
- 2022Self-supervised Neural Articulated Shape and Appearance Modelscited by 51
- 2022DiffDreamer: Towards Consistent Unsupervised Single-view Scene Extrapolation with Conditional Diffusion Modelscited by 51
- 2022IntrinsicNeRF: Learning Intrinsic Neural Radiance Fields for Editable Novel View Synthesiscited by 50
- 2023FeatureNeRF: Learning Generalizable NeRFs by Distilling Foundation Modelscited by 47
- 2024CViT: Continuous Vision Transformer for Operator Learningcited by 47
50 most cited of 183 All 183 (JSON)
- 2026ToW3D: Consistency-aware Interactive Point-based Mesh Editing on GANs3 Aug 2026
- 2026Fast and Lightweight Novel View Synthesis with Differentiable Multiplane Image1 Jun 2026
- 2026Fast and Generalizable NeRF Architecture Selection for Satellite Scene Reconstruction18 Mar 2026
- 2026studentSplat: Your Student Model Learns Single-view 3D Gaussian Splatting16 Jan 2026
- 2025RayletDF: Raylet Distance Fields for Generalizable 3D Surface Reconstruction from Point Clouds or Gaussians13 Aug 2025
- 2025H3R: Hybrid Multi-view Correspondence for Generalizable 3D Reconstruction5 Aug 2025
- 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Survey19 Jul 2025
- 2025Peering into the Unknown: Active View Selection with Neural Uncertainty Maps for 3D Reconstruction17 Jun 2025
- 2025FreeGave: 3D Physics Learning from Dynamic Videos by Gaussian Velocity9 Jun 2025
- 2025GoLF-NRT: Integrating Global Context and Local Geometry for Few-Shot View Synthesis26 May 2025
- 2025Depth-Guided Bundle Sampling for Efficient Generalizable Neural Radiance Field Reconstruction26 May 2025
- 2025SparSplat: Fast Multi-View Reconstruction with Generalizable 2D Gaussian Splatting4 May 2025
38 more
- 2025Scene Splatter: Momentum 3D Scene Generation from Single Image with Video Diffusion Model3 Apr 2025
- 2025TriDF: Triplane-Accelerated Density Fields for Few-Shot Remote Sensing Novel View Synthesis17 Mar 2025
- 2025ConsistentDreamer: View-Consistent Meshes Through Balanced Multi-View Gaussian Optimization13 Feb 2025
- 2025Generalizable Radio-Frequency Radiance Fields for Spatial Spectrum Synthesis8 Feb 2025
- 2025Zero-Shot Novel View and Depth Synthesis with Multi-View Geometric Diffusion30 Jan 2025
- 2025Neural Radiance Fields for the Real World: A Survey22 Jan 2025
- 2024SimVS: Simulating World Inconsistencies for Robust View Synthesis10 Dec 2024
- 2024Splatter-360: Generalizable 360circ Gaussian Splatting for Wide-baseline Panoramic Images9 Dec 2024
- 2024Generative Artificial Intelligence Meets Synthetic Aperture Radar: A Survey5 Nov 2024
- 2024GMT: Enhancing Generalizable Neural Rendering via Geometry-Driven Multi-Reference Texture Transfer1 Oct 2024
- 2024OPONeRF: One-Point-One NeRF for Robust Neural Rendering30 Sep 2024
- 2024G3R: Gradient Guided Generalizable Reconstruction28 Sep 2024
- 2024View-Invariant Policy Learning via Zero-Shot Novel View Synthesis5 Sep 2024
- 2024GeoTransfer : Generalizable Few-Shot Multi-View Reconstruction via Transfer Learning27 Aug 2024
- 2024MeshFormer: High-Quality Mesh Generation with 3D-Guided Reconstruction Model19 Aug 2024
- 2024SpaRP: Fast 3D Object Reconstruction and Pose Estimation from Sparse Views19 Aug 2024
- 2024Scene123: One Prompt to 3D Scene Generation via Video-Assisted and Consistency-Enhanced MAE10 Aug 2024
- 2024BoostMVSNeRFs: Boosting MVS-based NeRFs to Generalizable View Synthesis in Large-scale Scenes22 Jul 2024
- 2024Enhancement of 3D Gaussian Splatting using Raw Mesh for Photorealistic Recreation of Architectures22 Jul 2024
- 2024SparseCraft: Few-Shot Neural Reconstruction through Stereopsis Guided Geometric Linearization19 Jul 2024
- 2024MIGS: Multi-Identity Gaussian Splatting via Tensor Decomposition10 Jul 2024
- 2024psPRF:Pansharpening Planar Neural Radiance Field for Generalized 3D Reconstruction Satellite Imagery22 Jun 2024
- 2024REPARO: Compositional 3D Assets Generation with Differentiable 3D Layout Alignment28 May 2024
- 2024Neural Directional Encoding for Efficient and Accurate View-Dependent Appearance Modeling23 May 2024
- 2024CViT: Continuous Vision Transformer for Operator Learning22 May 2024
- 2024Multi-view Action Recognition via Directed Gromov-Wasserstein Discrepancy2 May 2024
- 2024NeRFs in Robotics: A Survey2 May 2024
- 2024Invisible Stitch: Generating Smooth 3D Scenes with Depth Inpainting30 Apr 2024
- 2024Simple-RF: Regularizing Sparse Input Radiance Fields with Simpler Solutions29 Apr 2024
- 2024Generalizable Novel-View Synthesis using a Stereo Camera21 Apr 2024
- 20243D Multi-frame Fusion for Video Stabilization19 Apr 2024
- 20246Img-to-3D: Few-Image Large-Scale Outdoor Driving Scene Reconstruction18 Apr 2024
- 2024GPN: Generative Point-based NeRF12 Apr 2024
- 2024CodecNeRF: Toward Fast Encoding and Decoding, Compact, and High-quality Novel-view Synthesis7 Apr 2024
- 2024NeRF2Points: Large-Scale Point Cloud Generation From Street Views' Radiance Field Optimization7 Apr 2024
- 2024NeRF-MAE: Masked AutoEncoders for Self-Supervised 3D Representation Learning for Neural Radiance Fields1 Apr 2024
- 2024SGCNeRF: Few-Shot Neural Rendering via Sparse Geometric Consistency Guidance1 Apr 2024
- 2024MI-NeRF: Learning a Single Face NeRF from Multiple Identities29 Mar 2024
50 newest of 183 All 183 (JSON)
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
- 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 341
- 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 317
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
- 2022NeRDi: Single-View NeRF Synthesis with Language-Guided Diffusion as General Image Priorscited by 156
- 2023Diffusion with Forward Models: Solving Stochastic Inverse Problems Without Direct Supervisioncited by 112
- 2024V3D: Video Diffusion Models are Effective 3D Generatorscited by 88
- 2023ViVid-1-to-3: Novel View Synthesis with Video Diffusion Modelscited by 57
- 2024MeshFormer: High-Quality Mesh Generation with 3D-Guided Reconstruction Modelcited by 55
- 2024SpaRP: Fast 3D Object Reconstruction and Pose Estimation from Sparse Viewscited by 35
- 2023DreamSparse: Escaping from Plato's Cave with 2D Frozen Diffusion Model Given Sparse Viewscited by 31
12 most cited of 17 All 17 (JSON)
- 2025Scene Splatter: Momentum 3D Scene Generation from Single Image with Video Diffusion Model3 Apr 2025
- 2025ConsistentDreamer: View-Consistent Meshes Through Balanced Multi-View Gaussian Optimization13 Feb 2025
- 2024MeshFormer: High-Quality Mesh Generation with 3D-Guided Reconstruction Model19 Aug 2024
- 2024SpaRP: Fast 3D Object Reconstruction and Pose Estimation from Sparse Views19 Aug 2024
- 2024Invisible Stitch: Generating Smooth 3D Scenes with Depth Inpainting30 Apr 2024
- 2024V3D: Video Diffusion Models are Effective 3D Generators11 Mar 2024
- 2024Sketch2NeRF: Multi-view Sketch-guided Text-to-3D Generation25 Jan 2024
- 2023ReconFusion: 3D Reconstruction with Diffusion Priors5 Dec 2023
- 2023ViVid-1-to-3: Novel View Synthesis with Video Diffusion Models3 Dec 2023
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusion14 Nov 2023
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Model10 Nov 2023
- 2023Light Field Diffusion for Single-View Novel View Synthesis20 Sep 2023
12 newest of 17 All 17 (JSON)
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
- 2021Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughscited by 396
- 2021Advances in Neural Renderingcited by 365
- 2022NoPe-NeRF: Optimising Neural Radiance Field with No Pose Priorcited by 235
- 2023MVImgNet: A Large-scale Dataset of Multi-view Imagescited by 219
- 2022SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstructioncited by 216
- 2021GeoNeRF: Generalizing NeRF with Geometry Priorscited by 195
- 2022SPARF: Neural Radiance Fields from Sparse and Noisy Posescited by 195
- 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 191
12 most cited of 163 All 163 (JSON)
- 2026ToW3D: Consistency-aware Interactive Point-based Mesh Editing on GANs3 Aug 2026
- 2026Fast and Lightweight Novel View Synthesis with Differentiable Multiplane Image1 Jun 2026
- 2026Fast and Generalizable NeRF Architecture Selection for Satellite Scene Reconstruction18 Mar 2026
- 2026studentSplat: Your Student Model Learns Single-view 3D Gaussian Splatting16 Jan 2026
- 2025RayletDF: Raylet Distance Fields for Generalizable 3D Surface Reconstruction from Point Clouds or Gaussians13 Aug 2025
- 2025H3R: Hybrid Multi-view Correspondence for Generalizable 3D Reconstruction5 Aug 2025
- 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Survey19 Jul 2025
- 2025Peering into the Unknown: Active View Selection with Neural Uncertainty Maps for 3D Reconstruction17 Jun 2025
- 2025FreeGave: 3D Physics Learning from Dynamic Videos by Gaussian Velocity9 Jun 2025
- 2025GoLF-NRT: Integrating Global Context and Local Geometry for Few-Shot View Synthesis26 May 2025
- 2025Depth-Guided Bundle Sampling for Efficient Generalizable Neural Radiance Field Reconstruction26 May 2025
- 2025SparSplat: Fast Multi-View Reconstruction with Generalizable 2D Gaussian Splatting4 May 2025
12 newest of 163 All 163 (JSON)