DeepVoxels: Learning Persistent 3D Feature Embeddings
Not on the map. Why?
Abstract (arXiv)
In this work, we address the lack of 3D understanding of generative neural networks by introducing a persistent 3D feature embedding for view synthesis. To this end, we propose DeepVoxels, a learned representation that encodes the view-dependent appearance of a 3D scene without having to explicitly model its geometry. At its core, our approach is based on a Cartesian 3D grid of persistent embedded features that learn to make use of the underlying 3D scene structure. Our approach combines insights from 3D geometric computer vision with recent advances in learning image-to-image mappings based on adversarial loss functions. DeepVoxels is supervised, without requiring a 3D reconstruction of the scene, using a 2D re-rendering loss and enforces perspective and multi-view geometry in a principled manner. We apply our persistent 3D scene representation to the problem of novel view synthesis demonstrating high-quality results for a variety of challenging scenes.
Key facts. Cited by 401 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 110; 2022: 77; 2023: 102; 2024: 71; 2025: 34; 2026: 7.
401 papers.
Sort:
By area:
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
- 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
38 more
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
- 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 370
- 2021Advances in Neural Renderingcited by 365
- 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 344
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
- 2021PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relightingcited by 332
- 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 330
- 2021Neural RGB-D Surface Reconstructioncited by 312
- 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 311
- 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
- 20223D Neural Field Generation using Triplane Diffusioncited by 274
- 2023Generative Novel View Synthesis with 3D-Aware Diffusion Modelscited by 273
- 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
- 2021COIN: COmpression with Implicit Neural representationscited by 232
- 2021DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networkscited by 232
- 2025SAM 3D: 3Dfy Anything in Imagescited by 230
- 2021Learning Object-Compositional Neural Radiance Field for Editable Scene Renderingcited by 228
- 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
- 2021Editing Conditional Radiance Fieldscited by 222
- 2024A Survey on 3D Gaussian Splattingcited by 221
- 2023MVImgNet: A Large-scale Dataset of Multi-view Imagescited by 219
- 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
- 2022NeRF-Editing: Geometry Editing of Neural Radiance Fieldscited by 216
- 2021NeX: Real-time View Synthesis with Neural Basis Expansioncited by 215
- 2021HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fieldscited by 210
- 2021Neural Rays for Occlusion-aware Image-based Renderingcited by 192
- 2021Point-Based Neural Rendering with Per-View Optimizationcited by 188
- 2021Shape As Points: A Differentiable Poisson Solvercited by 186
- 2021CodeNeRF: Disentangled Neural Radiance Fields for Object Categoriescited by 183
- 2022SparseNeuS: Fast Generalizable Neural Surface Reconstruction from Sparse Viewscited by 175
- 2023HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Samplingcited by 173
- 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
- 2022SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Imagecited by 165
- 2021Neural Human Performer: Learning Generalizable Radiance Fields for Human Performance Renderingcited by 158
50 most cited of 401 All 401 (JSON)
- 2026InfiniVerse: Occupancy Guided Unbounded Scene Generation for Autonomous Driving30 Jun 2026
- 2026Tensor Memory: Fixed-Size Recurrent State for Long-Horizon Transformers26 May 2026
- 2026DINO Eats CLIP: Adapting Beyond Knowns for Open-set 3D Object Retrieval21 Apr 2026
- 2026PoInit-of-View: Poisoning Initialization of Views Transfers Across Multiple 3D Reconstruction Systems17 Apr 2026
- 2026Mobile-GS: Real-time Gaussian Splatting for Mobile Devices12 Mar 2026
- 2026tttLRM: Test-Time Training for Long Context and Autoregressive 3D Reconstruction23 Feb 2026
- 2026LongStream: Long-Sequence Streaming Autoregressive Visual Geometry13 Feb 2026
- 2025Long-LRM++: Preserving Fine Details in Feed-Forward Wide-Coverage Reconstruction11 Dec 2025
- 2025Gaussian Entropy Fields: Driving Adaptive Sparsity in 3D Gaussian Optimization4 Dec 2025
- 2025SAM 3D: 3Dfy Anything in Images20 Nov 2025
- 2025Depth-Consistent 3D Gaussian Splatting via Physical Defocus Modeling and Multi-View Geometric Supervision13 Nov 2025
- 2025Gen-LangSplat: Generalized Language Gaussian Splatting with Pre-Trained Feature Compression27 Oct 2025
38 more
- 2025LookOut: Real-World Humanoid Egocentric Navigation20 Aug 2025
- 2025STream3R: Scalable Sequential 3D Reconstruction with Causal Transformer14 Aug 2025
- 2025Multi-Sample Anti-Aliasing and Constrained Optimization for 3D Gaussian Splatting14 Aug 2025
- 2025Optimization-Free Style Transfer for 3D Gaussian Splats7 Aug 2025
- 2025RLGS: Reinforcement Learning-Based Adaptive Hyperparameter Tuning for Gaussian Splatting6 Aug 2025
- 2025Describe, Adapt and Combine: Empowering CLIP Encoders for Open-set 3D Object Retrieval29 Jul 2025
- 2025GTAD: Global Temporal Aggregation Denoising Learning for 3D Semantic Occupancy Prediction28 Jul 2025
- 2025HairCUP: Hair Compositional Universal Prior for 3D Gaussian Avatars25 Jul 2025
- 2025Real-Time Scene Reconstruction using Light Field Probes19 Jul 2025
- 2025Advancing Text-to-3D Generation with Linearized Lookahead Variational Score Distillation13 Jul 2025
- 2025SemFaceEdit: Semantic Face Editing on Generative Radiance Manifolds28 Jun 2025
- 2025SurfR: Surface Reconstruction with Multi-scale Attention10 Jun 2025
- 2025MonoSplat: Generalizable 3D Gaussian Splatting from Monocular Depth Foundation Models21 May 2025
- 2025A Survey of 3D Reconstruction with Event Cameras13 May 2025
- 2025Learning Multi-frame and Monocular Prior for Estimating Geometry in Dynamic Scenes3 May 2025
- 2025Dual-Camera All-in-Focus Neural Radiance Fields23 Apr 2025
- 2025Geo4D: Leveraging Video Generators for Geometric 4D Scene Reconstruction10 Apr 2025
- 2025Objaverse++: Curated 3D Object Dataset with Quality Annotations9 Apr 2025
- 2025D2USt3R: Enhancing 3D Reconstruction for Dynamic Scenes8 Apr 2025
- 2025Video4DGen: Enhancing Video and 4D Generation through Mutual Optimization5 Apr 2025
- 2025Uni-Render: A Unified Accelerator for Real-Time Rendering Across Diverse Neural Renderers31 Mar 2025
- 2025FreeSplat++: Generalizable 3D Gaussian Splatting for Efficient Indoor Scene Reconstruction29 Mar 2025
- 2025Niagara: Normal-Integrated Geometric Affine Field for Scene Reconstruction from a Single View16 Mar 2025
- 2025MetricGrids: Arbitrary Nonlinear Approximation with Elementary Metric Grids based Implicit Neural Representation13 Mar 2025
- 2025Neural Chaos: A Spectral Stochastic Neural Operator17 Feb 2025
- 2025Implicit Neural Representations of Molecular Vector-Valued Functions15 Feb 2025
- 2025Rapid Whole Brain Motion-robust Mesoscale In-vivo MR Imaging using Multi-scale Implicit Neural Representation12 Feb 2025
- 2025CamCtrl3D: Single-Image Scene Exploration with Precise 3D Camera Control10 Jan 2025
- 2025AE-NeRF: Augmenting Event-Based Neural Radiance Fields for Non-ideal Conditions and Larger Scene6 Jan 2025
- 2024Deformable Radial Kernel Splatting16 Dec 2024
- 2024Mixture of neural fields for heterogeneous reconstruction in cryo-EM12 Dec 2024
- 2024Puzzle Similarity: A Perceptually-guided Cross-Reference Metric for Artifact Detection in 3D Scene Reconstructions26 Nov 2024
- 2024Quark: Real-time, High-resolution, and General Neural View Synthesis25 Nov 2024
- 2024Geometric Algebra Planes: Convex Implicit Neural Volumes20 Nov 2024
- 2024Beyond Gaussians: Fast and High-Fidelity 3D Splatting with Linear Kernels19 Nov 2024
- 2024ELMGS: Enhancing memory and computation scaLability through coMpression for 3D Gaussian Splatting30 Oct 2024
- 2024Epipolar-Free 3D Gaussian Splatting for Generalizable Novel View Synthesis30 Oct 2024
- 2024Guide3D: A Bi-planar X-ray Dataset for 3D Shape Reconstruction29 Oct 2024
50 newest of 401 All 401 (JSON)
- 20223D Neural Field Generation using Triplane Diffusioncited by 274
- 2023Generative Novel View Synthesis with 3D-Aware Diffusion Modelscited by 273
- 2024MultiDiff: Consistent Novel View Synthesis from a Single Imagecited by 67
- 2025Geo4D: Leveraging Video Generators for Geometric 4D Scene Reconstructioncited by 66
- 2023ViVid-1-to-3: Novel View Synthesis with Video Diffusion Modelscited by 57
- 2024SCube: Instant Large-Scale Scene Reconstruction using VoxSplatscited by 56
- 2023Large-Vocabulary 3D Diffusion Model with Transformercited by 48
- 2023DreamSparse: Escaping from Plato's Cave with 2D Frozen Diffusion Model Given Sparse Viewscited by 31
- 2023HD-Fusion: Detailed Text-to-3D Generation Leveraging Multiple Noise Estimationcited by 27
- 2024ScaleDreamer: Scalable Text-to-3D Synthesis with Asynchronous Score Distillationcited by 27
- 2024Invisible Stitch: Generating Smooth 3D Scenes with Depth Inpaintingcited by 23
- 2024Sampling 3D Gaussian Scenes in Seconds with Latent Diffusion Modelscited by 10
12 most cited of 16 All 16 (JSON)
- 2025Advancing Text-to-3D Generation with Linearized Lookahead Variational Score Distillation13 Jul 2025
- 2025Geo4D: Leveraging Video Generators for Geometric 4D Scene Reconstruction10 Apr 2025
- 2024SCube: Instant Large-Scale Scene Reconstruction using VoxSplats26 Oct 2024
- 2024DreamHOI: Subject-Driven Generation of 3D Human-Object Interactions with Diffusion Priors12 Sep 2024
- 2024TEDRA: Text-based Editing of Dynamic and Photoreal Actors28 Aug 2024
- 2024ScaleDreamer: Scalable Text-to-3D Synthesis with Asynchronous Score Distillation2 Jul 2024
- 2024MultiDiff: Consistent Novel View Synthesis from a Single Image26 Jun 2024
- 2024Sampling 3D Gaussian Scenes in Seconds with Latent Diffusion Models18 Jun 2024
- 2024DiffTF++: 3D-aware Diffusion Transformer for Large-Vocabulary 3D Generation13 May 2024
- 2024Invisible Stitch: Generating Smooth 3D Scenes with Depth Inpainting30 Apr 2024
- 2023ViVid-1-to-3: Novel View Synthesis with Video Diffusion Models3 Dec 2023
- 2023Large-Vocabulary 3D Diffusion Model with Transformer14 Sep 2023
12 newest of 16 All 16 (JSON)
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
- 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
12 most cited of 382 All 382 (JSON)
- 2026InfiniVerse: Occupancy Guided Unbounded Scene Generation for Autonomous Driving30 Jun 2026
- 2026Tensor Memory: Fixed-Size Recurrent State for Long-Horizon Transformers26 May 2026
- 2026DINO Eats CLIP: Adapting Beyond Knowns for Open-set 3D Object Retrieval21 Apr 2026
- 2026PoInit-of-View: Poisoning Initialization of Views Transfers Across Multiple 3D Reconstruction Systems17 Apr 2026
- 2026Mobile-GS: Real-time Gaussian Splatting for Mobile Devices12 Mar 2026
- 2026tttLRM: Test-Time Training for Long Context and Autoregressive 3D Reconstruction23 Feb 2026
- 2026LongStream: Long-Sequence Streaming Autoregressive Visual Geometry13 Feb 2026
- 2025Long-LRM++: Preserving Fine Details in Feed-Forward Wide-Coverage Reconstruction11 Dec 2025
- 2025Gaussian Entropy Fields: Driving Adaptive Sparsity in 3D Gaussian Optimization4 Dec 2025
- 2025SAM 3D: 3Dfy Anything in Images20 Nov 2025
- 2025Depth-Consistent 3D Gaussian Splatting via Physical Defocus Modeling and Multi-View Geometric Supervision13 Nov 2025
- 2025Gen-LangSplat: Generalized Language Gaussian Splatting with Pre-Trained Feature Compression27 Oct 2025
12 newest of 382 All 382 (JSON)