CodeNeRF: Disentangled Neural Radiance Fields for Object Categories
Not on the map. Why?
Cited by 21 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
CodeNeRF is an implicit 3D neural representation that learns the variation of object shapes and textures across a category and can be trained, from a set of posed images, to synthesize novel views of unseen objects. Unlike the original NeRF, which is scene specific, CodeNeRF learns to disentangle shape and texture by learning separate embeddings. At test time, given a single unposed image of an unseen object, CodeNeRF jointly estimates camera viewpoint, and shape and appearance codes via optimization. Unseen objects can be reconstructed from a single image, and then rendered from new viewpoints or their shape and texture edited by varying the latent codes. We conduct experiments on the SRN benchmark, which show that CodeNeRF generalises well to unseen objects and achieves on-par performance with methods that require known camera pose at test time. Our results on real-world images demonstrate that CodeNeRF can bridge the sim-to-real gap. Project page: urlhttps://github.com/wayne1123/code-nerf
Key facts. Cited by 183 papers in the map (data through 14 Oct 2026). Builds on 24 of its 37 references that are in the map. First posted on arXiv 3 Sep 2021.
Builds on
24 of 37 references.
References · 24
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,584
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
- 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 784
- 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 700
- 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 689
- 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 651
- 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 588
12 more
- 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
- 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
- 2017Neural 3D Mesh Renderercited by 437
- 2018DeepVoxels: Learning Persistent 3D Feature Embeddingscited by 405
- 2020INeRF: Inverting Neural Radiance Fields for Pose Estimationcited by 382
- 2019DISN: Deep Implicit Surface Network for High-quality Single-view 3D Reconstructioncited by 333
- 2019What Do Single-view 3D Reconstruction Networks Learn?cited by 260
- 2018Pix3D: Dataset and Methods for Single-Image 3D Shape Modelingcited by 218
- 2020MeshSDF: Differentiable Iso-Surface Extractioncited by 112
- 2020FroDO: From Detections to 3D Objectscited by 51
- 2020Equivariant Neural Renderingcited by 48
- 2019Photometric Mesh Optimization for Video-Aligned 3D Object Reconstructioncited by 28
Built on by
Citing papers per year: 2021: 11; 2022: 46; 2023: 70; 2024: 40; 2025: 10; 2026: 6.
183 papers.
Sort:
By area:
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 615
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
- 2021Neural Fields in Visual Computing and Beyondcited by 540
- 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 371
- 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 370
- 2021Advances in Neural Renderingcited by 365
- 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 364
- 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 306
- 2022Novel View Synthesis with Diffusion Modelscited by 300
- 20243D Reconstruction with Spatial Memorycited by 277
- 2023Generative Novel View Synthesis with 3D-Aware Diffusion Modelscited by 274
38 more
- 2021Urban Radiance Fieldscited by 263
- 2022Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representationcited by 243
- 2021Scene Representation Transformer: Geometry-Free Novel View Synthesis Through Set-Latent Scene Representationscited by 227
- 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
- 2023NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusioncited by 180
- 2023Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstructioncited by 180
- 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
- 2022NeRF: Neural Radiance Field in 3D Vision: A Comprehensive Review (Updated Post-Gaussian Splatting)cited by 158
- 2021CIPS-3D: A 3D-Aware Generator of GANs Based on Conditionally-Independent Pixel Synthesiscited by 149
- 2021NeSF: Neural Semantic Fields for Generalizable Semantic Segmentation of 3D Scenescited by 119
- 2024latentSplat: Autoencoding Variational Gaussians for Fast Generalizable 3D Reconstructioncited by 118
- 2023Viewset Diffusion: (0-)Image-Conditioned 3D Generative Models from 2D Datacited by 113
- 2022MagicPony: Learning Articulated 3D Animals in the Wildcited by 112
- 2022Vision Transformer for NeRF-Based View Synthesis from a Single Input Imagecited by 104
- 2023GNFactor: Multi-Task Real Robot Learning with Generalizable Neural Feature Fieldscited by 99
- 2021NeRF-SR: High-Quality Neural Radiance Fields using Supersamplingcited by 95
- 2023SINE: Semantic-driven Image-based NeRF Editing with Prior-guided Editing Fieldcited by 94
- 2024LN3DIFF++: Scalable Latent Neural Fields Diffusion for Speedy 3D Generationcited by 92
- 2022Object Scene Representation Transformercited by 90
- 2023SHERF: Generalizable Human NeRF from a Single Imagecited by 88
- 2021LOLNeRF: Learn from One Lookcited by 84
- 2023PC2: Projection-Conditioned Point Cloud Diffusion for Single-Image 3D Reconstructioncited by 84
- 2023Consistent123: Improve Consistency for One Image to 3D Object Synthesiscited by 84
- 2022InfiniteNature-Zero: Learning Perpetual View Generation of Natural Scenes from Single Imagescited by 82
- 2022Pix2NeRF: Unsupervised Conditional π-GAN for Single Image to Neural Radiance Fields Translationcited by 73
- 2022GRAM-HD: 3D-Consistent Image Generation at High Resolution with Generative Radiance Manifoldscited by 73
- 2025Pow3R: Empowering Unconstrained 3D Reconstruction with Camera and Scene Priorscited by 72
- 2022NeRF-SOS: Any-View Self-supervised Object Segmentation on Complex Scenescited by 71
- 2022DM-NeRF: 3D Scene Geometry Decomposition and Manipulation from 2D Imagescited by 69
- 2023vMAP: Vectorised Object Mapping for Neural Field SLAMcited by 67
- 2021CoNeRF: Controllable Neural Radiance Fieldscited by 65
- 2023Real-Time Radiance Fields for Single-Image Portrait View Synthesiscited by 64
- 2022MonoNeRF: Learning a Generalizable Dynamic Radiance Field from Monocular Videoscited by 63
- 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Modelscited by 62
- 2022AutoRF: Learning 3D Object Radiance Fields from Single View Observationscited by 59
- 2022SparsePose: Sparse-View Camera Pose Regression and Refinementcited by 53
- 2023NeO 360: Neural Fields for Sparse View Synthesis of Outdoor Scenescited by 53
- 2022DiffDreamer: Towards Consistent Unsupervised Single-view Scene Extrapolation with Conditional Diffusion Modelscited by 51
50 most cited of 183 All 183 (JSON)
- 2026FlexSplat: Flexible Feed-Forward 3D Gaussian Splatting without Point Cloud Correspondence8 Aug 2026
- 2026UniqueSplat: View-conditioned 3D Gaussian Splatting for Generalizable 3D Reconstruction3 Aug 2026
- 2026GenAssets: Generating in-the-wild 3D Assets in Latent Space24 Apr 2026
- 2026SVGS: Single-View to 3D Object Editing via Gaussian Splatting30 Mar 2026
- 2026UniQueR: Unified Query-based Feedforward 3D Reconstruction24 Mar 2026
- 2026HeroGS: Hierarchical Guidance for Robust 3D Gaussian Splatting under Sparse Views1 Mar 2026
- 2025Scaling Sequence-to-Sequence Generative Neural Rendering5 Oct 2025
- 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Survey19 Jul 2025
- 2025Martian World Model: Controllable Video Synthesis with Physically Accurate 3D Reconstructions10 Jul 2025
- 2025Unifying Appearance Codes and Bilateral Grids for Driving Scene Gaussian Splatting5 Jun 2025
- 2025Pl"uckeRF: A Line-based 3D Representation for Few-view Reconstruction4 Jun 2025
- 2025Fusing Foveal Fixations Using Linear Retinal Transformations and Bayesian Experimental Design2 May 2025
38 more
- 2025Pow3R: Empowering Unconstrained 3D Reconstruction with Camera and Scene Priors21 Mar 2025
- 2025Gaussian Graph Network: Learning Efficient and Generalizable Gaussian Representations from Multi-view Images20 Mar 2025
- 2025Neural Radiance Fields for the Real World: A Survey22 Jan 2025
- 2025Chirpy3D: Part-Aware Multi-View Diffusion for Creative Fine-Grained Object Generation7 Jan 2025
- 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Models24 Dec 2024
- 2024Editing Implicit and Explicit Representations of Radiance Fields: A Survey23 Dec 2024
- 2024Coherent 3D Scene Diffusion From a Single RGB Image13 Dec 2024
- 2024A Lesson in Splats: Teacher-Guided Diffusion for 3D Gaussian Splats Generation with 2D Supervision1 Dec 2024
- 2024PreF3R: Pose-Free Feed-Forward 3D Gaussian Splatting from Variable-length Image Sequence25 Nov 2024
- 2024Intensity Field Decomposition for Tissue-Guided Neural Tomography1 Nov 2024
- 2024Fused-Planes: Why Train a Thousand Tri-Planes When You Can Share?31 Oct 2024
- 2024GUMBEL-NERF: Representing Unseen Objects as Part-Compositional Neural Radiance Fields27 Oct 2024
- 2024ChatCam: Empowering Camera Control through Conversational AI25 Sep 2024
- 2024SDFit: 3D Object Pose and Shape by Fitting a Morphable SDF to a Single Image24 Sep 2024
- 20243D Reconstruction with Spatial Memory28 Aug 2024
- 2024S^3D-NeRF: Single-Shot Speech-Driven Neural Radiance Field for High Fidelity Talking Head Synthesis18 Aug 2024
- 2024VQA-Diff: Exploiting VQA and Diffusion for Zero-Shot Image-to-3D Vehicle Asset Generation in Autonomous Driving9 Jul 2024
- 2024GSD: View-Guided Gaussian Splatting Diffusion for 3D Reconstruction5 Jul 2024
- 2024NeRFDeformer: NeRF Transformation from a Single View via 3D Scene Flows15 Jun 2024
- 2024Category-level Neural Field for Reconstruction of Partially Observed Objects in Indoor Environment12 Jun 2024
- 2024ReFiNe: Recursive Field Networks for Cross-modal Multi-scene Representation6 Jun 2024
- 2024Bilateral Guided Radiance Field Processing1 Jun 2024
- 2024A Pixel Is Worth More Than One 3D Gaussians in Single-View 3D Reconstruction30 May 2024
- 2024TetSphere Splatting: Representing High-Quality Geometry with Lagrangian Volumetric Meshes30 May 2024
- 2024CViT: Continuous Vision Transformer for Operator Learning22 May 2024
- 2024AtomGS: Atomizing Gaussian Splatting for High-Fidelity Radiance Field20 May 2024
- 2024NeRFs in Robotics: A Survey2 May 2024
- 2024LeanGaussian: Breaking Pixel or Point Cloud Correspondence in Modeling 3D Gaussians25 Apr 2024
- 2024GPN: Generative Point-based NeRF12 Apr 2024
- 2024G-NeRF: Geometry-enhanced Novel View Synthesis from Single-View Images11 Apr 2024
- 2024Mesh2NeRF: Direct Mesh Supervision for Neural Radiance Field Representation and Generation28 Mar 2024
- 2024latentSplat: Autoencoding Variational Gaussians for Fast Generalizable 3D Reconstruction24 Mar 2024
- 2024SUP-NeRF: A Streamlined Unification of Pose Estimation and NeRF for Monocular 3D Object Reconstruction23 Mar 2024
- 2024LN3DIFF++: Scalable Latent Neural Fields Diffusion for Speedy 3D Generation18 Mar 2024
- 2024ARC-NeRF: Area Ray Casting for Broader Unseen View Coverage in Few-shot Object Rendering16 Mar 2024
- 2024KP-RED: Exploiting Semantic Keypoints for Joint 3D Shape Retrieval and Deformation15 Mar 2024
- 2024Put Myself in Your Shoes: Lifting the Egocentric Perspective from Exocentric Videos11 Mar 2024
- 2024DNAct: Diffusion Guided Multi-Task 3D Policy Learning7 Mar 2024
50 newest of 183 All 183 (JSON)
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
- 2022Novel View Synthesis with Diffusion Modelscited by 300
- 2023Generative Novel View Synthesis with 3D-Aware Diffusion Modelscited by 274
- 2023Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstructioncited by 180
- 2023Viewset Diffusion: (0-)Image-Conditioned 3D Generative Models from 2D Datacited by 113
- 2023Consistent123: Improve Consistency for One Image to 3D Object Synthesiscited by 84
- 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Modelscited by 62
- 2023Deceptive-NeRF/3DGS: Diffusion-Generated Pseudo-Observations for High-Quality Sparse-View Reconstructioncited by 39
- 2023DreamSparse: Escaping from Plato's Cave with 2D Frozen Diffusion Model Given Sparse Viewscited by 31
- 2023CustomNet: Zero-shot Object Customization with Variable-Viewpoints in Text-to-Image Diffusion Modelscited by 25
- 2024GSD: View-Guided Gaussian Splatting Diffusion for 3D Reconstructioncited by 18
- 2024ViewFusion: Towards Multi-View Consistency via Interpolated Denoisingcited by 14
12 most cited of 20 All 20 (JSON)
- 2026GenAssets: Generating in-the-wild 3D Assets in Latent Space24 Apr 2026
- 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Models24 Dec 2024
- 2024A Lesson in Splats: Teacher-Guided Diffusion for 3D Gaussian Splats Generation with 2D Supervision1 Dec 2024
- 2024VQA-Diff: Exploiting VQA and Diffusion for Zero-Shot Image-to-3D Vehicle Asset Generation in Autonomous Driving9 Jul 2024
- 2024GSD: View-Guided Gaussian Splatting Diffusion for 3D Reconstruction5 Jul 2024
- 2024ViewFusion: Towards Multi-View Consistency via Interpolated Denoising29 Feb 2024
- 2024GD^2-NeRF: Generative Detail Compensation via GAN and Diffusion for One-shot Generalizable Neural Radiance Fields1 Jan 2024
- 2023Neural Point Cloud Diffusion for Disentangled 3D Shape and Appearance Generation21 Dec 2023
- 2023CustomNet: Zero-shot Object Customization with Variable-Viewpoints in Text-to-Image Diffusion Models30 Oct 2023
- 2023Consistent123: Improve Consistency for One Image to 3D Object Synthesis12 Oct 2023
- 2023Light Field Diffusion for Single-View Novel View Synthesis20 Sep 2023
- 2023CCD-3DR: Consistent Conditioning in Diffusion for Single-Image 3D Reconstruction15 Aug 2023
12 newest of 20 All 20 (JSON)
- 2022DiffDreamer: Towards Consistent Unsupervised Single-view Scene Extrapolation with Conditional Diffusion Modelscited by 51
- 2023Persistent Nature: A Generative Model of Unbounded 3D Worldscited by 44
- 2025Martian World Model: Controllable Video Synthesis with Physically Accurate 3D Reconstructionscited by 6
- 2025Martian World Model: Controllable Video Synthesis with Physically Accurate 3D Reconstructions10 Jul 2025
- 2023Persistent Nature: A Generative Model of Unbounded 3D Worlds23 Mar 2023
- 2022DiffDreamer: Towards Consistent Unsupervised Single-view Scene Extrapolation with Conditional Diffusion Models22 Nov 2022
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 615
- 2021Neural Fields in Visual Computing and Beyondcited by 540
- 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 371
- 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 370
- 2021Advances in Neural Renderingcited by 365
- 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 364
- 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 306
- 20243D Reconstruction with Spatial Memorycited by 277
- 2021Urban Radiance Fieldscited by 263
- 2022Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representationcited by 243
- 2021Scene Representation Transformer: Geometry-Free Novel View Synthesis Through Set-Latent Scene Representationscited by 227
12 most cited of 157 All 157 (JSON)
- 2026FlexSplat: Flexible Feed-Forward 3D Gaussian Splatting without Point Cloud Correspondence8 Aug 2026
- 2026UniqueSplat: View-conditioned 3D Gaussian Splatting for Generalizable 3D Reconstruction3 Aug 2026
- 2026SVGS: Single-View to 3D Object Editing via Gaussian Splatting30 Mar 2026
- 2026UniQueR: Unified Query-based Feedforward 3D Reconstruction24 Mar 2026
- 2026HeroGS: Hierarchical Guidance for Robust 3D Gaussian Splatting under Sparse Views1 Mar 2026
- 2025Scaling Sequence-to-Sequence Generative Neural Rendering5 Oct 2025
- 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Survey19 Jul 2025
- 2025Unifying Appearance Codes and Bilateral Grids for Driving Scene Gaussian Splatting5 Jun 2025
- 2025Pl"uckeRF: A Line-based 3D Representation for Few-view Reconstruction4 Jun 2025
- 2025Fusing Foveal Fixations Using Linear Retinal Transformations and Bayesian Experimental Design2 May 2025
- 2025Pow3R: Empowering Unconstrained 3D Reconstruction with Camera and Scene Priors21 Mar 2025
- 2025Gaussian Graph Network: Learning Efficient and Generalizable Gaussian Representations from Multi-view Images20 Mar 2025
12 newest of 157 All 157 (JSON)