mlsanityData to 14 Oct 2026

CoNeRF: Controllable Neural Radiance Fields

arXiv 2112.01983 ↗First posted 3 Dec 2021cs.CV cs.GRcited by 65

Not on the map. Why?

Abstract (arXiv)

We extend neural 3D representations to allow for intuitive and interpretable user control beyond novel view rendering (i.e. camera control). We allow the user to annotate which part of the scene one wishes to control with just a small number of mask annotations in the training images. Our key idea is to treat the attributes as latent variables that are regressed by the neural network given the scene encoding. This leads to a few-shot learning framework, where attributes are discovered automatically by the framework, when annotations are not provided. We apply our method to various scenes with different types of controllable attributes (e.g. expression control on human faces, or state control in movement of inanimate objects). Overall, we demonstrate, to the best of our knowledge, for the first time novel view and novel attribute re-rendering of scenes from a single video.

Key facts. Cited by 65 papers in the map (data through 14 Oct 2026). Builds on 34 of its 53 references that are in the map. First posted on arXiv 3 Dec 2021.

Builds on

34 of 53 references.

References · 34

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
  4. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,232
  5. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 861
  6. 2016InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Netscited by 860
  7. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 689
  8. 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 632
  9. 2020A Survey of Deep Active Learningcited by 554
  10. 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 471
  11. 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 467
  12. 2018Towards a Definition of Disentangled Representationscited by 296
22 more
  1. 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
  2. 2020PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstructioncited by 231
  3. 2021Learning Object-Compositional Neural Radiance Field for Editable Scene Renderingcited by 228
  4. 2021Editing Conditional Radiance Fieldscited by 222
  5. 2021Neural Articulated Radiance Fieldcited by 196
  6. 2021CodeNeRF: Disentangled Neural Radiance Fields for Object Categoriescited by 183
  7. 2021SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networkscited by 181
  8. 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
  9. 2019NASA: Neural Articulated Shape Approximationcited by 149
  10. 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 114
  11. 2019Unsupervised Learning of Object Keypoints for Perception and Controlcited by 109
  12. 2021LEAP: Learning Articulated Occupancy of Peoplecited by 107
  13. 2021imGHUM: Implicit Generative Models of 3D Human Shape and Articulated Posecited by 103
  14. 2021Unsupervised Discovery of Object Radiance Fieldscited by 101
  15. 2020Object-Centric Neural Scene Renderingcited by 90
  16. 2021SCALE: Modeling Clothed Humans with a Surface Codec of Articulated Local Elementscited by 72
  17. 2021Reverse Engineering of Generative Models: Inferring Model Hyperparameters from Generated Imagescited by 58
  18. 2021FiG-NeRF: Figure-Ground Neural Radiance Fields for 3D Object Category Modellingcited by 47
  19. 2020Deep Active Learning for Joint Classification & Segmentation with Weak Annotatorcited by 16
  20. 2020Product Manifold Learningcited by 16
  21. 2021Data-Driven 3D Reconstruction of Dressed Humans From Sparse Viewscited by 11
  22. 2020Markov-Lipschitz Deep Learningcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 12; 2023: 34; 2024: 11; 2025: 6; 2026: 2.

65 papers.

Sort:

By area:

  1. 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 393
  2. 2024A Survey on 3D Gaussian Splattingcited by 224
  3. 2022NeRF: Neural Radiance Field in 3D Vision: A Comprehensive Review (Updated Post-Gaussian Splatting)cited by 158
  4. 2022SPIn-NeRF: Multiview Segmentation and Perceptual Inpainting with Neural Radiance Fieldscited by 144
  5. 2022NeuMesh: Learning Disentangled Neural Mesh-based Implicit Field for Geometry and Texture Editingcited by 142
  6. 2022D2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Videocited by 137
  7. 20243D Gaussian as a New Era: A Surveycited by 104
  8. 2022Generative Neural Articulated Radiance Fieldscited by 101
  9. 2023SINE: Semantic-driven Image-based NeRF Editing with Prior-guided Editing Fieldcited by 94
  10. 2023FocalDreamer: Text-driven 3D Editing via Focal-fusion Assemblycited by 76
  11. 2023PIE-NeRF: Physics-based Interactive Elastodynamics with NeRFcited by 51
  12. 2023Watch Your Steps: Local Image and Scene Editing by Text Instructionscited by 50
38 more
  1. 2023Reference-guided Controllable Inpainting of Neural Radiance Fieldscited by 40
  2. 2023SHAP-EDITOR: Instruction-guided Latent 3D Editing in Secondscited by 37
  3. 2023PartNeRF: Generating Part-Aware Editable 3D Shapes without 3D Supervisioncited by 36
  4. 2023OmniAvatar: Geometry-Guided Controllable 3D Head Synthesiscited by 34
  5. 2022NeRFFaceEditing: Disentangled Face Editing in Neural Radiance Fieldscited by 33
  6. 2023A Large-Scale Outdoor Multi-modal Dataset and Benchmark for Novel View Synthesis and Implicit Scene Reconstructioncited by 32
  7. 2023CoGS: Controllable Gaussian Splattingcited by 32
  8. 2022NeuWigs: A Neural Dynamic Model for Volumetric Hair Capture and Animationcited by 30
  9. 2022EditableNeRF: Editing Topologically Varying Neural Radiance Fields by Key Pointscited by 30
  10. 2024Recent Trends in 3D Reconstruction of General Non-Rigid Scenescited by 28
  11. 2023BeyondPixels: A Comprehensive Review of the Evolution of Neural Radiance Fieldscited by 27
  12. 2023CVTHead: One-shot Controllable Head Avatar with Vertex-feature Transformercited by 24
  13. 20253D Scene Generation: A Surveycited by 24
  14. 2024Morphable Diffusion: 3D-Consistent Diffusion for Single-image Avatar Creationcited by 23
  15. 2023ActorsNeRF: Animatable Few-shot Human Rendering with Generalizable NeRFscited by 21
  16. 2023DyLiN: Making Light Field Networks Dynamiccited by 20
  17. 2023Local 3D Editing via 3D Distillation of CLIP Knowledgecited by 20
  18. 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
  19. 2024D-MiSo: Editing Dynamic 3D Scenes using Multi-Gaussians Soupcited by 18
  20. 2023Template-free Articulated Neural Point Clouds for Reposable View Synthesiscited by 15
  21. 2024CoARF: Controllable 3D Artistic Style Transfer for Radiance Fieldscited by 14
  22. 2023FaceCLIPNeRF: Text-driven 3D Face Manipulation using Deformable Neural Radiance Fieldscited by 12
  23. 2022Points2NeRF: Generating Neural Radiance Fields from 3D point cloudcited by 11
  24. 2023USB-NeRF: Unrolling Shutter Bundle Adjusted Neural Radiance Fieldscited by 11
  25. 2023Neural Impostor: Editing Neural Radiance Fields with Explicit Shape Manipulationcited by 11
  26. 2025ODE-GS: Latent ODEs for Dynamic Scene Extrapolation with 3D Gaussian Splattingcited by 11
  27. 2023Frequency-Modulated Point Cloud Rendering with Easy Editingcited by 10
  28. 2023LucidDreaming: Controllable Object-Centric 3D Generationcited by 10
  29. 2024Semantically-aware Neural Radiance Fields for Visual Scene Understanding: A Comprehensive Reviewcited by 9
  30. 2023NaviNeRF: NeRF-based 3D Representation Disentanglement by Latent Semantic Navigationcited by 8
  31. 2023Interactive Geometry Editing of Neural Radiance Fieldscited by 7
  32. 2023Point-Based Radiance Fields for Controllable Human Motion Synthesiscited by 7
  33. 2023BlendFields: Few-Shot Example-Driven Facial Modelingcited by 6
  34. 2024LiveScene: Language Embedding Interactive Radiance Fields for Physical Scene Rendering and Controlcited by 6
  35. 2023Dyn-E: Local Appearance Editing of Dynamic Neural Radiance Fieldscited by 5
  36. 2023Total Selfie: Generating Full-Body Selfiescited by 5
  37. 2025Hypo3D: Exploring Hypothetical Reasoning in 3Dcited by 5
  38. 2022AE-NeRF: Auto-Encoding Neural Radiance Fields for 3D-Aware Object Manipulationcited by 4

50 most cited of 65 All 65 (JSON)