mlsanityData to 14 Oct 2026

Deforming Radiance Fields with Cages

arXiv 2207.12298 ↗First posted 25 Jul 2022cs.CVcited by 78

Not on the map. Why?

Abstract (arXiv)

Recent advances in radiance fields enable photorealistic rendering of static or dynamic 3D scenes, but still do not support explicit deformation that is used for scene manipulation or animation. In this paper, we propose a method that enables a new type of deformation of the radiance field: free-form radiance field deformation. We use a triangular mesh that encloses the foreground object called cage as an interface, and by manipulating the cage vertices, our approach enables the free-form deformation of the radiance field. The core of our approach is cage-based deformation which is commonly used in mesh deformation. We propose a novel formulation to extend it to the radiance field, which maps the position and the view direction of the sampling points from the deformed space to the canonical space, thus enabling the rendering of the deformed scene. The deformation results of the synthetic datasets and the real-world datasets demonstrate the effectiveness of our approach.

Key facts. Cited by 78 papers in the map (data through 14 Oct 2026). Builds on 34 of its 51 references that are in the map. First posted on arXiv 25 Jul 2022.

Builds on

34 of 51 references.

References · 34

  1. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  2. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  3. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
  4. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  5. 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
  6. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
  7. 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
  8. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 964
  9. 2020Neural Sparse Voxel Fieldscited by 959
  10. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  11. 2020PCT: Point cloud transformercited by 732
  12. 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 700
22 more
  1. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
  2. 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 471
  3. 2017Neural 3D Mesh Renderercited by 437
  4. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
  5. 2021NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Imagescited by 336
  6. 2018Learning Category-Specific Mesh Reconstruction from Image Collectionscited by 317
  7. 2020Neural Scene Graphs for Dynamic Scenescited by 298
  8. 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
  9. 2021Learning Object-Compositional Neural Radiance Field for Editable Scene Renderingcited by 228
  10. 2021Editing Conditional Radiance Fieldscited by 222
  11. 2022NeRF-Editing: Geometry Editing of Neural Radiance Fieldscited by 217
  12. 2021HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fieldscited by 214
  13. 2021Neural Articulated Radiance Fieldcited by 196
  14. 2016Learning a Predictable and Generative Vector Representation for Objectscited by 173
  15. 2021Editable Free-viewpoint Video Using a Layered Neural Representationcited by 148
  16. 2016Perspective Transformer Nets: Learning Single-View 3D Object Reconstruction without 3D Supervisioncited by 106
  17. 2019Neural Cages for Detail-Preserving 3D Deformationscited by 106
  18. 2021Neural Actor: Neural Free-view Synthesis of Human Actors with Pose Controlcited by 106
  19. 2020Object-Centric Neural Scene Renderingcited by 90
  20. 2021KeypointDeformer: Unsupervised 3D Keypoint Discovery for Shape Controlcited by 51
  21. 2021Watch It Move: Unsupervised Discovery of 3D Joints for Re-Posing of Articulated Objectscited by 50
  22. 2022Surface-Aligned Neural Radiance Fields for Controllable 3D Human Synthesiscited by 41

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 4; 2023: 32; 2024: 27; 2025: 11; 2026: 4.

78 papers.

Sort:

By area:

  1. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
  2. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 347
  3. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
  4. 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 297
  5. 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 168
  6. 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 155
  7. 2023Vox-E: Text-guided Voxel Editing of 3D Objectscited by 115
  8. 20243D Gaussian as a New Era: A Surveycited by 104
  9. 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editingcited by 94
  10. 2024StyleGaussian: Instant 3D Style Transfer with Gaussian Splattingcited by 79
  11. 2024TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Promptscited by 77
  12. 2022Interactive Segmentation of Radiance Fieldscited by 60
38 more
  1. 2023PIE-NeRF: Physics-based Interactive Elastodynamics with NeRFcited by 51
  2. 2023NeuralEditor: Editing Neural Radiance Fields via Manipulating Point Cloudscited by 41
  3. 2022ClimateNeRF: Extreme Weather Synthesis in Neural Radiance Fieldcited by 37
  4. 2023SHAP-EDITOR: Instruction-guided Latent 3D Editing in Secondscited by 37
  5. 2024Gaussian Splashing: Unified Particles for Versatile Motion Synthesis and Renderingcited by 37
  6. 2022VolTeMorph: Realtime, Controllable and Generalisable Animation of Volumetric Representationscited by 36
  7. 2023OR-NeRF: Object Removing from 3D Scenes Guided by Multiview Segmentation with Neural Radiance Fieldscited by 34
  8. 2023ScatterNeRF: Seeing Through Fog with Physically-Based Inverse Neural Renderingcited by 28
  9. 2024Mesh-based Gaussian Splatting for Real-time Large-scale Deformationcited by 28
  10. 2024Recent Trends in 3D Reconstruction of General Non-Rigid Scenescited by 28
  11. 2023BeyondPixels: A Comprehensive Review of the Evolution of Neural Radiance Fieldscited by 27
  12. 2023Point'n Move: Interactive Scene Object Manipulation on Gaussian Splatting Radiance Fieldscited by 27
  13. 2024AutoVFX: Physically Realistic Video Editing from Natural Language Instructionscited by 27
  14. 2023RecolorNeRF: Layer Decomposed Radiance Fields for Efficient Color Editing of 3D Scenescited by 25
  15. 2025HiMoR: Monocular Deformable Gaussian Reconstruction with Hierarchical Motion Representationcited by 22
  16. 2023Customize your NeRF: Adaptive Source Driven 3D Scene Editing via Local-Global Iterative Trainingcited by 21
  17. 2023RePaint-NeRF: NeRF Editting via Semantic Masks and Diffusion Modelscited by 19
  18. 2024Consolidating Attention Features for Multi-view Image Editingcited by 19
  19. 2024Mirror-3DGS: Incorporating Mirror Reflections into 3D Gaussian Splattingcited by 18
  20. 2024ConsistDreamer: 3D-Consistent 2D Diffusion for High-Fidelity Scene Editingcited by 18
  21. 2022SPIDR: SDF-based Neural Point Fields for Illumination and Deformationcited by 17
  22. 2023ProteusNeRF: Fast Lightweight NeRF Editing using 3D-Aware Image Contextcited by 17
  23. 2023Template-free Articulated Neural Point Clouds for Reposable View Synthesiscited by 15
  24. 2024CoARF: Controllable 3D Artistic Style Transfer for Radiance Fieldscited by 14
  25. 2023Neural Impostor: Editing Neural Radiance Fields with Explicit Shape Manipulationcited by 11
  26. 2024SIGNeRF: Scene Integrated Generation for Neural Radiance Fieldscited by 11
  27. 2024NeRF Analogies: Example-Based Visual Attribute Transfer for NeRFscited by 11
  28. 2024CTRL-D: Controllable Dynamic 3D Scene Editing with Personalized 2D Diffusioncited by 11
  29. 2023Frequency-Modulated Point Cloud Rendering with Easy Editingcited by 10
  30. 20243DEgo: 3D Editing on the Go!cited by 10
  31. 2023BLiRF: Bandlimited Radiance Fields for Dynamic Scene Modelingcited by 9
  32. 2023Interactive Geometry Editing of Neural Radiance Fieldscited by 7
  33. 2023Point-Based Radiance Fields for Controllable Human Motion Synthesiscited by 7
  34. 2024HumanCoser: Layered 3D Human Generation via Semantic-Aware Diffusion Modelcited by 7
  35. 2023BlendFields: Few-Shot Example-Driven Facial Modelingcited by 6
  36. 2023Instruct-Video2Avatar: Video-to-Avatar Generation with Instructionscited by 6
  37. 2024GeometrySticker: Enabling Ownership Claim of Recolorized Neural Radiance Fieldscited by 6
  38. 2024Space-time 2D Gaussian Splatting for Accurate Surface Reconstruction under Complex Dynamic Scenescited by 6

50 most cited of 78 All 78 (JSON)