Neural Articulated Radiance Field
Not on the map. Why?
Abstract (arXiv)
We present Neural Articulated Radiance Field (NARF), a novel deformable 3D representation for articulated objects learned from images. While recent advances in 3D implicit representation have made it possible to learn models of complex objects, learning pose-controllable representations of articulated objects remains a challenge, as current methods require 3D shape supervision and are unable to render appearance. In formulating an implicit representation of 3D articulated objects, our method considers only the rigid transformation of the most relevant object part in solving for the radiance field at each 3D location. In this way, the proposed method represents pose-dependent changes without significantly increasing the computational complexity. NARF is fully differentiable and can be trained from images with pose annotations. Moreover, through the use of an autoencoder, it can learn appearance variations over multiple instances of an object class. Experiments show that the proposed method is efficient and can generalize well to novel poses. The code is available for research purposes at https://github.com/nogu-atsu/NARF
Key facts. Cited by 196 papers in the map (data through 7 Oct 2026). Builds on 51 of its 73 references that are in the map. First posted on arXiv 7 Apr 2021.
Builds on
51 of 73 references.
References · 51
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
- 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
38 more
- 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
- 2019Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelinescited by 672
- 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
- 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
- 2020Local Implicit Grid Representations for 3D Scenescited by 372
- 2017Learning from Synthetic Humanscited by 358
- 2018Image Generation from Scene Graphscited by 324
- 2018Everybody Dance Nowcited by 313
- 20163D Menagerie: Modeling the 3D shape and pose of animalscited by 310
- 2019DeepView: View Synthesis with Learned Gradient Descentcited by 253
- 2017Pose Guided Person Image Generationcited by 251
- 2019Learning Shape Templates with Structured Implicit Functionscited by 242
- 2019Texture Fields: Learning Texture Representations in Function Spacecited by 210
- 2017Learning a Multi-View Stereo Machinecited by 194
- 2020STAR: Sparse Trained Articulated Human Body Regressorcited by 194
- 2019Pushing the Boundaries of View Extrapolation with Multiplane Imagescited by 191
- 2019DeepHuman: 3D Human Reconstruction from a Single Imagecited by 182
- 2017Multi-view Supervision for Single-view Reconstruction via Differentiable Ray Consistencycited by 177
- 2016Panoptic Studio: A Massively Multiview System for Social Interaction Capturecited by 173
- 2016View Synthesis by Appearance Flowcited by 172
- 2017Deformable GANs for Pose-based Human Image Generationcited by 166
- 2019NASA: Neural Articulated Shape Approximationcited by 149
- 2018A Variational U-Net for Conditional Appearance and Shape Generationcited by 124
- 2015Deep Convolutional Inverse Graphics Networkcited by 121
- 2016Perspective Transformer Nets: Learning Single-View 3D Object Reconstruction without 3D Supervisioncited by 106
- 2017Disentangled Person Image Generationcited by 98
- 2018Synthesizing Images of Humans in Unseen Posescited by 96
- 2020SRNet: Improving Generalization in 3D Human Pose Estimation with a Split-and-Recombine Approachcited by 94
- 2017Learning to Generate Long-term Future via Hierarchical Predictioncited by 88
- 2020STaR: Self-supervised Tracking and Reconstruction of Rigid Objects in Motion with Neural Renderingcited by 76
- 2015Multi-view 3D Models from Single Images with a Convolutional Networkcited by 57
- 2016SE3-Nets: Learning Rigid Body Motion using Deep Neural Networkscited by 48
- 2016Deep Kinematic Pose Regressioncited by 40
- 2017A Generative Model of People in Clothingcited by 37
- 2014Learning to Generate Chairs, Tables and Cars with Convolutional Networkscited by 26
- 2016Single Image 3D Interpreter Networkcited by 19
- 2018Learning and Tracking the 3D Body Shape of Freely Moving Infants from RGB-D sequencescited by 19
- 2013Approximate Bayesian Image Interpretation using Generative Probabilistic Graphics Programscited by 10
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2021: 18; 2022: 59; 2023: 71; 2024: 29; 2025: 11; 2026: 8.
196 papers.
Sort:
By area:
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
- 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 370
- 2021Advances in Neural Renderingcited by 365
- 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 344
- 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 331
- 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 311
- 2021Neural Head Avatars from Monocular RGB Videoscited by 212
- 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 199
- 2021BANMo: Building Animatable 3D Neural Models from Many Casual Videoscited by 195
- 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
38 more
- 2022TAVA: Template-free Animatable Volumetric Actorscited by 172
- 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
- 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 166
- 2023HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motioncited by 161
- 2021H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motioncited by 157
- 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Modelscited by 154
- 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 154
- 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 152
- 2022NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fieldscited by 151
- 2022ARAH: Animatable Volume Rendering of Articulated Human SDFscited by 139
- 2022InstantAvatar: Learning Avatars from Monocular Video in 60 Secondscited by 138
- 2023Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decompositioncited by 134
- 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
- 2023GART: Gaussian Articulated Template Modelscited by 121
- 2021NeSF: Neural Semantic Fields for Generalizable Semantic Segmentation of 3D Scenescited by 119
- 2022Semantic-Aware Implicit Neural Audio-Driven Video Portrait Generationcited by 119
- 2022Structured Local Radiance Fields for Human Avatar Modelingcited by 116
- 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 115
- 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 113
- 2022EVA3D: Compositional 3D Human Generation from 2D Image Collectionscited by 111
- 2022MagicPony: Learning Articulated 3D Animals in the Wildcited by 111
- 2023ASH: Animatable Gaussian Splats for Efficient and Photoreal Human Renderingcited by 104
- 2023DreamHuman: Animatable 3D Avatars from Textcited by 102
- 2022Generative Neural Articulated Radiance Fieldscited by 101
- 2024Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstructioncited by 100
- 2021MoFaNeRF: Morphable Facial Neural Radiance Fieldcited by 94
- 2023SHERF: Generalizable Human NeRF from a Single Imagecited by 88
- 2023MonoHuman: Animatable Human Neural Field from Monocular Videocited by 85
- 2022Deforming Radiance Fields with Cagescited by 78
- 2024StyleGaussian: Instant 3D Style Transfer with Gaussian Splattingcited by 78
- 2021Learning to Stylize Novel Viewscited by 76
- 2022gDNA: Towards Generative Detailed Neural Avatarscited by 72
- 2022NeuralDome: A Neural Modeling Pipeline on Multi-View Human-Object Interactionscited by 67
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
- 2021CoNeRF: Controllable Neural Radiance Fieldscited by 65
- 2022Unsupervised Learning of Efficient Geometry-Aware Neural Articulated Representationscited by 65
- 2022LISA: Learning Implicit Shape and Appearance of Handscited by 63
- 2021DOVE: Learning Deformable 3D Objects by Watching Videoscited by 61
50 most cited of 196 All 196 (JSON)
- 2026Temporal Residual Neural Radiance Fields for Monocular Video Dynamic Human Body Reconstruction4 Sep 2026
- 2026LUNA: Learning Universal 3D Human Animation Beyond Skinning30 Jun 2026
- 2026URDF Synthesis from RGB-D Sequences via Differentiable Joint Inference and Energy-Consistent Verification17 Jun 2026
- 2026SCAPO: Self-Supervised Category-Level Articulated Pose Estimation from a Single 3D Observation1 Jun 2026
- 2026ArtMesh: Part-Aware Articulated Mesh Fields with Motion-Consistent Dynamics15 May 2026
- 2026Real-Time Human Reconstruction and Animation using Feed-Forward Gaussian Splatting11 Apr 2026
- 2026HumANDiff: Articulated Noise Diffusion for Motion-Consistent Human Video Generation7 Apr 2026
- 2026Quantum Implicit Neural Representations for Novel View Synthesis8 Jan 2026
- 2025MPMAvatar: Learning 3D Gaussian Avatars with Accurate and Robust Physics-Based Dynamics2 Oct 2025
- 2025Parametric Gaussian Human Model: Generalizable Prior for Efficient and Realistic Human Avatar Modeling7 Jun 2025
- 2025Advances in Radiance Field for Dynamic Scene: From Neural Field to Gaussian Field15 May 2025
- 2025Feature4X: Bridging Any Monocular Video to 4D Agentic AI with Versatile Gaussian Feature Fields26 Mar 2025
38 more
- 2025RePerformer: Immersive Human-centric Volumetric Videos from Playback to Photoreal Reperformance15 Mar 2025
- 2025Learning High-Fidelity Robot Self-Model with Articulated 3D Gaussian Splatting7 Mar 2025
- 2025Vid2Avatar-Pro: Authentic Avatar from Videos in the Wild via Universal Prior3 Mar 2025
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splatting26 Feb 2025
- 2025HumanGif: Single-View Human Diffusion with Generative Prior17 Feb 2025
- 2025Deblur-Avatar: Animatable Avatars from Motion-Blurred Monocular Videos23 Jan 2025
- 2025NeRFs are Mirror Detectors: Using Structural Similarity for Multi-View Mirror Scene Reconstruction with 3D Surface Primitives7 Jan 2025
- 2024CTRL-D: Controllable Dynamic 3D Scene Editing with Personalized 2D Diffusion2 Dec 2024
- 2024Motion-Aware Animatable Gaussian Avatars Deblurring24 Nov 2024
- 2024TalkinNeRF: Animatable Neural Fields for Full-Body Talking Humans25 Sep 2024
- 2024TEDRA: Text-based Editing of Dynamic and Photoreal Actors28 Aug 2024
- 20243D-Consistent Human Avatars with Sparse Inputs via Gaussian Splatting and Contrastive Learning19 Aug 2024
- 2024Garment Animation NeRF with Color Editing29 Jul 2024
- 2024iHuman: Instant Animatable Digital Humans From Monocular Videos15 Jul 2024
- 20243DEgo: 3D Editing on the Go!14 Jul 2024
- 2024MIGS: Multi-Identity Gaussian Splatting via Tensor Decomposition10 Jul 2024
- 2024Fine-Grained Multi-View Hand Reconstruction Using Inverse Rendering8 Jul 2024
- 2024Articulate your NeRF: Unsupervised articulated object modeling via conditional view synthesis24 Jun 2024
- 20244DRecons: 4D Neural Implicit Deformable Objects Reconstruction from a single RGB-D Camera with Geometrical and Topological Regularizations14 Jun 2024
- 2024A Survey on 3D Human Avatar Modeling -- From Reconstruction to Generation6 Jun 2024
- 2024Representing Animatable Avatar via Factorized Neural Fields2 Jun 2024
- 2024HINT: Learning Complete Human Neural Representations from Limited Viewpoints30 May 2024
- 2024AtomGS: Atomizing Gaussian Splatting for High-Fidelity Radiance Field20 May 2024
- 2024Generalizable Neural Human Renderer22 Apr 2024
- 2024REACTO: Reconstructing Articulated Objects from a Single Video17 Apr 2024
- 2024LetsGo: Large-Scale Garage Modeling and Rendering via LiDAR-Assisted Gaussian Primitives15 Apr 2024
- 2024PhysAvatar: Learning the Physics of Dressed 3D Avatars from Visual Observations5 Apr 2024
- 2024SurMo: Surface-based 4D Motion Modeling for Dynamic Human Rendering1 Apr 2024
- 2024Within the Dynamic Context: Inertia-aware 3D Human Modeling with Pose Sequence28 Mar 2024
- 2024UV Gaussians: Joint Learning of Mesh Deformation and Gaussian Textures for Human Avatar Modeling18 Mar 2024
- 2024Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstruction18 Mar 2024
- 2024BiTT: Bi-directional Texture Reconstruction of Interacting Two Hands from a Single Image13 Mar 2024
- 2024StyleGaussian: Instant 3D Style Transfer with Gaussian Splatting12 Mar 2024
- 2024NToP: NeRF-Powered Large-scale Dataset Generation for 2D and 3D Human Pose Estimation in Top-View Fisheye Images28 Feb 2024
- 2024AniDress: Animatable Loose-Dressed Avatar from Sparse Views Using Garment Rigging Model27 Jan 2024
- 2024Gaussian Shadow Casting for Neural Characters11 Jan 2024
- 2023HISR: Hybrid Implicit Surface Representation for Photorealistic 3D Human Reconstruction28 Dec 2023
- 2023Deformable 3D Gaussian Splatting for Animatable Human Avatars22 Dec 2023
50 newest of 196 All 196 (JSON)
- 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 166
- 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Modelscited by 154
- 2023HumanLiff: Layer-wise 3D Human Generation with Diffusion Modelcited by 23
- 20243DEgo: 3D Editing on the Go!cited by 10
- 2025HumanGif: Single-View Human Diffusion with Generative Priorcited by 7
- 2023MVHuman: Tailoring 2D Diffusion with Multi-view Sampling For Realistic 3D Human Generationcited by 6
- 2024TEDRA: Text-based Editing of Dynamic and Photoreal Actorscited by 1
- 2026HumANDiff: Articulated Noise Diffusion for Motion-Consistent Human Video Generationcited by 0
- 2026HumANDiff: Articulated Noise Diffusion for Motion-Consistent Human Video Generation7 Apr 2026
- 2025HumanGif: Single-View Human Diffusion with Generative Prior17 Feb 2025
- 2024TEDRA: Text-based Editing of Dynamic and Photoreal Actors28 Aug 2024
- 20243DEgo: 3D Editing on the Go!14 Jul 2024
- 2023MVHuman: Tailoring 2D Diffusion with Multi-view Sampling For Realistic 3D Human Generation15 Dec 2023
- 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructions27 Nov 2023
- 2023HumanLiff: Layer-wise 3D Human Generation with Diffusion Model18 Aug 2023
- 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Models3 Apr 2023
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
- 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 370
- 2021Advances in Neural Renderingcited by 365
- 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 344
- 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 331
- 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 311
- 2021Neural Head Avatars from Monocular RGB Videoscited by 212
- 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 199
- 2021BANMo: Building Animatable 3D Neural Models from Many Casual Videoscited by 195
- 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
12 most cited of 188 All 188 (JSON)
- 2026Temporal Residual Neural Radiance Fields for Monocular Video Dynamic Human Body Reconstruction4 Sep 2026
- 2026LUNA: Learning Universal 3D Human Animation Beyond Skinning30 Jun 2026
- 2026URDF Synthesis from RGB-D Sequences via Differentiable Joint Inference and Energy-Consistent Verification17 Jun 2026
- 2026SCAPO: Self-Supervised Category-Level Articulated Pose Estimation from a Single 3D Observation1 Jun 2026
- 2026ArtMesh: Part-Aware Articulated Mesh Fields with Motion-Consistent Dynamics15 May 2026
- 2026Real-Time Human Reconstruction and Animation using Feed-Forward Gaussian Splatting11 Apr 2026
- 2026Quantum Implicit Neural Representations for Novel View Synthesis8 Jan 2026
- 2025MPMAvatar: Learning 3D Gaussian Avatars with Accurate and Robust Physics-Based Dynamics2 Oct 2025
- 2025Parametric Gaussian Human Model: Generalizable Prior for Efficient and Realistic Human Avatar Modeling7 Jun 2025
- 2025Advances in Radiance Field for Dynamic Scene: From Neural Field to Gaussian Field15 May 2025
- 2025Feature4X: Bridging Any Monocular Video to 4D Agentic AI with Versatile Gaussian Feature Fields26 Mar 2025
- 2025RePerformer: Immersive Human-centric Volumetric Videos from Playback to Photoreal Reperformance15 Mar 2025
12 newest of 188 All 188 (JSON)