ANR: Articulated Neural Rendering for Virtual Avatars
Not on the map. Why?
Abstract (arXiv)
The combination of traditional rendering with neural networks in Deferred Neural Rendering (DNR) provides a compelling balance between computational complexity and realism of the resulting images. Using skinned meshes for rendering articulating objects is a natural extension for the DNR framework and would open it up to a plethora of applications. However, in this case the neural shading step must account for deformations that are possibly not captured in the mesh, as well as alignment inaccuracies and dynamics -- which can confound the DNR pipeline. We present Articulated Neural Rendering (ANR), a novel framework based on DNR which explicitly addresses its limitations for virtual human avatars. We show the superiority of ANR not only with respect to DNR but also with methods specialized for avatar creation and animation. In two user studies, we observe a clear preference for our avatar model and we demonstrate state-of-the-art performance on quantitative evaluation metrics. Perceptually, we observe better temporal stability, level of detail and plausibility.
Key facts. Cited by 55 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 19; 2023: 18; 2024: 3; 2025: 3; 2026: 1.
55 papers.
Sort:
By area:
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2022Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representationcited by 243
- 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
- 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
- 2022TAVA: Template-free Animatable Volumetric Actorscited by 172
- 2022ARAH: Animatable Volume Rendering of Articulated Human SDFscited by 139
- 2022Structured Local Radiance Fields for Human Avatar Modelingcited by 116
- 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 115
- 2021Neural Actor: Neural Free-view Synthesis of Human Actors with Pose Controlcited by 106
- 2021The Power of Points for Modeling Humans in Clothingcited by 90
- 2023AvatarReX: Real-time Expressive Full-body Avatarscited by 83
- 2021MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Imagescited by 78
38 more
- 2022KeypointNeRF: Generalizing Image-based Volumetric Avatars using Relative Spatial Encoding of Keypointscited by 77
- 2023Learning Neural Volumetric Representations of Dynamic Humans in Minutescited by 70
- 2021Modeling Clothing as a Separate Layer for an Animatable Human Avatarcited by 66
- 2022Drivable Volumetric Avatars using Texel-Aligned Featurescited by 62
- 2022PINA: Learning a Personalized Implicit Neural Avatar from a Single RGB-D Video Sequencecited by 46
- 2021Pose with Style: Detail-Preserving Pose-Guided Image Synthesis with Conditional StyleGANcited by 45
- 2022Relighting4D: Neural Relightable Human from Videoscited by 41
- 2022Generalizable Neural Performer: Learning Robust Radiance Fields for Human Novel View Synthesiscited by 40
- 2021HVTR: Hybrid Volumetric-Textural Rendering for Human Avatarscited by 33
- 2022Animatable Implicit Neural Representations for Creating Realistic Avatars from Videoscited by 33
- 2021VariTex: Variational Neural Face Texturescited by 30
- 2024HAHA: Highly Articulated Gaussian Human Avatars with Textured Mesh Priorcited by 30
- 2023DINAR: Diffusion Inpainting of Neural Textures for One-Shot Human Avatarscited by 28
- 2023NVFi: Neural Velocity Fields for 3D Physics Learning from Dynamic Videoscited by 28
- 2021Dynamic Neural Garmentscited by 27
- 2023HumanLiff: Layer-wise 3D Human Generation with Diffusion Modelcited by 23
- 2023Drivable Avatar Clothing: Faithful Full-Body Telepresence with Dynamic Clothing Driven by Sparse RGB-D Inputcited by 22
- 2023CaPhy: Capturing Physical Properties for Animatable Human Avatarscited by 20
- 2022Dressing Avatars: Deep Photorealistic Appearance for Physically Simulated Clothingcited by 19
- 2023Neural Image-based Avatars: Generalizable Radiance Fields for Human Avatar Modelingcited by 19
- 2023Holoported Characters: Real-time Free-viewpoint Rendering of Humans from Sparse RGB Camerascited by 17
- 2021Dance In the Wild: Monocular Human Animation with Neural Dynamic Appearance Synthesiscited by 14
- 2022Learning Motion-Dependent Appearance for High-Fidelity Rendering of Dynamic Humans from a Single Cameracited by 12
- 2022Neural Mesh-Based Graphicscited by 12
- 2022HDHumans: A Hybrid Approach for High-fidelity Digital Humanscited by 12
- 2022RANA: Relightable Articulated Neural Avatarscited by 12
- 2024SurMo: Surface-based 4D Motion Modeling for Dynamic Human Renderingcited by 9
- 2022Collaborative Neural Rendering using Anime Character Sheetscited by 8
- 2023Self-supervised Learning of Implicit Shape Representation with Dense Correspondence for Deformable Objectscited by 8
- 2025Kinematify: Open-Vocabulary Synthesis of High-DoF Articulated Objectscited by 8
- 2023MoRF: Mobile Realistic Fullbody Avatars from a Monocular Videocited by 7
- 2023Replay: Multi-modal Multi-view Acted Videos for Casual Holographycited by 6
- 2023LANe: Lighting-Aware Neural Fields for Compositional Scene Synthesiscited by 5
- 2023CAT-NeRF: Constancy-Aware Tx2Former for Dynamic Body Modelingcited by 3
- 2022DRaCoN -- Differentiable Rasterization Conditioned Neural Radiance Fields for Articulated Avatarscited by 2
- 2023Efficient Meshy Neural Fields for Animatable Human Avatarscited by 2
- 2024One-shot Human Motion Transfer via Occlusion-Robust Flow Prediction and Neural Texturingcited by 2
- 2025DNRSelect: Active Best View Selection for Deferred Neural Renderingcited by 2
50 most cited of 55 All 55 (JSON)
- 2026HumANDiff: Articulated Noise Diffusion for Motion-Consistent Human Video Generation7 Apr 2026
- 2025Frequency-Decomposed Avatar Representation for Varying Camera Distances3 Dec 2025
- 2025Kinematify: Open-Vocabulary Synthesis of High-DoF Articulated Objects3 Nov 2025
- 2025DNRSelect: Active Best View Selection for Deferred Neural Rendering21 Jan 2025
- 2024One-shot Human Motion Transfer via Occlusion-Robust Flow Prediction and Neural Texturing9 Dec 2024
- 2024SurMo: Surface-based 4D Motion Modeling for Dynamic Human Rendering1 Apr 2024
- 2024HAHA: Highly Articulated Gaussian Human Avatars with Textured Mesh Prior1 Apr 2024
- 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splatting14 Dec 2023
- 2023Holoported Characters: Real-time Free-viewpoint Rendering of Humans from Sparse RGB Cameras12 Dec 2023
- 2023NVFi: Neural Velocity Fields for 3D Physics Learning from Dynamic Videos11 Dec 2023
- 2023Drivable Avatar Clothing: Faithful Full-Body Telepresence with Dynamic Clothing Driven by Sparse RGB-D Input9 Oct 2023
- 2023Self-supervised Learning of Implicit Shape Representation with Dense Correspondence for Deformable Objects24 Aug 2023
38 more
- 2023HumanLiff: Layer-wise 3D Human Generation with Diffusion Model18 Aug 2023
- 2023CaPhy: Capturing Physical Properties for Animatable Human Avatars11 Aug 2023
- 2023Replay: Multi-modal Multi-view Acted Videos for Casual Holography22 Jul 2023
- 2023AvatarReX: Real-time Expressive Full-body Avatars8 May 2023
- 2023CAT-NeRF: Constancy-Aware Tx2Former for Dynamic Body Modeling16 Apr 2023
- 2023UVA: Towards Unified Volumetric Avatar for View Synthesis, Pose rendering, Geometry and Texture Editing14 Apr 2023
- 2023Neural Image-based Avatars: Generalizable Radiance Fields for Human Avatar Modeling10 Apr 2023
- 2023LANe: Lighting-Aware Neural Fields for Compositional Scene Synthesis6 Apr 2023
- 2023Efficient Meshy Neural Fields for Animatable Human Avatars23 Mar 2023
- 2023MoRF: Mobile Realistic Fullbody Avatars from a Monocular Video17 Mar 2023
- 2023DINAR: Diffusion Inpainting of Neural Textures for One-Shot Human Avatars16 Mar 2023
- 2023Learning Neural Volumetric Representations of Dynamic Humans in Minutes23 Feb 2023
- 2023AniPixel: Towards Animatable Pixel-Aligned Human Avatar7 Feb 2023
- 2022RANA: Relightable Articulated Neural Avatars6 Dec 2022
- 2022Deep Generative Models on 3D Representations: A Survey27 Oct 2022
- 2022HDHumans: A Hybrid Approach for High-fidelity Digital Humans21 Oct 2022
- 2022ARAH: Animatable Volume Rendering of Articulated Human SDFs18 Oct 2022
- 2022Neural Mesh-Based Graphics10 Aug 2022
- 2022Drivable Volumetric Avatars using Texel-Aligned Features20 Jul 2022
- 2022Relighting4D: Neural Relightable Human from Videos14 Jul 2022
- 2022Collaborative Neural Rendering using Anime Character Sheets12 Jul 2022
- 2022Dressing Avatars: Deep Photorealistic Appearance for Physically Simulated Clothing30 Jun 2022
- 2022TAVA: Template-free Animatable Volumetric Actors17 Jun 2022
- 2022KeypointNeRF: Generalizing Image-based Volumetric Avatars using Relative Spatial Encoding of Keypoints10 May 2022
- 2022Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representation9 May 2022
- 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modeling28 Apr 2022
- 2022Generalizable Neural Performer: Learning Robust Radiance Fields for Human Novel View Synthesis25 Apr 2022
- 2022DRaCoN -- Differentiable Rasterization Conditioned Neural Radiance Fields for Articulated Avatars29 Mar 2022
- 2022Structured Local Radiance Fields for Human Avatar Modeling28 Mar 2022
- 2022Learning Motion-Dependent Appearance for High-Fidelity Rendering of Dynamic Humans from a Single Camera24 Mar 2022
- 2022Animatable Implicit Neural Representations for Creating Realistic Avatars from Videos15 Mar 2022
- 2022PINA: Learning a Personalized Implicit Neural Avatar from a Single RGB-D Video Sequence3 Mar 2022
- 2021HVTR: Hybrid Volumetric-Textural Rendering for Human Avatars19 Dec 2021
- 2021Dance In the Wild: Monocular Human Animation with Neural Dynamic Appearance Synthesis10 Nov 2021
- 2021Pose with Style: Detail-Preserving Pose-Guided Image Synthesis with Conditional StyleGAN13 Sep 2021
- 2021The Power of Points for Modeling Humans in Clothing2 Sep 2021
- 2021Modeling Clothing as a Separate Layer for an Animatable Human Avatar28 Jun 2021
- 2021MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Images22 Jun 2021
50 newest of 55 All 55 (JSON)
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2022Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representationcited by 243
- 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
- 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
- 2022TAVA: Template-free Animatable Volumetric Actorscited by 172
- 2022ARAH: Animatable Volume Rendering of Articulated Human SDFscited by 139
- 2022Structured Local Radiance Fields for Human Avatar Modelingcited by 116
- 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 115
- 2021Neural Actor: Neural Free-view Synthesis of Human Actors with Pose Controlcited by 106
- 2021The Power of Points for Modeling Humans in Clothingcited by 90
- 2023AvatarReX: Real-time Expressive Full-body Avatarscited by 83
- 2021MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Imagescited by 78
12 most cited of 52 All 52 (JSON)
- 2025Frequency-Decomposed Avatar Representation for Varying Camera Distances3 Dec 2025
- 2025Kinematify: Open-Vocabulary Synthesis of High-DoF Articulated Objects3 Nov 2025
- 2025DNRSelect: Active Best View Selection for Deferred Neural Rendering21 Jan 2025
- 2024One-shot Human Motion Transfer via Occlusion-Robust Flow Prediction and Neural Texturing9 Dec 2024
- 2024SurMo: Surface-based 4D Motion Modeling for Dynamic Human Rendering1 Apr 2024
- 2024HAHA: Highly Articulated Gaussian Human Avatars with Textured Mesh Prior1 Apr 2024
- 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splatting14 Dec 2023
- 2023Holoported Characters: Real-time Free-viewpoint Rendering of Humans from Sparse RGB Cameras12 Dec 2023
- 2023NVFi: Neural Velocity Fields for 3D Physics Learning from Dynamic Videos11 Dec 2023
- 2023Drivable Avatar Clothing: Faithful Full-Body Telepresence with Dynamic Clothing Driven by Sparse RGB-D Input9 Oct 2023
- 2023Self-supervised Learning of Implicit Shape Representation with Dense Correspondence for Deformable Objects24 Aug 2023
- 2023CaPhy: Capturing Physical Properties for Animatable Human Avatars11 Aug 2023
12 newest of 52 All 52 (JSON)