Real-Time Animatable 2DGS-Avatars with Detail Enhancement from Monocular Videos
Not on the map. Why?
Abstract (arXiv)
High-quality, animatable 3D human avatar reconstruction from monocular videos offers significant potential for reducing reliance on complex hardware, making it highly practical for applications in game development, augmented reality, and social media. However, existing methods still face substantial challenges in capturing fine geometric details and maintaining animation stability, particularly under dynamic or complex poses. To address these issues, we propose a novel real-time framework for animatable human avatar reconstruction based on 2D Gaussian Splatting (2DGS). By leveraging 2DGS and global SMPL pose parameters, our framework not only aligns positional and rotational discrepancies but also enables robust and natural pose-driven animation of the reconstructed avatars. Furthermore, we introduce a Rotation Compensation Network (RCN) that learns rotation residuals by integrating local geometric features with global pose parameters. This network significantly improves the handling of non-rigid deformations and ensures smooth, artifact-free pose transitions during animation. Experimental results demonstrate that our method successfully reconstructs realistic and highly animatable human avatars from monocular videos, effectively preserving fine-grained details while ensuring stable and natural pose variation. Our approach surpasses current state-of-the-art methods in both reconstruction quality and animation robustness on public benchmarks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 40 references that are in the map. First posted on arXiv 1 May 2025.
Builds on
27 of 40 references.
References · 27
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
- 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
- 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
- 2020ARCH: Animatable Reconstruction of Clothed Humanscited by 257
- 2018Video Based Reconstruction of 3D People Modelscited by 238
- 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
- 2024CityGaussian: Real-time High-quality Large-Scale Scene Rendering with Gaussianscited by 192
- 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 191
- 2024SplattingAvatar: Realistic Real-Time Human Avatars with Mesh-Embedded Gaussian Splattingcited by 172
15 more
- 2022Instant Volumetric Head Avatarscited by 159
- 2023HUGS: Human Gaussian Splatscited by 154
- 2022SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Videocited by 144
- 2022InstantAvatar: Learning Avatars from Monocular Video in 60 Secondscited by 138
- 2023GART: Gaussian Articulated Template Modelscited by 121
- 2022Structured Local Radiance Fields for Human Avatar Modelingcited by 116
- 2018Detailed Human Avatars from Monocular Videocited by 109
- 2023Human Gaussian Splatting: Real-time Rendering of Animatable Avatarscited by 105
- 2019360-Degree Textures of People in Clothing from a Single Imagecited by 75
- 2021SCALE: Modeling Clothed Humans with a Surface Codec of Articulated Local Elementscited by 72
- 2023High-Fidelity Clothed Avatar Reconstruction from a Single Imagecited by 38
- 2022Animatable Implicit Neural Representations for Creating Realistic Avatars from Videoscited by 33
- 2020SparseFusion: Dynamic Human Avatar Modeling from Sparse RGBD Imagescited by 16
- 2024Surfel-based Gaussian Inverse Rendering for Fast and Relightable Dynamic Human Reconstruction from Monocular Videocited by 12
- 2023Explicifying Neural Implicit Fields for Efficient Dynamic Human Avatar Modeling via a Neural Explicit Surfacecited by 6
Built on by
Not cited yet.