MUA: Mobile Ultra-detailed Animatable Avatars
Not on the map. Why?
Abstract (arXiv)
Building photorealistic, animatable full-body digital humans remains a longstanding challenge in computer graphics and vision. Recent advances in animatable avatar modeling have largely progressed along two directions: improving the fidelity of dynamic geometry and appearance, or reducing computational complexity to enable deployment on resource-constrained platforms, e.g., VR headsets. However, existing approaches fail to achieve both goals simultaneously: Ultra-high-fidelity avatars typically require substantial computation on server-class GPUs, whereas lightweight avatars often suffer from limited surface dynamics, reduced appearance details, and noticeable artifacts. To bridge this gap, we propose a novel animatable avatar representation, termed Wavelet-guided Multi-level Spatial Factorized Blendshapes, and a corresponding distillation pipeline that transfers motion-aware clothing dynamics and fine-grained appearance details from a pre-trained ultra-high-quality avatar model into a compact, efficient representation. By coupling multi-level wavelet spectral decomposition with low-rank structural factorization in texture space, our method achieves up to 2000X lower computational cost and a 10X smaller model size than the original high-quality teacher avatar model, while preserving visually plausible dynamics and appearance details closely resemble those of the teacher model. Extensive comparisons with state-of-the-art methods show that our approach significantly outperforms existing avatar approaches designed for mobile settings and achieves comparable or superior rendering quality to most approaches that can only run on servers. Importantly, our representation substantially improves the practicality of high-fidelity avatars for immersive applications, achieving over 180 FPS on a desktop PC and real-time native on-device performance at 24 FPS on a standalone Meta Quest 3.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 67 of its 86 references that are in the map. First posted on arXiv 20 Apr 2026.
Builds on
67 of 86 references.
References · 67
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 703
- 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
- 2023CoTracker: It is Better to Track Togethercited by 522
38 more
- 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 314
- 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
- 2018Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodiescited by 239
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
- 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
- 2020STAR: Sparse Trained Articulated Human Body Regressorcited by 194
- 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 191
- 2022TAVA: Template-free Animatable Volumetric Actorscited by 172
- 2024SplattingAvatar: Realistic Real-Time Human Avatars with Mesh-Embedded Gaussian Splattingcited by 172
- 2019Learning to Reconstruct People in Clothing from a Single RGB Cameracited by 168
- 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
- 2020DeepCap: Monocular Human Performance Capture Using Weak Supervisioncited by 162
- 2023HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motioncited by 161
- 2021Neural Human Performer: Learning Generalizable Radiance Fields for Human Performance Renderingcited by 158
- 2021H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motioncited by 157
- 2023HUGS: Human Gaussian Splatscited by 154
- 2022ARAH: Animatable Volume Rendering of Articulated Human SDFscited by 139
- 2021Real-time Deep Dynamic Characterscited by 133
- 2021Pixel Codec Avatarscited by 127
- 2023GART: Gaussian Articulated Template Modelscited by 121
- 2018Detailed Human Avatars from Monocular Videocited by 109
- 2023ASH: Animatable Gaussian Splats for Efficient and Photoreal Human Renderingcited by 104
- 2018LiveCap: Real-time Human Performance Capture from Monocular Videocited by 93
- 2021The Power of Points for Modeling Humans in Clothingcited by 90
- 2023AvatarReX: Real-time Expressive Full-body Avatarscited by 84
- 2018Image Inpainting via Generative Multi-column Convolutional Neural Networkscited by 81
- 2021Driving-Signal Aware Full-Body Avatarscited by 81
- 2020Learning Compositional Radiance Fields of Dynamic Human Headscited by 78
- 2023SIFU: Side-view Conditioned Implicit Function for Real-world Usable Clothed Human Reconstructioncited by 77
- 2021SCALE: Modeling Clothed Humans with a Surface Codec of Articulated Local Elementscited by 72
- 2024Analytic-Splatting: Anti-Aliased 3D Gaussian Splatting via Analytic Integrationcited by 67
- 2021Modeling Clothing as a Separate Layer for an Animatable Human Avatarcited by 66
- 2019Textured Neural Avatarscited by 65
- 2022Drivable Volumetric Avatars using Texel-Aligned Featurescited by 62
- 2024Representing Long Volumetric Video with Temporal Gaussian Hierarchycited by 58
50 most cited of 67 All 67 (JSON)
Built on by
Not cited yet.