Motion-Aware Animatable Gaussian Avatars Deblurring
Not on the map. Why?
Abstract (arXiv)
The creation of 3D human avatars from multi-view videos is a significant yet challenging task in computer vision. However, existing techniques rely on high-quality, sharp images as input, which are often impractical to obtain in real-world scenarios due to variations in human motion speed and intensity. This paper introduces a novel method for directly reconstructing sharp 3D human Gaussian avatars from blurry videos. The proposed approach incorporates a 3D-aware, physics-based model of blur formation caused by human motion, together with a 3D human motion model designed to resolve ambiguities in motion-induced blur. This framework enables the joint optimization of the avatar representation and motion parameters from a coarse initialization. Comprehensive benchmarks are established using both a synthetic dataset and a real-world dataset captured with a 360-degree synchronous hybrid-exposure camera system. Extensive evaluations demonstrate the effectiveness of the model across diverse conditions. Codes Available: https://github.com/MyNiuuu/MAD-Avatar
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 80 of its 110 references that are in the map. First posted on arXiv 24 Nov 2024.
Builds on
80 of 110 references.
References · 80
- 2023Segment Anythingcited by 8,158
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2017Deformable Convolutional Networkscited by 1,481
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
- 2021Multi-Stage Progressive Image Restorationcited by 813
- 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 722
- 2018Deformable ConvNets v2: More Deformable, Better Resultscited by 666
- 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
- 2020Zero-Reference Deep Curve Estimation for Low-Light Image Enhancementcited by 541
- 2019EDVR: Video Restoration with Enhanced Deformable Convolutional Networkscited by 492
38 more
- 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
- 2017DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networkscited by 366
- 2019DeblurGAN-v2: Deblurring (Orders-of-Magnitude) Faster and Bettercited by 361
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2021NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Imagescited by 336
- 2018Scale-recurrent Network for Deep Image Deblurringcited by 332
- 2022NeuMan: Neural Human Radiance Field from a Single Videocited by 244
- 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
- 2022VRT: A Video Restoration Transformercited by 219
- 2020Real-Time Intermediate Flow Estimation for Video Frame Interpolationcited by 211
- 2021Neural Articulated Radiance Fieldcited by 196
- 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
- 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 190
- 2021Deblur-NeRF: Neural Radiance Fields from Blurry Imagescited by 179
- 2022TAVA: Template-free Animatable Volumetric Actorscited by 172
- 2022Recurrent Video Restoration Transformer with Guided Deformable Attentioncited by 168
- 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
- 2021H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motioncited by 157
- 2023HUGS: Human Gaussian Splatscited by 154
- 2022ARAH: Animatable Volume Rendering of Articulated Human SDFscited by 139
- 2022InstantAvatar: Learning Avatars from Monocular Video in 60 Secondscited by 138
- 2023Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decompositioncited by 134
- 2023GART: Gaussian Articulated Template Modelscited by 121
- 2023Drivable 3D Gaussian Avatarscited by 120
- 2024MVSplat360: Feed-Forward 360 Scene Synthesis from Sparse Viewscited by 111
- 2019Spatio-Temporal Filter Adaptive Network for Video Deblurringcited by 106
- 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priorscited by 106
- 2023Human Gaussian Splatting: Real-time Rendering of Animatable Avatarscited by 105
- 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videoscited by 105
- 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
- 2024Dynamic Gaussian Marbles for Novel View Synthesis of Casual Monocular Videoscited by 96
- 2024MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Modelcited by 87
- 2020Cascaded Deep Video Deblurring Using Temporal Sharpness Priorcited by 85
- 2023MonoHuman: Animatable Human Neural Field from Monocular Videocited by 85
- 2022BAD-NeRF: Bundle Adjusted Deblur Neural Radiance Fieldscited by 80
- 2022DP-NeRF: Deblurred Neural Radiance Field with Physical Scene Priorscited by 70
- 2023Learning Neural Volumetric Representations of Dynamic Humans in Minutescited by 70
- 2022A Simple Baseline for Video Restoration with Grouped Spatial-temporal Shiftcited by 68
50 most cited of 80 All 80 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 3; 2026: 2.
6 papers.
- 2024Sequential Gaussian Avatars with Hierarchical Motion Contextcited by 9
- 2026WorldSculpt: Generating Compositional Worlds from Grounded Videoscited by 2
- 2025On the Skinning of Gaussian Avatarscited by 1
- 2025Dynamic Gaussian Splatting from Defocused and Motion-blurred Monocular Videoscited by 1
- 2025Visionary: The World Model Carrier Built on WebGPU-Powered Gaussian Splatting Platformcited by 1
- 2026Scanline-Aware Animatable Gaussian Avatars from Rolling-Shutter Videoscited by 0
- 2026WorldSculpt: Generating Compositional Worlds from Grounded Videos4 Sep 2026
- 2026Scanline-Aware Animatable Gaussian Avatars from Rolling-Shutter Videos18 Aug 2026
- 2025Visionary: The World Model Carrier Built on WebGPU-Powered Gaussian Splatting Platform9 Dec 2025
- 2025Dynamic Gaussian Splatting from Defocused and Motion-blurred Monocular Videos12 Oct 2025
- 2025On the Skinning of Gaussian Avatars14 Sep 2025
- 2024Sequential Gaussian Avatars with Hierarchical Motion Context25 Nov 2024