mlsanityData to 7 Oct 2026

Motion-Aware Animatable Gaussian Avatars Deblurring

arXiv 2411.16758 ↗First posted 24 Nov 2024cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

The creation of 3D human avatars from multi-view videos is a significant yet challenging task in computer vision. However, existing techniques rely on high-quality, sharp images as input, which are often impractical to obtain in real-world scenarios due to variations in human motion speed and intensity. This paper introduces a novel method for directly reconstructing sharp 3D human Gaussian avatars from blurry videos. The proposed approach incorporates a 3D-aware, physics-based model of blur formation caused by human motion, together with a 3D human motion model designed to resolve ambiguities in motion-induced blur. This framework enables the joint optimization of the avatar representation and motion parameters from a coarse initialization. Comprehensive benchmarks are established using both a synthetic dataset and a real-world dataset captured with a 360-degree synchronous hybrid-exposure camera system. Extensive evaluations demonstrate the effectiveness of the model across diverse conditions. Codes Available: https://github.com/MyNiuuu/MAD-Avatar

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 80 of its 110 references that are in the map. First posted on arXiv 24 Nov 2024.

Builds on

80 of 110 references.

References · 80

  1. 2023Segment Anythingcited by 8,158
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  3. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  4. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  5. 2017Deformable Convolutional Networkscited by 1,481
  6. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  7. 2021Multi-Stage Progressive Image Restorationcited by 813
  8. 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 722
  9. 2018Deformable ConvNets v2: More Deformable, Better Resultscited by 666
  10. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
  11. 2020Zero-Reference Deep Curve Estimation for Low-Light Image Enhancementcited by 541
  12. 2019EDVR: Video Restoration with Enhanced Deformable Convolutional Networkscited by 492
38 more
  1. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  2. 2017DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networkscited by 366
  3. 2019DeblurGAN-v2: Deblurring (Orders-of-Magnitude) Faster and Bettercited by 361
  4. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
  5. 2021NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Imagescited by 336
  6. 2018Scale-recurrent Network for Deep Image Deblurringcited by 332
  7. 2022NeuMan: Neural Human Radiance Field from a Single Videocited by 244
  8. 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
  9. 2022VRT: A Video Restoration Transformercited by 219
  10. 2020Real-Time Intermediate Flow Estimation for Video Frame Interpolationcited by 211
  11. 2021Neural Articulated Radiance Fieldcited by 196
  12. 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
  13. 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 190
  14. 2021Deblur-NeRF: Neural Radiance Fields from Blurry Imagescited by 179
  15. 2022TAVA: Template-free Animatable Volumetric Actorscited by 172
  16. 2022Recurrent Video Restoration Transformer with Guided Deformable Attentioncited by 168
  17. 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
  18. 2021H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motioncited by 157
  19. 2023HUGS: Human Gaussian Splatscited by 154
  20. 2022ARAH: Animatable Volume Rendering of Articulated Human SDFscited by 139
  21. 2022InstantAvatar: Learning Avatars from Monocular Video in 60 Secondscited by 138
  22. 2023Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decompositioncited by 134
  23. 2023GART: Gaussian Articulated Template Modelscited by 121
  24. 2023Drivable 3D Gaussian Avatarscited by 120
  25. 2024MVSplat360: Feed-Forward 360 Scene Synthesis from Sparse Viewscited by 111
  26. 2019Spatio-Temporal Filter Adaptive Network for Video Deblurringcited by 106
  27. 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priorscited by 106
  28. 2023Human Gaussian Splatting: Real-time Rendering of Animatable Avatarscited by 105
  29. 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videoscited by 105
  30. 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
  31. 2024Dynamic Gaussian Marbles for Novel View Synthesis of Casual Monocular Videoscited by 96
  32. 2024MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Modelcited by 87
  33. 2020Cascaded Deep Video Deblurring Using Temporal Sharpness Priorcited by 85
  34. 2023MonoHuman: Animatable Human Neural Field from Monocular Videocited by 85
  35. 2022BAD-NeRF: Bundle Adjusted Deblur Neural Radiance Fieldscited by 80
  36. 2022DP-NeRF: Deblurred Neural Radiance Field with Physical Scene Priorscited by 70
  37. 2023Learning Neural Volumetric Representations of Dynamic Humans in Minutescited by 70
  38. 2022A Simple Baseline for Video Restoration with Grouped Spatial-temporal Shiftcited by 68

50 most cited of 80 All 80 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 3; 2026: 2.

6 papers.