mlsanityData to 14 Oct 2026

Scanline-Aware Animatable Gaussian Avatars from Rolling-Shutter Videos

arXiv 2608.17314 ↗First posted 18 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Animatable human avatars are routinely reconstructed from multi-view video under a silent assumption: that every pixel of a frame observes the same instant of the body's motion. Rolling-shutter (RS) sensors expose image rows sequentially, so within one frame the head and the feet of a moving person are separated by tens of milliseconds of articulated motion, and every scanline sees a different pose. Feeding such video to a state-of-the-art avatar bakes the distortion into the canonical representation, where it survives as shear and wobble under novel views and novel poses. Worse, every camera in a rig follows its own readout schedule, so the multi-view consistency that drives the reconstruction is violated even when the geometry is correct. We present RS-Avatar, which reconstructs a sharp, undistorted, animatable 3D Gaussian avatar directly from RS video. The formulation is minimal: a motion-aware avatar already renders the body at several sub-frame instants, and where a blur model averages those renderings, a rolling-shutter model composites them scanline by scanline. Changing that operator is the only modification required. On RS-ZJU, a benchmark we build from ZJU-MoCap, this improves novel-view synthesis over training as if the frames were instantaneous, on every subject. A motion-aware blur model built on the same sub-frame machinery does not transfer, and in fact falls below the shutter-oblivious baseline: the machinery is reusable, the operator is not.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 41 of its 56 references that are in the map. First posted on arXiv 18 Aug 2026.

Builds on

41 of 56 references.

References · 41

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  3. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
  4. 2020Zero-Reference Deep Curve Estimation for Low-Light Image Enhancementcited by 542
  5. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  6. 2019EnlightenGAN: Deep Light Enhancement without Paired Supervisioncited by 466
  7. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
  8. 2021NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Imagescited by 336
  9. 2020Real-Time Intermediate Flow Estimation for Video Frame Interpolationcited by 213
  10. 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
  11. 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 191
  12. 2021Deblur-NeRF: Neural Radiance Fields from Blurry Imagescited by 179
29 more
  1. 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
  2. 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 161
  3. 2022InstantAvatar: Learning Avatars from Monocular Video in 60 Secondscited by 138
  4. 2024MVSplat360: Feed-Forward 360 Scene Synthesis from Sparse Viewscited by 116
  5. 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priorscited by 106
  6. 2024MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Modelcited by 89
  7. 2022BAD-NeRF: Bundle Adjusted Deblur Neural Radiance Fieldscited by 80
  8. 2024CV-VAE: A Compatible Video VAE for Latent Generative Video Modelscited by 70
  9. 2024BAD-Gaussians: Bundle Adjusted Deblur Gaussian Splattingcited by 61
  10. 2024StereoCrafter: Diffusion-based Generation of Long and High-fidelity Stereoscopic 3D from Monocular Videoscited by 37
  11. 2019Rolling-Shutter-Aware Differential SfM and Image Rectificationcited by 32
  12. 2021Towards Rolling Shutter Correction and Deblurring in Dynamic Scenescited by 32
  13. 2024Gaussian Splatting on the Move: Blur and Rolling Shutter Compensation for Natural Camera Motioncited by 29
  14. 2019Efficient Derivative Computation for Cumulative B-Splines on Lie Groupscited by 28
  15. 2021SUNet: Symmetric Undistortion Network for Rolling Shutter Correctioncited by 20
  16. 2022Bringing Rolling Shutter Images Alive with Dual Reversed Distortioncited by 15
  17. 2022Context-Aware Video Reconstruction for Rolling Shutter Camerascited by 15
  18. 2023USB-NeRF: Unrolling Shutter Bundle Adjusted Neural Radiance Fieldscited by 11
  19. 2024ToMiE: Towards Explicit Exoskeleton for the Reconstruction of Complicated 3D Human Avatarscited by 10
  20. 2025AniCrafter: Customizing Realistic Human-Centric Animation via Avatar-Background Conditioning in Video Diffusion Modelscited by 10
  21. 2023Towards Nonlinear-Motion-Aware and Occlusion-Robust Rolling Shutter Correctioncited by 8
  22. 2024RS-NeRF: Neural Radiance Fields from Rolling Shutter Imagescited by 8
  23. 2023Visibility Constrained Wide-band Illumination Spectrum Design for Seeing-in-the-Darkcited by 7
  24. 2023Self-supervised Learning to Bring Dual Reversed Rolling Shutter Images Alivecited by 7
  25. 2024Motion-Aware Animatable Gaussian Avatars Deblurringcited by 6
  26. 2024URS-NeRF: Unordered Rolling Shutter Bundle Adjustment for Neural Radiance Fieldscited by 4
  27. 2024Rolling Shutter Correction with Intermediate Distortion Flow Estimationcited by 3
  28. 2024Physics-Based Adversarial Attack on Near-Infrared Human Detector for Nighttime Surveillance Camera Systemscited by 3
  29. 2026Toward Robust and 3D-Aware RGB-NIR Imaging in the Darkcited by 2

Built on by

Not cited yet.