mlsanityData to 14 Oct 2026

AHOY! Animatable Humans under Occlusion from YouTube Videos with Gaussian Splatting and Video Diffusion Priors

arXiv 2603.17975 ↗First posted 18 Mar 2026cs.CVcited by 2

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

We present AHOY, a method for reconstructing complete, animatable 3D Gaussian avatars from in-the-wild monocular video despite heavy occlusion. Existing methods assume unoccluded input-a fully visible subject, often in a canonical pose-excluding the vast majority of real-world footage where people are routinely occluded by furniture, objects, or other people. Reconstructing from such footage poses fundamental challenges: large body regions may never be observed, and multi-view supervision per pose is unavailable. We address these challenges with four contributions: (i) a hallucination-as-supervision pipeline that uses identity-finetuned diffusion models to generate dense supervision for previously unobserved body regions; (ii) a two-stage canonical-to-pose-dependent architecture that bootstraps from sparse observations to full pose-dependent Gaussian maps; (iii) a map-pose/LBS-pose decoupling that absorbs multi-view inconsistencies from the generated data; (iv) a head/body split supervision strategy that preserves facial identity. We evaluate on YouTube videos and on multi-view capture data with significant occlusion and demonstrate state-of-the-art reconstruction quality. We also demonstrate that the resulting avatars are robust enough to be animated with novel poses and composited into 3DGS scenes captured using cell-phone video. Our project page is available at https://miraymen.github.io/ahoy/

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 140 of its 155 references that are in the map. First posted on arXiv 18 Mar 2026.

Builds on

140 of 155 references.

Closest ancestors · 11

Same direction, newest first

  1. 2025MoGA: 3D Generative Avatar Prior for Monocular Gaussian Avatar Reconstruction31 Jul
  2. 2025Dream, Lift, Animate: From Single Images to Animatable Gaussian Avatars21 Jul
  3. 2025ViDAR: Video Diffusion-Aware 4D Reconstruction From Monocular Inputs23 Jun
  4. 2025MEAT: Multiview Diffusion Model for Human Generation on Megapixels with Mesh Attention11 Mar
  5. 2025Taming Video Diffusion Prior with Scene-Grounding Guidance for 3D Gaussian Splatting from Sparse Inputs7 Mar
  6. 2025GAS: Generative Avatar Synthesis from a Single Image10 Feb
  7. 2024CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Models16 Dec
  8. 2024MagicMan: Generative Novel View Synthesis of Humans with 3D-Aware Diffusion and Iterative Refinement26 Aug
  9. 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humans16 Aug
  10. 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Models3 Apr
  11. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 129

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  5. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  6. 2022Scalable Diffusion Models with Transformerscited by 6,054
  7. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  8. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  9. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  10. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
  11. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  12. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
38 more
  1. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
  2. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  3. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  4. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  5. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  6. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
  7. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  8. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
  9. 2025SAM 3: Segment Anything with Conceptscited by 906
  10. 2017End-to-end Recovery of Human Shape and Posecited by 885
  11. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  12. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
  13. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  14. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
  15. 2020First Order Motion Model for Image Animationcited by 704
  16. 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 695
  17. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
  18. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
  19. 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 671
  20. 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 616
  21. 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 600
  22. 2018DensePose: Dense Human Pose Estimation In The Wildcited by 575
  23. 2021Neural Fields in Visual Computing and Beyondcited by 540
  24. 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
  25. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  26. 2025VACE: All-in-One Video Creation and Editingcited by 479
  27. 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 388
  28. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
  29. 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
  30. 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 344
  31. 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
  32. 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 272
  33. 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
  34. 2020ARCH: Animatable Reconstruction of Clothed Humanscited by 257
  35. 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 249
  36. 2022NeuMan: Neural Human Radiance Field from a Single Videocited by 244
  37. 2018Video Based Reconstruction of 3D People Modelscited by 238
  38. 2020PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstructioncited by 231

50 most cited of 129 All 129 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024GAF: Gaussian Avatar Reconstruction from Monocular Videos via Multi-view Diffusion
  2. 2025SVAD: From Single Image to 3D Avatar via Synthetic Data Generation with Video Diffusion and Data Augmentation
  3. 2024SOAR: Self-Occluded Avatar Recovery from a Single Video In the Wild
  4. 20243D2-Actor: Learning Pose-Conditioned 3D-Aware Denoiser for Realistic Gaussian Avatar Modeling
  5. 2026GenLCA: 3D Diffusion for Full-Body Avatars from In-the-Wild Videos
  6. 2025Controlling Avatar Diffusion with Learnable Gaussian Embedding
  7. 2025Towards Efficient 3D Gaussian Human Avatar Compression: A Prior-Guided Framework
  8. 2026LiftAvatar: Kinematic-Space Completion for Expression-Controlled 3D Gaussian Avatar Animation