mlsanityData to 7 Oct 2026

GoMAvatar: Efficient Animatable Human Modeling from Monocular Video Using Gaussians-on-Mesh

arXiv 2404.07991 ↗First posted 11 Apr 2024cs.CVcited by 51

Not on the map. Why?

Abstract (arXiv)

We introduce GoMAvatar, a novel approach for real-time, memory-efficient, high-quality animatable human modeling. GoMAvatar takes as input a single monocular video to create a digital avatar capable of re-articulation in new poses and real-time rendering from novel viewpoints, while seamlessly integrating with rasterization-based graphics pipelines. Central to our method is the Gaussians-on-Mesh representation, a hybrid 3D model combining rendering quality and speed of Gaussian splatting with geometry modeling and compatibility of deformable meshes. We assess GoMAvatar on ZJU-MoCap data and various YouTube videos. GoMAvatar matches or surpasses current monocular human modeling algorithms in rendering quality and significantly outperforms them in computational efficiency (43 FPS) while being memory-efficient (3.63 MB per subject).

Key facts. Cited by 51 papers in the map (data through 7 Oct 2026). Builds on 70 of its 87 references that are in the map. First posted on arXiv 11 Apr 2024.

Builds on

70 of 87 references.

References · 70

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  3. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  4. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  5. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  6. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  7. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  8. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  9. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  10. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  11. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
  12. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
38 more
  1. 2022Human Motion Diffusion Modelcited by 1,062
  2. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  3. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
  4. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
  5. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  6. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
  7. 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 667
  8. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
  9. 2019MediaPipe: A Framework for Building Perception Pipelinescited by 572
  10. 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 569
  11. 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
  12. 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 510
  13. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  14. 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 465
  15. 2019Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoningcited by 420
  16. 2018DeepVoxels: Learning Persistent 3D Feature Embeddingscited by 401
  17. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
  18. 2021PARE: Part Attention Regressor for 3D Human Body Estimationcited by 334
  19. 2022MobileNeRF: Exploiting the Polygon Rasterization Pipeline for Efficient Neural Field Rendering on Mobile Architecturescited by 308
  20. 2022NeuMan: Neural Human Radiance Field from a Single Videocited by 244
  21. 2018Video Based Reconstruction of 3D People Modelscited by 237
  22. 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
  23. 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
  24. 2023BakedSDF: Meshing Neural SDFs for Real-Time View Synthesiscited by 220
  25. 2021NeX: Real-time View Synthesis with Neural Basis Expansioncited by 215
  26. 20203D Photography using Context-aware Layered Depth Inpaintingcited by 206
  27. 2022PointAvatar: Deformable Point-based Head Avatars from Videoscited by 183
  28. 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
  29. 2016Panoptic Studio: A Massively Multiview System for Social Interaction Capturecited by 173
  30. 2022TAVA: Template-free Animatable Volumetric Actorscited by 172
  31. 2022Shape, Light, and Material Decomposition from Images using Monte Carlo Rendering and Denoisingcited by 163
  32. 2021Neural Human Performer: Learning Generalizable Radiance Fields for Human Performance Renderingcited by 158
  33. 2021H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motioncited by 157
  34. 2022SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Videocited by 144
  35. 2022ARAH: Animatable Volume Rendering of Articulated Human SDFscited by 139
  36. 2022InstantAvatar: Learning Avatars from Monocular Video in 60 Secondscited by 138
  37. 2022Structured Local Radiance Fields for Human Avatar Modelingcited by 116
  38. 2021Animatable Neural Radiance Fields from Monocular RGB Videoscited by 109

50 most cited of 70 All 70 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 13; 2025: 27; 2026: 11.

51 papers.

Sort:

By area:

  1. 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 177
  2. 2024HumanSplat: Generalizable Single-Image Human Gaussian Splatting with Structure Priorscited by 54
  3. 2025Vid2Avatar-Pro: Authentic Avatar from Videos in the Wild via Universal Priorcited by 31
  4. 2025DRAWER: Digital Reconstruction and Articulation With Environment Realismcited by 29
  5. 2024AutoVFX: Physically Realistic Video Editing from Natural Language Instructionscited by 27
  6. 2025Pippo: High-Resolution Multi-View Humans from a Single Imagecited by 20
  7. 2024D-MiSo: Editing Dynamic 3D Scenes using Multi-Gaussians Soupcited by 18
  8. 2024GaussianDreamerPro: Text to Manipulable 3D Gaussians with Highly Enhanced Qualitycited by 17
  9. 2024Advancing Extended Reality with 3D Gaussian Splatting: Innovations and Prospectscited by 17
  10. 2024Surfel-based Gaussian Inverse Rendering for Fast and Relightable Dynamic Human Reconstruction from Monocular Videocited by 12
  11. 2025Real-time High-fidelity Gaussian Human Avatars with Position-based Interpolation of Spatially Distributed MLPscited by 12
  12. 2025LIFe-GoM: Generalizable Human Rendering with Learned Iterative Feedback Over Multi-Resolution Gaussians-on-Meshcited by 11
38 more
  1. 2025TaoAvatar: Real-Time Lifelike Full-Body Talking Avatars for Augmented Reality via 3D Gaussian Splattingcited by 11
  2. 2024SweepEvGS: Event-Based 3D Gaussian Splatting for Macro and Micro Radiance Field Rendering from a Single Sweepcited by 10
  3. 2025HumanRAM: Feed-forward Human Reconstruction and Animation Model using Transformerscited by 9
  4. 2024PICA: Physics-Integrated Clothed Avatarcited by 8
  5. 2025STG-Avatar: Animatable Human Avatars via Spacetime Gaussiancited by 8
  6. 2025RMAvatar: Photorealistic Human Avatar Reconstruction from Monocular Video Based on Rectified Mesh-embedded Gaussianscited by 7
  7. 2024Interactive Rendering of Relightable and Animatable Gaussian Avatarscited by 6
  8. 20243D-Consistent Human Avatars with Sparse Inputs via Gaussian Splatting and Contrastive Learningcited by 6
  9. 2025FastAvatar: Towards Unified and Fast 3D Avatar Reconstruction with Large Gaussian Reconstruction Transformerscited by 6
  10. 2024DAGSM: Disentangled Avatar Generation with GS-enhanced Meshcited by 5
  11. 2025GASPACHO: Gaussian Splatting for Controllable Humans and Objectscited by 5
  12. 2024EVA-Gaussian: 3D Gaussian-based Real-time Human Novel View Synthesis under Diverse Multi-view Camera Settingscited by 4
  13. 2025Advances in Radiance Field for Dynamic Scene: From Neural Field to Gaussian Fieldcited by 4
  14. 2025Reconstructing Close Human Interaction with Appearance and Proxemics Reasoningcited by 4
  15. 2025MV-Performer: Taming Video Diffusion Model for Faithful and Synchronized Multi-view Performer Synthesiscited by 4
  16. 2025Parametric Gaussian Human Model: Generalizable Prior for Efficient and Realistic Human Avatar Modelingcited by 3
  17. 2025Deblur-Avatar: Animatable Avatars from Motion-Blurred Monocular Videoscited by 2
  18. 20254D-MoDe: Towards Editable and Scalable Volumetric Streaming via Motion-Decoupled 4D Gaussian Compressioncited by 2
  19. 2026High-Fidelity Mobile Avatars with Pruned Local Blendshapescited by 2
  20. 2025HandSCS: Structural Coordinate Space for Animatable Hand Gaussian Splattingcited by 1
  21. 2025Hybrid Mesh-Gaussian Representation for Efficient Indoor Scene Reconstructioncited by 1
  22. 2026ICo3D: An Interactive Conversational 3D Virtual Humancited by 1
  23. 2025STGA: Selective-Training Gaussian Head Avatarscited by 0
  24. 2025HumMorph: Generalized Dynamic Human Neural Fields from Few Viewscited by 0
  25. 2025DevilSight: Augmenting Monocular Human Avatar Reconstruction through a Virtual Perspectivecited by 0
  26. 2025GaussianGAN: Real-Time Photorealistic controllable Human Avatarscited by 0
  27. 2025FMGS-Avatar: Mesh-Guided 2D Gaussian Splatting with Foundation Model Priors for 3D Monocular Avatar Reconstructioncited by 0
  28. 2025HumanCrafter: Synergizing Generalizable Human Reconstruction and Semantic 3D Segmentationcited by 0
  29. 2025Dynamic Avatar-Scene Rendering from Human-centric Contextcited by 0
  30. 2025NoPo-Avatar: Generalizable and Animatable Avatars from Sparse Inputs without Human Posescited by 0
  31. 2026PoseGaussian: Pose-Driven Novel View Synthesis for Robust 3D Human Reconstructioncited by 0
  32. 2026HOIGS: Human-Object Interaction Gaussian Splattingcited by 0
  33. 2026MASS: Mesh-inellipse Aligned Deformable Surfel Splatting for Hand Reconstruction and Rendering from Egocentric Monocular Videocited by 0
  34. 2026Generalizable Human Gaussian Splatting via Multi-view Semantic Consistencycited by 0
  35. 2026HumanSplatHMR: Closing the Loop Between Human Mesh Recovery and Gaussian Splatting Avatarcited by 0
  36. 2026PiG-Avatar: Hierarchical Neural-Field-Guided Gaussian Avatarscited by 0
  37. 2026PIAvatar: Physically Interactive Avatars via Deformation Gradient Decouplingcited by 0
  38. 2026JacobianAvatar: Temporally Consistent Semi-rigid Avatar Reconstruction from a Monocular Videocited by 0

50 most cited of 51 All 51 (JSON)