mlsanityData to 7 Oct 2026

3D-Consistent Human Avatars with Sparse Inputs via Gaussian Splatting and Contrastive Learning

arXiv 2408.09663 ↗First posted 19 Aug 2024cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

Existing approaches for human avatar generation--both NeRF-based and 3D Gaussian Splatting (3DGS) based--struggle with maintaining 3D consistency and exhibit degraded detail reconstruction, particularly when training with sparse inputs. To address this challenge, we propose CHASE, a novel framework that achieves dense-input-level performance using only sparse inputs through two key innovations: cross-pose intrinsic 3D consistency supervision and 3D geometry contrastive learning. Building upon prior skeleton-driven approaches that combine rigid deformation with non-rigid cloth dynamics, we first establish baseline avatars with fundamental 3D consistency. To enhance 3D consistency under sparse inputs, we introduce a Dynamic Avatar Adjustment (DAA) module, which refines deformed Gaussians by leveraging similar poses from the training set. By minimizing the rendering discrepancy between adjusted Gaussians and reference poses, DAA provides additional supervision for avatar reconstruction. We further maintain global 3D consistency through a novel geometry-aware contrastive learning strategy. While designed for sparse inputs, CHASE surpasses state-of-the-art methods across both full and sparse settings on ZJU-MoCap and H36M datasets, demonstrating that our enhanced 3D consistency leads to superior rendering quality.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 33 of its 52 references that are in the map. First posted on arXiv 19 Aug 2024.

Builds on

33 of 52 references.

References · 33

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  3. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  4. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
  5. 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 699
  6. 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
  7. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
  8. 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 611
  9. 2020PointContrast: Unsupervised Pre-training for 3D Point Cloud Understandingcited by 502
  10. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  11. 2021PointCLIP: Point Cloud Understanding by CLIPcited by 461
  12. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
21 more
  1. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 331
  2. 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 330
  3. 2019Differentiable Surface Splatting for Point-based Geometry Processingcited by 238
  4. 2021Neural Articulated Radiance Fieldcited by 196
  5. 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
  6. 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 190
  7. 2021Shape As Points: A Differentiable Poisson Solvercited by 186
  8. 2024SplattingAvatar: Realistic Real-Time Human Avatars with Mesh-Embedded Gaussian Splattingcited by 171
  9. 2023Contrast with Reconstruct: Contrastive 3D Representation Learning Guided by Generative Pretrainingcited by 162
  10. 2022ARAH: Animatable Volume Rendering of Articulated Human SDFscited by 139
  11. 2021LEAP: Learning Articulated Occupancy of Peoplecited by 107
  12. 2019Neural Cages for Detail-Preserving 3D Deformationscited by 105
  13. 2023Human Gaussian Splatting: Real-time Rendering of Animatable Avatarscited by 105
  14. 2023MonoHuman: Animatable Human Neural Field from Monocular Videocited by 85
  15. 2024View-Consistent 3D Editing with Gaussian Splattingcited by 67
  16. 2024GoMAvatar: Efficient Animatable Human Modeling from Monocular Video Using Gaussians-on-Meshcited by 51
  17. 2023PoseVocab: Learning Joint-structured Pose Embeddings for Human Avatar Modelingcited by 50
  18. 2021Geometry-Guided Progressive NeRF for Generalizable and Efficient Neural Human Renderingcited by 46
  19. 2024Generalizable Human Gaussians for Sparse View Synthesiscited by 40
  20. 2017Sparse Data Driven Mesh Deformationcited by 21
  21. 2024Gaussian Control with Hierarchical Semantic Graphs in 3D Human Recoverycited by 3

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 5.

6 papers.