Self-Learning Expression Deformations for Data-Efficient Gaussian Avatars
Not on the map. Why?
Abstract (arXiv)
Modeling dynamic facial expressions using 3D Gaussian representations remains challenging due to their unstructured nature. Conventional Gaussian avatar pipelines require extensive multiview and sequential expression data, limiting scalability and accessibility. In this work, we introduce Self-Adaptive Gaussian Expression (SAGE), a framework for self-learning expression-induced Gaussian deformations that enables high-fidelity, animatable avatars from minimal input data. Our method jointly optimizes 2D Gaussian surfels and a Signed Distance Field (SDF) to enforce compact, surface-aligned Gaussian distributions, while a self-supervised expression learning phase replaces long training sequences with geometric and appearance consistency constraints. This design allows flexible deployment across multiple reconstruction regimes: in the multiview setting, only a single frame (timestep) is required instead of thousands; in the monocular setting, only head rotations are needed without expression sequences; and in the one-shot setting, no pretraining or priors are necessary. Experiments demonstrate that our approach achieves reconstruction and animation quality comparable to state-of-the-art methods, while reducing data requirements by several orders of magnitude. Our results highlight the potential of self-supervised Gaussian deformation learning as a step toward accessible, data-efficient avatar creation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 70 of its 85 references that are in the map. First posted on arXiv 4 Jun 2026.
Builds on
70 of 85 references.
References · 70
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
- 2020First Order Motion Model for Image Animationcited by 698
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
- 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 661
- 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 611
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
38 more
- 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 475
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 467
- 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 465
- 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 311
- 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
- 2018Generating 3D faces using Convolutional Mesh Autoencoderscited by 267
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 256
- 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 230
- 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
- 2021Neural Head Avatars from Monocular RGB Videoscited by 212
- 2021PIRenderer: Controllable Portrait Image Generation via Semantic Neural Renderingcited by 202
- 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 190
- 2018X2Face: A network for controlling face generation by using images, audio, and pose codescited by 189
- 2022PointAvatar: Deformable Point-based Head Avatars from Videoscited by 183
- 2023GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesiscited by 170
- 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
- 2017MoFA: Model-based Deep Convolutional Face Autoencoder for Unsupervised Monocular Reconstructioncited by 163
- 2023NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidancecited by 137
- 2022Reconstructing Personalized Semantic Facial NeRF Models From Monocular Videocited by 128
- 2021Pixel Codec Avatarscited by 125
- 2023Drivable 3D Gaussian Avatarscited by 120
- 2020i3DMM: Deep Implicit 3D Morphable Model of Human Headscited by 109
- 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 107
- 2022FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Datasetcited by 98
- 2021MoFaNeRF: Morphable Facial Neural Radiance Fieldcited by 94
- 2023MonoGaussianAvatar: Monocular Gaussian Point-based Head Avatarcited by 89
- 20243DGSR: Implicit Surface Reconstruction with 3D Gaussian Splattingcited by 78
- 2024GPAvatar: Generalizable and Precise Head Avatar from Image(s)cited by 74
- 2022AvatarMAV: Fast 3D Head Avatar Reconstruction Using Motion-Aware Neural Voxelscited by 73
- 2022Learning Neural Parametric Head Modelscited by 73
- 2022ImFace: A Nonlinear 3D Morphable Face Model with Implicit Neural Representationscited by 64
- 2023Gaussian Shell Maps for Efficient 3D Human Generationcited by 61
- 2023HeadGaS: Real-Time Animatable Head Avatars via 3D Gaussian Splattingcited by 60
- 20243D Gaussian Blendshapes for Head Avatar Animationcited by 58
- 2023Portrait4D: Learning One-Shot 4D Head Avatar Synthesis using Synthetic Datacited by 55
- 2024GGHead: Fast and Generalizable 3D Gaussian Headscited by 51
- 2023RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatarscited by 45
- 2024HeadGAP: Few-Shot 3D Head Avatar via Generalizable Gaussian Priorscited by 44
50 most cited of 70 All 70 (JSON)
Built on by
Not cited yet.