LayerGS: Decomposition and Inpainting of Layered 3D Human Avatars via 2D Gaussian Splatting
Not on the map. Why?
Abstract (arXiv)
We propose a novel framework for decomposing arbitrarily posed humans into animatable multi-layered 3D human avatars, separating the body and garments. Conventional single-layer reconstruction methods lock clothing to one identity, while prior multi-layer approaches struggle with occluded regions. We overcome both limitations by encoding each layer as a set of 2D Gaussians for accurate geometry and photorealistic rendering, and inpainting hidden regions with a pretrained 2D diffusion model via score-distillation sampling (SDS). Our three-stage training strategy first reconstructs the coarse canonical garment via single-layer reconstruction, followed by multi-layer training to jointly recover the inner-layer body and outer-layer garment details. Experiments on two 3D human benchmark datasets (4D-Dress, Thuman2.0) show that our approach achieves better rendering quality and layer decomposition and recomposition than the previous state-of-the-art, enabling realistic virtual try-on under novel viewpoints and poses, and advancing practical creation of high-fidelity 3D human assets for immersive applications. Our code is available at https://github.com/RockyXu66/LayerGS
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 32 of its 38 references that are in the map. First posted on arXiv 9 Jan 2026.
Builds on
32 of 38 references.
References · 32
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,162
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 460
- 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
20 more
- 2021Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensorscited by 246
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
- 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 191
- 2021SMPLicit: Topology-aware Generative Model for Clothed Peoplecited by 155
- 2020Combining Implicit Function Learning and Parametric Models for 3D Human Reconstructioncited by 133
- 2023GP-VTON: Towards General Purpose Virtual Try-on via Collaborative Local-Flow Global-Parsing Learningcited by 120
- 2021The Power of Points for Modeling Humans in Clothingcited by 90
- 2023SIFU: Side-view Conditioned Implicit Function for Real-world Usable Clothed Human Reconstructioncited by 77
- 2023X-Avatar: Expressive Human Avatarscited by 66
- 20244D-DRESS: A 4D Dataset of Real-world Human Clothing with Semantic Annotationscited by 54
- 2024HumanSplat: Generalizable Single-Image Human Gaussian Splatting with Structure Priorscited by 54
- 2024M&M VTO: Multi-Garment Virtual Try-On and Editingcited by 29
- 2024LayGA: Layered Gaussian Avatars for Animatable Clothing Transfercited by 22
- 2024GALA: Generating Animatable Layered Assets from a Single Scancited by 21
- 2023CaPhy: Capturing Physical Properties for Animatable Human Avatarscited by 20
- 2025VTON 360: High-Fidelity Virtual Try-On from Any Viewing Directioncited by 10
- 2022LoRD: Local 4D Implicit Representation for High-Fidelity Dynamic Human Modelingcited by 8
- 2025Disentangled Clothed Avatar Generation with Layered Representationcited by 7
- 2025DeClotH: Decomposable 3D Cloth and Human Body Reconstruction from a Single Imagecited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Layering Virtual Try-Oncited by 0
- 2026Layering Virtual Try-On24 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2023AvatarFusion: Zero-shot Generation of Clothing-Decoupled 3D Avatars Using 2D Diffusion
- 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Models
- 2024GarmentDreamer: 3DGS Guided Garment Synthesis with Diverse Geometry and Texture Details
- 2025SVAD: From Single Image to 3D Avatar via Synthetic Data Generation with Video Diffusion and Data Augmentation
- 2025HGC-Avatar: Hierarchical Gaussian Compression for Streamable Dynamic 3D Avatars
- 2026DiGS-Avatar: Single-Image Animatable 3D Human Reconstruction via UV-Space Diffusion
- 2025Towards Efficient 3D Gaussian Human Avatar Compression: A Prior-Guided Framework
- 2024GarVerseLOD: High-Fidelity 3D Garment Reconstruction from a Single In-the-Wild Image using a Dataset with Levels of Details