CaricatureGS: Exaggerating 3D Gaussian Splatting Faces With Gaussian Curvature
Not on the map. Why?
Abstract (arXiv)
A photorealistic and controllable 3D caricaturization framework for faces is introduced. We start with an intrinsic Gaussian curvature-based surface exaggeration technique, which, when coupled with texture, tends to produce over-smoothed renders. To address this, we resort to 3D Gaussian Splatting (3DGS), which has recently been shown to produce realistic free-viewpoint avatars. Given a multiview sequence, we extract a FLAME mesh, solve a curvature-weighted Poisson equation, and obtain its exaggerated form. However, directly deforming the Gaussians yields poor results, necessitating the synthesis of pseudo-ground-truth caricature images by warping each frame to its exaggerated 2D representation using local affine transformations. We then devise a training scheme that alternates real and synthesized supervision, enabling a single Gaussian collection to represent both natural and exaggerated avatars. This scheme improves fidelity, supports local edits, and allows continuous control over the intensity of the caricature. In order to achieve real-time deformations, an efficient interpolation between the original and exaggerated surfaces is introduced. We further analyze and show that it has a bounded deviation from closed-form solutions. In both quantitative and qualitative evaluations, our results outperform prior work, delivering photorealistic, geometry-controlled caricature avatars.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 49 references that are in the map. First posted on arXiv 6 Jan 2026.
Builds on
31 of 49 references.
References · 31
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 482
- 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 465
- 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 331
- 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 230
- 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 190
19 more
- 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 166
- 2021StyleGAN-NADA: CLIP-Guided Domain Adaptation of Image Generatorscited by 164
- 2022Instant Volumetric Head Avatarscited by 157
- 2022Reconstructing Personalized Semantic Facial NeRF Models From Monocular Videocited by 128
- 2020Learning Compositional Radiance Fields of Dynamic Human Headscited by 78
- 2022AvatarMAV: Fast 3D Head Avatar Reconstruction Using Motion-Aware Neural Voxelscited by 73
- 2022ImFace: A Nonlinear 3D Morphable Face Model with Implicit Neural Representationscited by 64
- 2023HeadGaS: Real-Time Animatable Head Avatars via 3D Gaussian Splattingcited by 60
- 2024MeGA: Hybrid Mesh-Gaussian Head Avatar for High-Fidelity Rendering and Head Editingcited by 37
- 2017DeepSketch2Face: A Deep Learning Based Sketching System for 3D Face and Caricature Modelingcited by 16
- 2024Rig3DGS: Creating Controllable Portraits from Casual Monocular Videoscited by 16
- 2024SurFhead: Affine Rig Blending for Geometrically Accurate 2D Gaussian Surfel Head Avatarscited by 15
- 2024Deformable One-shot Face Stylization via DINO Semantic Guidancecited by 14
- 2018Alive Caricature from 2D to 3Dcited by 13
- 2018CaricatureShop: Personalized and Photorealistic Caricature Sketchingcited by 12
- 2022Deep Deformable 3D Caricatures with Learned Shape Controlcited by 10
- 2023ImFace++: A Sophisticated Nonlinear 3D Morphable Face Model with Implicit Neural Representationscited by 10
- 2024Generating Editable Head Avatars with 3D Gaussian GANscited by 5
- 2024LeGO: Leveraging a Surface Deformation Network for Animatable Stylized Face Generation with One Examplecited by 4
Built on by
Not cited yet.