# Landmark Detection and 3D Face Reconstruction for Caricature using a Nonlinear Parametric Model

arXiv: https://arxiv.org/abs/2004.09190 · HTML: https://mlsanity.com/paper/2004.09190/

## Key facts

- Cited by 13 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 20 Apr 2020.

## Built on by (most cited first, 13 of 13)

- [RaBit: Parametric Modeling of 3D Biped Cartoon Characters with a Topological-consistent Dataset](https://mlsanity.com/paper/2303.12564/) (2023)
- [3DCaricShop: A Dataset and A Baseline Method for Single-view 3D Caricature Face Reconstruction](https://mlsanity.com/paper/2103.08204/) (2021)
- [Deep Deformable 3D Caricatures with Learned Shape Control](https://mlsanity.com/paper/2207.14593/) (2022)
- [AgileAvatar: Stylized 3D Avatar Creation via Cascaded Domain Bridging](https://mlsanity.com/paper/2211.07818/) (2022)
- [Generalizable Face Landmarking Guided by Conditional Face Warping](https://mlsanity.com/paper/2404.12322/) (2024)
- [SketchMetaFace: A Learning-based Sketching Interface for High-fidelity 3D Character Face Modeling](https://mlsanity.com/paper/2307.00804/) (2023)
- [Multi-Domain Multi-Definition Landmark Localization for Small Datasets](https://mlsanity.com/paper/2203.10358/) (2022)
- [Tag-based annotation creates better avatars](https://mlsanity.com/paper/2302.07354/) (2023)
- [Intelligent Generation of Graphical Game Assets: A Conceptual Framework and Systematic Review of the State of the Art](https://mlsanity.com/paper/2311.10129/) (2023)
- [Towards Multi-domain Face Landmark Detection with Synthetic Data from Diffusion model](https://mlsanity.com/paper/2401.13191/) (2024)
- [OccFace: Unified Occlusion-Aware Facial Landmark Detection with Per-Point Visibility](https://mlsanity.com/paper/2602.10728/) (2026)
- [Deep-MDS Framework for Recovering the 3D Shape of 2D Landmarks from a Single Image](https://mlsanity.com/paper/2210.15200/) (2022)
- [Generating Animatable 3D Cartoon Faces from Single Portraits](https://mlsanity.com/paper/2307.01468/) (2023)

## Abstract (arXiv)

Caricature is an artistic abstraction of the human face by distorting or exaggerating certain facial features, while still retains a likeness with the given face. Due to the large diversity of geometric and texture variations, automatic landmark detection and 3D face reconstruction for caricature is a challenging problem and has rarely been studied before. In this paper, we propose the first automatic method for this task by a novel 3D approach. To this end, we first build a dataset with various styles of 2D caricatures and their corresponding 3D shapes, and then build a parametric model on vertex based deformation space for 3D caricature face. Based on the constructed dataset and the nonlinear parametric model, we propose a neural network based method to regress the 3D face shape and orientation from the input 2D caricature image. Ablation studies and comparison with state-of-the-art methods demonstrate the effectiveness of our algorithm design. Extensive experimental results demonstrate that our method works well for various caricatures. Our constructed dataset, source code and trained model are available at https://github.com/Juyong/CaricatureFace.