# Simultaneous Facial Landmark Detection, Pose and Deformation Estimation under Facial Occlusion

arXiv: https://arxiv.org/abs/1709.08130 · HTML: https://mlsanity.com/paper/1709.08130/

## Key facts

- Cited by 12 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 23 Sep 2017.

## Built on by (most cited first, 12 of 12)

- [FaceXFormer: A Unified Transformer for Facial Analysis](https://mlsanity.com/paper/2403.12960/) (2024)
- [Multi-task head pose estimation in-the-wild](https://mlsanity.com/paper/2202.02299/) (2022)
- [ASMNet: a Lightweight Deep Neural Network for Face Alignment and Pose Estimation](https://mlsanity.com/paper/2103.00119/) (2021)
- [ACR Loss: Adaptive Coordinate-based Regression Loss for Face Alignment](https://mlsanity.com/paper/2203.15835/) (2022)
- [Facial Landmark Points Detection Using Knowledge Distillation-Based Neural Networks](https://mlsanity.com/paper/2111.07047/) (2021)
- [Tree-gated Deep Mixture-of-Experts For Pose-robust Face Alignment](https://mlsanity.com/paper/1910.09450/) (2019)
- [2D Image head pose estimation via latent space regression under occlusion settings](https://mlsanity.com/paper/2311.06038/) (2023)
- [Pretrained equivariant features improve unsupervised landmark discovery](https://mlsanity.com/paper/2104.02925/) (2021)
- [Ar2Can: An Architect and an Artist Leveraging a Canvas for Multi-Human Generation](https://mlsanity.com/paper/2511.22690/) (2025)
- [Separable Batch Normalization for Robust Facial Landmark Localization with Cross-protocol Network Training](https://mlsanity.com/paper/2101.06663/) (2021)
- [Facial Landmark Detection Evaluation on MOBIO Database](https://mlsanity.com/paper/2307.03329/) (2023)
- [Latent Embedding Clustering for Occlusion Robust Head Pose Estimation](https://mlsanity.com/paper/2403.20251/) (2024)

## Abstract (arXiv)

Facial landmark detection, head pose estimation, and facial deformation analysis are typical facial behavior analysis tasks in computer vision. The existing methods usually perform each task independently and sequentially, ignoring their interactions. To tackle this problem, we propose a unified framework for simultaneous facial landmark detection, head pose estimation, and facial deformation analysis, and the proposed model is robust to facial occlusion. Following a cascade procedure augmented with model-based head pose estimation, we iteratively update the facial landmark locations, facial occlusion, head pose and facial de- formation until convergence. The experimental results on benchmark databases demonstrate the effectiveness of the proposed method for simultaneous facial landmark detection, head pose and facial deformation estimation, even if the images are under facial occlusion.