# Disentangling 3D Pose in A Dendritic CNN for Unconstrained 2D Face Alignment

arXiv: https://arxiv.org/abs/1802.06713 · HTML: https://mlsanity.com/paper/1802.06713/

## Key facts

- Cited by 18 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 19 Feb 2018.

## Built on by (most cited first, 18 of 18)

- [STAR Loss: Reducing Semantic Ambiguity in Facial Landmark Detection](https://mlsanity.com/paper/2306.02763/) (2023)
- [ADNet: Leveraging Error-Bias Towards Normal Direction in Face Alignment](https://mlsanity.com/paper/2109.05721/) (2021)
- [Supervision by Registration and Triangulation for Landmark Detection](https://mlsanity.com/paper/2101.09866/) (2021)
- [Multi-task head pose estimation in-the-wild](https://mlsanity.com/paper/2202.02299/) (2022)
- [ZoomNAS: Searching for Whole-body Human Pose Estimation in the Wild](https://mlsanity.com/paper/2208.11547/) (2022)
- [Shape Preserving Facial Landmarks with Graph Attention Networks](https://mlsanity.com/paper/2210.07233/) (2022)
- [Precise Facial Landmark Detection by Reference Heatmap Transformer](https://mlsanity.com/paper/2303.07840/) (2023)
- [HIH: Towards More Accurate Face Alignment via Heatmap in Heatmap](https://mlsanity.com/paper/2104.03100/) (2021)
- [ASMNet: a Lightweight Deep Neural Network for Face Alignment and Pose Estimation](https://mlsanity.com/paper/2103.00119/) (2021)
- [A Comprehensive Survey on Deep-Learning-based Vehicle Re-Identification: Models, Data Sets and Challenges](https://mlsanity.com/paper/2401.10643/) (2024)
- [Facial Landmark Points Detection Using Knowledge Distillation-Based Neural Networks](https://mlsanity.com/paper/2111.07047/) (2021)
- [Robust and Precise Facial Landmark Detection by Self-Calibrated Pose Attention Network](https://mlsanity.com/paper/2112.12328/) (2021)
- [Tree-gated Deep Mixture-of-Experts For Pose-robust Face Alignment](https://mlsanity.com/paper/1910.09450/) (2019)
- [Reasoning Structural Relation for Occlusion-Robust Facial Landmark Localization](https://mlsanity.com/paper/2112.10087/) (2021)
- [Generative Landmarks Guided Eyeglasses Removal 3D Face Reconstruction](https://mlsanity.com/paper/2412.19848/) (2024)
- [Heatmap Regression without Soft-Argmax for Facial Landmark Detection](https://mlsanity.com/paper/2508.14929/) (2025)
- [Supervision-by-Hallucination-and-Transfer: A Weakly-Supervised Approach for Robust and Precise Facial Landmark Detection](https://mlsanity.com/paper/2601.12919/) (2026)
- [Double-Shot 3D Shape Measurement with a Dual-Branch Network for Structured Light Projection Profilometry](https://mlsanity.com/paper/2407.14198/) (2024)

## Abstract (arXiv)

Heatmap regression has been used for landmark localization for quite a while now. Most of the methods use a very deep stack of bottleneck modules for heatmap classification stage, followed by heatmap regression to extract the keypoints. In this paper, we present a single dendritic CNN, termed as Pose Conditioned Dendritic Convolution Neural Network (PCD-CNN), where a classification network is followed by a second and modular classification network, trained in an end to end fashion to obtain accurate landmark points. Following a Bayesian formulation, we disentangle the 3D pose of a face image explicitly by conditioning the landmark estimation on pose, making it different from multi-tasking approaches. Extensive experimentation shows that conditioning on pose reduces the localization error by making it agnostic to face pose. The proposed model can be extended to yield variable number of landmark points and hence broadening its applicability to other datasets. Instead of increasing depth or width of the network, we train the CNN efficiently with Mask-Softmax Loss and hard sample mining to achieve upto 15% reduction in error compared to state-of-the-art methods for extreme and medium pose face images from challenging datasets including AFLW, AFW, COFW and IBUG.
