# Nose, eyes and ears: Head pose estimation by locating facial keypoints

arXiv: https://arxiv.org/abs/1812.00739 · HTML: https://mlsanity.com/paper/1812.00739/

## Key facts

- Cited by 6 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 3 Dec 2018.

## Built on by (most cited first, 6 of 6)

- [Towards Robust and Unconstrained Full Range of Rotation Head Pose Estimation](https://mlsanity.com/paper/2309.07654/) (2023)
- [PedRecNet: Multi-task deep neural network for full 3D human pose and orientation estimation](https://mlsanity.com/paper/2204.11548/) (2022)
- [Defending Deep Regression Models against Backdoor Attacks](https://mlsanity.com/paper/2411.04811/) (2024)
- [MarkerPose: Robust Real-time Planar Target Tracking for Accurate Stereo Pose Estimation](https://mlsanity.com/paper/2105.00368/) (2021)
- [SLYKLatent: A Learning Framework for Gaze Estimation Using Deep Facial Feature Learning](https://mlsanity.com/paper/2402.01555/) (2024)
- [Boosting of Head Pose Estimation by Knowledge Distillation](https://mlsanity.com/paper/2108.09183/) (2021)

## Abstract (arXiv)

Monocular head pose estimation requires learning a model that computes the intrinsic Euler angles for pose (yaw, pitch, roll) from an input image of human face. Annotating ground truth head pose angles for images in the wild is difficult and requires ad-hoc fitting procedures (which provides only coarse and approximate annotations). This highlights the need for approaches which can train on data captured in controlled environment and generalize on the images in the wild (with varying appearance and illumination of the face). Most present day deep learning approaches which learn a regression function directly on the input images fail to do so. To this end, we propose to use a higher level representation to regress the head pose while using deep learning architectures. More specifically, we use the uncertainty maps in the form of 2D soft localization heatmap images over five facial keypoints, namely left ear, right ear, left eye, right eye and nose, and pass them through an convolutional neural network to regress the head-pose. We show head pose estimation results on two challenging benchmarks BIWI and AFLW and our approach surpasses the state of the art on both the datasets.