On the representation and methodology for wide and short range head pose estimation
Not on the map. Why?
Abstract (arXiv)
Head pose estimation (HPE) is a problem of interest in computer vision to improve the performance of face processing tasks in semi-frontal or profile settings. Recent applications require the analysis of faces in the full 360deg rotation range. Traditional approaches to solve the semi-frontal and profile cases are not directly amenable for the full rotation case. In this paper we analyze the methodology for short- and wide-range HPE and discuss which representations and metrics are adequate for each case. We show that the popular Euler angles representation is a good choice for short-range HPE, but not at extreme rotations. However, the Euler angles' gimbal lock problem prevents them from being used as a valid metric in any setting. We also revisit the current cross-data set evaluation methodology and note that the lack of alignment between the reference systems of the training and test data sets negatively biases the results of all articles in the literature. We introduce a procedure to quantify this misalignment and a new methodology for cross-data set HPE that establishes new, more accurate, SOTA for the 300W-LP|Biwi benchmark. We also propose a generalization of the geodesic angular distance metric that enables the construction of a loss that controls the contribution of each training sample to the optimization of the model. Finally, we introduce a wide range HPE benchmark based on the CMU Panoptic data set.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 20 of its 40 references that are in the map. First posted on arXiv 11 Jan 2024.
Builds on
20 of 40 references.
References · 20
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
- 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 903
- 2015WIDER FACE: A Face Detection Benchmarkcited by 298
- 2016Panoptic Studio: A Massively Multiview System for Social Interaction Capturecited by 173
- 2017Fine-Grained Head Pose Estimation Without Keypointscited by 163
- 2018Face Alignment in Full Pose Range: A 3D Total Solutioncited by 148
- 2017Wing Loss for Robust Facial Landmark Localisation with Convolutional Neural Networkscited by 109
- 2016HyperFace: A Deep Multi-task Learning Framework for Face Detection, Landmark Localization, Pose Estimation, and Gender Recognitioncited by 104
- 2020Bridging Composite and Real: Towards End-to-end Deep Image Mattingcited by 89
- 20226D Rotation Representation For Unconstrained Head Pose Estimationcited by 64
- 2020img2pose: Face Alignment and Detection via 6DoF, Face Pose Estimationcited by 58
8 more
- 2020WHENet: Real-time Fine-Grained Estimation for Wide Range Head Posecited by 47
- 2020A Vector-based Representation to Enhance Head Pose Estimationcited by 35
- 2022DAD-3DHeads: A Large-scale Dense, Accurate and Diverse Dataset for 3D Head Alignment from a Single Imagecited by 31
- 2022Multi-task head pose estimation in-the-wildcited by 23
- 2022Uni6D: A Unified CNN Framework without Projection Breakdown for 6D Pose Estimationcited by 22
- 2022Focal Length and Object Pose Estimation via Render and Comparecited by 17
- 2017FERA 2017 - Addressing Head Pose in the Third Facial Expression Recognition and Analysis Challengecited by 9
- 2023DSFNet: Dual Space Fusion Network for Occlusion-Robust 3D Dense Face Alignmentcited by 6
Built on by
Citing papers per year: 2024: 7; 2025: 2; 2026: 3.
12 papers.
- 2024FaceXFormer: A Unified Transformer for Facial Analysiscited by 34
- 2024Face-MLLM: A Large Face Perception Modelcited by 13
- 2025FaVChat: Hierarchical Prompt-Query Guided Facial Video Understanding with Data-Efficient GRPOcited by 6
- 2024Semi-Supervised Unconstrained Head Pose Estimation in the Wildcited by 2
- 2024HPE-CogVLM: Advancing Vision Language Models with a Head Pose Grounding Taskcited by 1
- 2024On the power of data augmentation for head pose estimationcited by 0
- 2024Bidirectional Regression for Monocular 6DoF Head Pose Estimation and Reference System Alignmentcited by 0
- 2024CLERF: Contrastive LEaRning for Full Range Head Pose Estimationcited by 0
- 2025DIPSER: A Dataset for In-Person Student Engagement Recognition in the Wildcited by 0
- 2026Auditing Demographic Bias in Facial Landmark Detection for Fair Human-Robot Interactioncited by 0
- 2026VGGT-HPE: Reframing Head Pose Estimation as Relative Pose Predictioncited by 0
- 2026DIME: Scaling Facial Representation Learning via Differential Masked Autoencodingcited by 0
- 2026DIME: Scaling Facial Representation Learning via Differential Masked Autoencoding12 Oct 2026
- 2026VGGT-HPE: Reframing Head Pose Estimation as Relative Pose Prediction11 Apr 2026
- 2026Auditing Demographic Bias in Facial Landmark Detection for Fair Human-Robot Interaction8 Apr 2026
- 2025FaVChat: Hierarchical Prompt-Query Guided Facial Video Understanding with Data-Efficient GRPO12 Mar 2025
- 2025DIPSER: A Dataset for In-Person Student Engagement Recognition in the Wild27 Feb 2025
- 2024CLERF: Contrastive LEaRning for Full Range Head Pose Estimation3 Dec 2024
- 2024Face-MLLM: A Large Face Perception Model28 Oct 2024
- 2024Bidirectional Regression for Monocular 6DoF Head Pose Estimation and Reference System Alignment19 Jul 2024
- 2024On the power of data augmentation for head pose estimation7 Jul 2024
- 2024HPE-CogVLM: Advancing Vision Language Models with a Head Pose Grounding Task4 Jun 2024
- 2024Semi-Supervised Unconstrained Head Pose Estimation in the Wild3 Apr 2024
- 2024FaceXFormer: A Unified Transformer for Facial Analysis19 Mar 2024