6D Rotation Representation For Unconstrained Head Pose Estimation
Not on the map. Why?
Abstract (arXiv)
In this paper, we present a method for unconstrained end-to-end head pose estimation. We address the problem of ambiguous rotation labels by introducing the rotation matrix formalism for our ground truth data and propose a continuous 6D rotation matrix representation for efficient and robust direct regression. This way, our method can learn the full rotation appearance which is contrary to previous approaches that restrict the pose prediction to a narrow-angle for satisfactory results. In addition, we propose a geodesic distance-based loss to penalize our network with respect to the SO(3) manifold geometry. Experiments on the public AFLW2000 and BIWI datasets demonstrate that our proposed method significantly outperforms other state-of-the-art methods by up to 20%. We open-source our training and testing code along with our pre-trained models: https://github.com/thohemp/6DRepNet.
Key facts. Cited by 63 papers in the map (data through 7 Oct 2026). Builds on 9 of its 20 references that are in the map. First posted on arXiv 25 Feb 2022.
Builds on
9 of 20 references.
References · 9
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Going Deeper with Convolutionscited by 4,231
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
- 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 895
- 2021RepVGG: Making VGG-style ConvNets Great Againcited by 520
- 2017Fine-Grained Head Pose Estimation Without Keypointscited by 163
- 2018Face Alignment in Full Pose Range: A 3D Total Solutioncited by 147
- 2020WHENet: Real-time Fine-Grained Estimation for Wide Range Head Posecited by 47
- 2020A Vector-based Representation to Enhance Head Pose Estimationcited by 34
Built on by
Citing papers per year: 2022: 5; 2023: 13; 2024: 26; 2025: 4; 2026: 15.
63 papers.
Sort:
By area:
- 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 247
- 2024FaceXFormer: A Unified Transformer for Facial Analysiscited by 34
- 2022DATID-3D: Diversity-Preserved Domain Adaptation Using Text-to-Image Diffusion for 3D Generative Modelcited by 32
- 2022Synthetic Data in Human Analysis: A Surveycited by 28
- 2024EgoLM: Multi-Modal Language Model of Egocentric Motionscited by 28
- 2025FaceXBench: Evaluating Multimodal LLMs on Face Understandingcited by 23
- 2023Towards Robust and Unconstrained Full Range of Rotation Head Pose Estimationcited by 20
- 2023Unsupervised Volumetric Animationcited by 18
- 2024On the representation and methodology for wide and short range head pose estimationcited by 11
- 2024CloudFixer: Test-Time Adaptation for 3D Point Clouds via Diffusion-Guided Geometric Transformationcited by 11
- 2026Wall-OSS-0.5 Technical Reportcited by 11
- 2023Disguise without Disruption: Utility-Preserving Face De-Identificationcited by 8
38 more
- 2025SENTINEL: A Fully End-to-End Language-Action Model for Humanoid Whole Body Controlcited by 7
- 2023DirectMHP: Direct 2D Multi-Person Head Pose Estimation with Full-range Anglescited by 6
- 2023DSFNet: Dual Space Fusion Network for Occlusion-Robust 3D Dense Face Alignmentcited by 6
- 2024Two-in-One: Unified Multi-Person Interactive Motion Generation by Latent Diffusion Transformercited by 6
- 2026X-Tokenizer: A Multimodal Action Tokenizer for Vision-Language-Action Pretrainingcited by 6
- 2022GOTCHA: Real-Time Video Deepfake Detection via Challenge-Responsecited by 5
- 2024Edit One for All: Interactive Batch Image Editingcited by 5
- 2024Task-adaptive Q-Facecited by 5
- 2024Geometric Transformation Uncertainty for Improving 3D Fetal Brain Pose Prediction from Freehand 2D Ultrasound Videoscited by 5
- 2023Robust Self-Supervised Extrinsic Self-Calibrationcited by 4
- 20232D Image head pose estimation via latent space regression under occlusion settingscited by 3
- 2024Mathematical Foundation and Corrections for Full Range Head Pose Estimationcited by 3
- 2024Skip-and-Play: Depth-Driven Pose-Preserved Image Generation for Any Objectscited by 3
- 2022An Intuitive and Unconstrained 2D Cube Representation for Simultaneous Head Detection and Pose Estimationcited by 2
- 2023Pose Impact Estimation on Face Recognition using 3D-Aware Synthetic Data with Application to Quality Assessmentcited by 2
- 2024Semi-Supervised Unconstrained Head Pose Estimation in the Wildcited by 2
- 2024FaceLift: Semi-supervised 3D Facial Landmark Localizationcited by 2
- 2024ReMP: Reusable Motion Prior for Multi-domain 3D Human Pose Estimation and Motion Inbetweeningcited by 2
- 2024Fairer Analysis and Demographically Balanced Face Generation for Fairer Face Verificationcited by 2
- 2022Extreme-scale Talking-Face Video Upsampling with Audio-Visual Priorscited by 1
- 2023Appearance-based gaze estimation enhanced with synthetic images using deep neural networkscited by 1
- 2024Alignment Helps Make the Most of Multimodal Datacited by 1
- 2024Rank-based No-reference Quality Assessment for Face Swappingcited by 1
- 2024HPE-CogVLM: Advancing Vision Language Models with a Head Pose Grounding Taskcited by 1
- 2024For a semiotic AI: Bridging computer vision and visual semiotics for computational observation of large scale facial image archivescited by 1
- 2024Full-range Head Pose Geometric Data Augmentationscited by 1
- 2024ORFormer: Occlusion-Robust Transformer for Accurate Facial Landmark Detectioncited by 1
- 2025StyleMorpheus: A Style-Based 3D-Aware Morphable Face Modelcited by 1
- 2026Beyond Coherence: Benchmarking Professional Editing-Technique Execution in Multi-Shot Audio-Video Generationcited by 1
- 2023Sentiment-based Engagement Strategies for intuitive Human-Robot Interactioncited by 0
- 20233D Face Alignment Through Fusion of Head Pose Information and Featurescited by 0
- 2023NITEC: Versatile Hand-Annotated Eye Contact Dataset for Ego-Vision Interactioncited by 0
- 2023VerA: Versatile Anonymization Applicable to Clinical Facial Photographscited by 0
- 2024Latent Embedding Clustering for Occlusion Robust Head Pose Estimationcited by 0
- 2024Toward Fairer Face Recognition Datasetscited by 0
- 2024On the power of data augmentation for head pose estimationcited by 0
- 2024Bidirectional Regression for Monocular 6DoF Head Pose Estimation and Reference System Alignmentcited by 0
- 2024End to End Face Reconstruction via Differentiable PnPcited by 0
50 most cited of 63 All 63 (JSON)
- 2026Automated Perceptually-Motivated Assessment of Photographic Consistency in Paired Clinical Photographs: Pipeline Development and Internal Evaluation14 Sep 2026
- 2026Beyond Coherence: Benchmarking Professional Editing-Technique Execution in Multi-Shot Audio-Video Generation8 Sep 2026
- 2026An Evaluation Framework for Generating Multi-View Images of a Person in a Scene4 Sep 2026
- 2026Coordinate Singularities Break Conformal Coverage for Gaze and Head Pose29 Jun 2026
- 2026MooMIns -- Monocular 3D Reconstruction and Object Pose Estimation from Multiple Instances12 Jun 2026
- 2026X-Tokenizer: A Multimodal Action Tokenizer for Vision-Language-Action Pretraining7 Jun 2026
- 2026Head-Pose-Aware Visual Speech Recognition with FiLM Modulation30 May 2026
- 2026Wall-OSS-0.5 Technical Report29 May 2026
- 2026FaithfulFaces: Pose-Faithful Facial Identity Preservation for Text-to-Video Generation6 May 2026
- 2026VGGT-HPE: Reframing Head Pose Estimation as Relative Pose Prediction11 Apr 2026
- 2026Image-based Quantification of Postural Deviations on Patients with Cervical Dystonia: A Machine Learning Approach Using Synthetic Training Data27 Mar 2026
- 2026Do Foundation Models Know Geometry? Probing Frozen Features for Continuous Physical Measurement6 Mar 2026
38 more
- 2026Yolo-Key-6D: Single Stage Monocular 6D Pose Estimation with Keypoint Enhancements4 Mar 2026
- 20263DXTalker: Unifying Identity, Lip Sync, Emotion, and Spatial Dynamics in Expressive 3D Talking Avatars11 Feb 2026
- 2026Asymmetric Hierarchical Anchoring for Robust Audio-Visual Cross-Modal Generalization3 Feb 2026
- 2025SENTINEL: A Fully End-to-End Language-Action Model for Humanoid Whole Body Control24 Nov 2025
- 2025Densemarks: Learning Canonical Embeddings for Human Heads Images via Point Tracks4 Nov 2025
- 2025StyleMorpheus: A Style-Based 3D-Aware Morphable Face Model14 Mar 2025
- 2025FaceXBench: Evaluating Multimodal LLMs on Face Understanding17 Jan 2025
- 2024Two-in-One: Unified Multi-Person Interactive Motion Generation by Latent Diffusion Transformer21 Dec 2024
- 2024ORFormer: Occlusion-Robust Transformer for Accurate Facial Landmark Detection17 Dec 2024
- 2024Fairer Analysis and Demographically Balanced Face Generation for Fairer Face Verification4 Dec 2024
- 2024ReMP: Reusable Motion Prior for Multi-domain 3D Human Pose Estimation and Motion Inbetweening13 Nov 2024
- 2024EgoLM: Multi-Modal Language Model of Egocentric Motions26 Sep 2024
- 2024End to End Face Reconstruction via Differentiable PnP21 Sep 2024
- 2024Skip-and-Play: Depth-Driven Pose-Preserved Image Generation for Any Objects4 Sep 2024
- 2024Full-range Head Pose Geometric Data Augmentations2 Aug 2024
- 2024CloudFixer: Test-Time Adaptation for 3D Point Clouds via Diffusion-Guided Geometric Transformation23 Jul 2024
- 2024Bidirectional Regression for Monocular 6DoF Head Pose Estimation and Reference System Alignment19 Jul 2024
- 2024Shape of Motion: 4D Reconstruction from a Single Video18 Jul 2024
- 2024On the power of data augmentation for head pose estimation7 Jul 2024
- 2024For a semiotic AI: Bridging computer vision and visual semiotics for computational observation of large scale facial image archives3 Jul 2024
- 2024Toward Fairer Face Recognition Datasets24 Jun 2024
- 2024HPE-CogVLM: Advancing Vision Language Models with a Head Pose Grounding Task4 Jun 2024
- 2024Rank-based No-reference Quality Assessment for Face Swapping4 Jun 2024
- 2024FaceLift: Semi-supervised 3D Facial Landmark Localization30 May 2024
- 2024Geometric Transformation Uncertainty for Improving 3D Fetal Brain Pose Prediction from Freehand 2D Ultrasound Videos21 May 2024
- 2024Task-adaptive Q-Face15 May 2024
- 2024Alignment Helps Make the Most of Multimodal Data14 May 2024
- 2024Semi-Supervised Unconstrained Head Pose Estimation in the Wild3 Apr 2024
- 2024Latent Embedding Clustering for Occlusion Robust Head Pose Estimation29 Mar 2024
- 2024Mathematical Foundation and Corrections for Full Range Head Pose Estimation26 Mar 2024
- 2024FaceXFormer: A Unified Transformer for Facial Analysis19 Mar 2024
- 2024Edit One for All: Interactive Batch Image Editing18 Jan 2024
- 2024On the representation and methodology for wide and short range head pose estimation11 Jan 2024
- 2023VerA: Versatile Anonymization Applicable to Clinical Facial Photographs4 Dec 2023
- 2023Appearance-based gaze estimation enhanced with synthetic images using deep neural networks23 Nov 2023
- 20232D Image head pose estimation via latent space regression under occlusion settings10 Nov 2023
- 2023NITEC: Versatile Hand-Annotated Eye Contact Dataset for Ego-Vision Interaction8 Nov 2023
- 2023Towards Robust and Unconstrained Full Range of Rotation Head Pose Estimation14 Sep 2023
50 newest of 63 All 63 (JSON)
- 2022DATID-3D: Diversity-Preserved Domain Adaptation Using Text-to-Image Diffusion for 3D Generative Modelcited by 32
- 2024CloudFixer: Test-Time Adaptation for 3D Point Clouds via Diffusion-Guided Geometric Transformationcited by 11
- 2024Two-in-One: Unified Multi-Person Interactive Motion Generation by Latent Diffusion Transformercited by 6
- 2024Skip-and-Play: Depth-Driven Pose-Preserved Image Generation for Any Objectscited by 3
- 2026An Evaluation Framework for Generating Multi-View Images of a Person in a Scenecited by 0
- 2026An Evaluation Framework for Generating Multi-View Images of a Person in a Scene4 Sep 2026
- 2024Two-in-One: Unified Multi-Person Interactive Motion Generation by Latent Diffusion Transformer21 Dec 2024
- 2024Skip-and-Play: Depth-Driven Pose-Preserved Image Generation for Any Objects4 Sep 2024
- 2024CloudFixer: Test-Time Adaptation for 3D Point Clouds via Diffusion-Guided Geometric Transformation23 Jul 2024
- 2022DATID-3D: Diversity-Preserved Domain Adaptation Using Text-to-Image Diffusion for 3D Generative Model29 Nov 2022
- 2024EgoLM: Multi-Modal Language Model of Egocentric Motionscited by 28
- 2025FaceXBench: Evaluating Multimodal LLMs on Face Understandingcited by 23
- 2024HPE-CogVLM: Advancing Vision Language Models with a Head Pose Grounding Taskcited by 1
- 2026Do Foundation Models Know Geometry? Probing Frozen Features for Continuous Physical Measurementcited by 0
- 2026Do Foundation Models Know Geometry? Probing Frozen Features for Continuous Physical Measurement6 Mar 2026
- 2025FaceXBench: Evaluating Multimodal LLMs on Face Understanding17 Jan 2025
- 2024EgoLM: Multi-Modal Language Model of Egocentric Motions26 Sep 2024
- 2024HPE-CogVLM: Advancing Vision Language Models with a Head Pose Grounding Task4 Jun 2024
- 2026Wall-OSS-0.5 Technical Reportcited by 11
- 2026X-Tokenizer: A Multimodal Action Tokenizer for Vision-Language-Action Pretrainingcited by 6
- 2026X-Tokenizer: A Multimodal Action Tokenizer for Vision-Language-Action Pretraining7 Jun 2026
- 2026Wall-OSS-0.5 Technical Report29 May 2026
- 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 247
- 2024FaceXFormer: A Unified Transformer for Facial Analysiscited by 34
- 2022Synthetic Data in Human Analysis: A Surveycited by 28
- 2023Towards Robust and Unconstrained Full Range of Rotation Head Pose Estimationcited by 20
- 2023Unsupervised Volumetric Animationcited by 18
- 2024On the representation and methodology for wide and short range head pose estimationcited by 11
- 2023Disguise without Disruption: Utility-Preserving Face De-Identificationcited by 8
- 2025SENTINEL: A Fully End-to-End Language-Action Model for Humanoid Whole Body Controlcited by 7
- 2023DirectMHP: Direct 2D Multi-Person Head Pose Estimation with Full-range Anglescited by 6
- 2023DSFNet: Dual Space Fusion Network for Occlusion-Robust 3D Dense Face Alignmentcited by 6
- 2022GOTCHA: Real-Time Video Deepfake Detection via Challenge-Responsecited by 5
- 2024Edit One for All: Interactive Batch Image Editingcited by 5
12 most cited of 52 All 52 (JSON)
- 2026Automated Perceptually-Motivated Assessment of Photographic Consistency in Paired Clinical Photographs: Pipeline Development and Internal Evaluation14 Sep 2026
- 2026Beyond Coherence: Benchmarking Professional Editing-Technique Execution in Multi-Shot Audio-Video Generation8 Sep 2026
- 2026Coordinate Singularities Break Conformal Coverage for Gaze and Head Pose29 Jun 2026
- 2026MooMIns -- Monocular 3D Reconstruction and Object Pose Estimation from Multiple Instances12 Jun 2026
- 2026Head-Pose-Aware Visual Speech Recognition with FiLM Modulation30 May 2026
- 2026FaithfulFaces: Pose-Faithful Facial Identity Preservation for Text-to-Video Generation6 May 2026
- 2026VGGT-HPE: Reframing Head Pose Estimation as Relative Pose Prediction11 Apr 2026
- 2026Image-based Quantification of Postural Deviations on Patients with Cervical Dystonia: A Machine Learning Approach Using Synthetic Training Data27 Mar 2026
- 2026Yolo-Key-6D: Single Stage Monocular 6D Pose Estimation with Keypoint Enhancements4 Mar 2026
- 20263DXTalker: Unifying Identity, Lip Sync, Emotion, and Spatial Dynamics in Expressive 3D Talking Avatars11 Feb 2026
- 2026Asymmetric Hierarchical Anchoring for Robust Audio-Visual Cross-Modal Generalization3 Feb 2026
- 2025SENTINEL: A Fully End-to-End Language-Action Model for Humanoid Whole Body Control24 Nov 2025
12 newest of 52 All 52 (JSON)