mlsanityData to 7 Oct 2026

Bidirectional Regression for Monocular 6DoF Head Pose Estimation and Reference System Alignment

arXiv 2407.14136 ↗First posted 19 Jul 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Precise six-degree-of-freedom (6DoF) head pose estimation is crucial for safety-critical applications and human-computer interaction scenarios, yet existing monocular methods still struggle with robust pose estimation. We revisit this problem by introducing TRGv2, a lightweight extension of our previous Translation, Rotation, and Geometry (TRG) network, which explicitly models the bidirectional interaction between facial geometry and head pose. TRGv2 jointly infers facial landmarks and 6DoF pose through an iterative refinement loop with landmark-to-image projection, ensuring metric consistency among face size, rotation, and depth. To further improve generalization to out-of-distribution data, TRGv2 regresses correction parameters instead of directly predicting translation, combining them with a pinhole camera model for analytic depth estimation. In addition, we identify a previously overlooked source of bias in cross-dataset evaluations due to inconsistent head center definitions across different datasets. To address this, we propose a reference system alignment strategy that quantifies and corrects translation bias, enabling fair comparisons across datasets. Extensive experiments on ARKitFace, BIWI, and the challenging DD-Pose benchmarks demonstrate that TRGv2 outperforms state-of-the-art methods in both accuracy and efficiency. Code and newly annotated landmarks for DD-Pose will be publicly available.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 37 of its 64 references that are in the map. First posted on arXiv 19 Jul 2024.

Builds on

37 of 64 references.

References · 37

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  4. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
  5. 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 481
  6. 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 475
  7. 2020End-to-End Human Pose and Mesh Reconstruction with Transformerscited by 417
  8. 2018Generating 3D faces using Convolutional Mesh Autoencoderscited by 267
  9. 2017Integral Human Pose Regressioncited by 255
  10. 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
  11. 2022CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimationcited by 237
  12. 2020Towards Fast, Accurate and Stable 3D Dense Face Alignmentcited by 219
25 more
  1. 2019Pix2Pose: Pixel-Wise Coordinate Regression of Objects for 6D Pose Estimationcited by 218
  2. 2018Joint 3D Face Reconstruction and Dense Alignment with Position Map Regression Networkcited by 195
  3. 2022Towards Metrical Reconstruction of Human Facescited by 165
  4. 2017Fine-Grained Head Pose Estimation Without Keypointscited by 163
  5. 2020We are More than Our Joints: Predicting how 3D Bodies Movecited by 115
  6. 2016HyperFace: A Deep Multi-task Learning Framework for Face Detection, Landmark Localization, Pose Estimation, and Gender Recognitioncited by 103
  7. 2022Cross-Attention of Disentangled Modalities for 3D Human Mesh Recovery with Transformerscited by 81
  8. 20226D Rotation Representation For Unconstrained Head Pose Estimationcited by 63
  9. 2020img2pose: Face Alignment and Detection via 6DoF, Face Pose Estimationcited by 57
  10. 2020WHENet: Real-time Fine-Grained Estimation for Wide Range Head Posecited by 47
  11. 2020A Vector-based Representation to Enhance Head Pose Estimationcited by 34
  12. 2024FaceXFormer: A Unified Transformer for Facial Analysiscited by 34
  13. 2022DAD-3DHeads: A Large-scale Dense, Accurate and Diverse Dataset for 3D Head Alignment from a Single Imagecited by 31
  14. 2021Synergy between 3DMM and 3D Landmarks for Accurate 3D Facial Geometrycited by 27
  15. 2022Multi-task head pose estimation in-the-wildcited by 22
  16. 2023Towards Robust and Unconstrained Full Range of Rotation Head Pose Estimationcited by 20
  17. 2024On the representation and methodology for wide and short range head pose estimationcited by 11
  18. 2019Facial Pose Estimation by Deep Learning from Label Distributionscited by 10
  19. 2022Towards 3D Face Reconstruction in Perspective Projection: Estimating 6DoF Face Pose from Monocular Imagecited by 9
  20. 2022Towards Unbiased Label Distribution Learning for Facial Pose Estimation Using Anisotropic Spherical Gaussiancited by 7
  21. 2023DirectMHP: Direct 2D Multi-Person Head Pose Estimation with Full-range Anglescited by 6
  22. 2022Perspective Reconstruction of Human Faces by Joint Mesh and Landmark Regressioncited by 4
  23. 2023Representation learning of vertex heatmaps for 3D human mesh reconstruction from multi-view imagescited by 4
  24. 20232D Image head pose estimation via latent space regression under occlusion settingscited by 3
  25. 2024Semi-Supervised Unconstrained Head Pose Estimation in the Wildcited by 2

Built on by

Not cited yet.