HyperFace: A Deep Multi-task Learning Framework for Face Detection, Landmark Localization, Pose Estimation, and Gender Recognition
Not on the map. Why?
Abstract (arXiv)
We present an algorithm for simultaneous face detection, landmarks localization, pose estimation and gender recognition using deep convolutional neural networks (CNN). The proposed method called, HyperFace, fuses the intermediate layers of a deep CNN using a separate CNN followed by a multi-task learning algorithm that operates on the fused features. It exploits the synergy among the tasks which boosts up their individual performances. Additionally, we propose two variants of HyperFace: (1) HyperFace-ResNet that builds on the ResNet-101 model and achieves significant improvement in performance, and (2) Fast-HyperFace that uses a high recall fast face detector for generating region proposals to improve the speed of the algorithm. Extensive experiments show that the proposed models are able to capture both global and local information in faces and performs significantly better than many competitive algorithms for each of these four tasks.
Key facts. Cited by 103 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Mar 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 36; 2022: 22; 2023: 17; 2024: 18; 2025: 6; 2026: 4.
103 papers.
Sort:
By area:
- 2021Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forwardcited by 82
- 2021OTCE: A Transferability Metric for Cross-Domain Cross-Task Representationscited by 62
- 2022Where in the World is this Image? Transformer-based Geo-localization in the Wildcited by 58
- 2023PIGEON: Predicting Image Geolocationscited by 55
- 2021Deep Learning for Micro-expression Recognition: A Surveycited by 43
- 2022Task Adaptive Parameter Sharing for Multi-Task Learningcited by 42
- 2023SwinFace: A Multi-task Transformer for Face Recognition, Expression Recognition, Age Estimation and Attribute Estimationcited by 38
- 2024FaceXFormer: A Unified Transformer for Facial Analysiscited by 34
- 2023Model Spider: Learning to Rank Pre-Trained Models Efficientlycited by 32
- 2022DAD-3DHeads: A Large-scale Dense, Accurate and Diverse Dataset for 3D Head Alignment from a Single Imagecited by 31
- 2021Unsupervised Part Segmentation through Disentangling Appearance and Shapecited by 29
- 2021Pre-training strategies and datasets for facial representation learningcited by 25
38 more
- 2022Multi-task head pose estimation in-the-wildcited by 22
- 2023Towards Robust and Unconstrained Full Range of Rotation Head Pose Estimationcited by 20
- 2022Part-based Face Recognition with Vision Transformerscited by 18
- 2025BiggerGait: Unlocking Gait Recognition with Layer-wise Representations from Large Vision Modelscited by 18
- 2021Towards Accurate and Compact Architectures via Neural Architecture Transformercited by 17
- 2021MultiTask-CenterNet (MCN): Efficient and Diverse Multitask Learning using an Anchor Free Approachcited by 17
- 2021AutoMTL: A Programming Framework for Automating Efficient Multi-Task Learningcited by 17
- 2022GazeOnce: Real-Time Multi-Person Gaze Estimationcited by 17
- 2024A Comprehensive Survey of Convolutions in Deep Learning: Applications, Challenges, and Future Trendscited by 16
- 2021Graph-based Facial Affect Analysis: A Reviewcited by 14
- 2022DiSparse: Disentangled Sparsification for Multitask Model Compressioncited by 14
- 2021Facial-Sketch Synthesis: A New Challengecited by 13
- 2024Faceptor: A Generalist Model for Face Perceptioncited by 12
- 2024On the representation and methodology for wide and short range head pose estimationcited by 11
- 2024Face-MLLM: A Large Face Perception Modelcited by 11
- 2021ASMNet: a Lightweight Deep Neural Network for Face Alignment and Pose Estimationcited by 10
- 2021Going Deeper Into Face Detection: A Surveycited by 10
- 2021A Deep Learning-based Quality Assessment and Segmentation System with a Large-scale Benchmark Dataset for Optical Coherence Tomographic Angiography Imagecited by 9
- 2021HHP-Net: A light Heteroscedastic neural network for Head Pose estimation with uncertaintycited by 9
- 2023Contrastive Modules with Temporal Attention for Multi-Task Reinforcement Learningcited by 8
- 2021Sejong Face Database: A Multi-Modal Disguise Face Databasecited by 7
- 2021Convolutional Neural Networks for Sleep Stage Scoring on a Two-Channel EEG Signalcited by 6
- 2021LOTR: Face Landmark Localization Using Localization Transformercited by 6
- 2022Multi-Order Networks for Action Unit Detectioncited by 6
- 2023DirectMHP: Direct 2D Multi-Person Head Pose Estimation with Full-range Anglescited by 6
- 2025FaVChat: Hierarchical Prompt-Query Guided Facial Video Understanding with Data-Efficient GRPOcited by 6
- 2021Few-Shot Model Adaptation for Customized Facial Landmark Detection, Segmentation, Stylization and Shadow Removalcited by 5
- 2023YOLOR-Based Multi-Task Learningcited by 5
- 2023BAND-2k: Banding Artifact Noticeable Database for Banding Detection and Quality Assessmentcited by 5
- 2024Task-adaptive Q-Facecited by 5
- 2021Instance-Level Task Parameters: A Robust Multi-task Weighting Frameworkcited by 4
- 2021Identification of Attack-Specific Signatures in Adversarial Examplescited by 4
- 2022LwPosr: Lightweight Efficient Fine-Grained Head Pose Estimationcited by 4
- 2022Composite Learning for Robust and Effective Dense Predictionscited by 4
- 2021Regional Attention Network (RAN) for Head Pose and Fine-grained Gesture Recognitioncited by 3
- 2021Is Gender "In-the-Wild" Inference Really a Solved Problem?cited by 3
- 2022ViewNet: Unsupervised Viewpoint Estimation from Conditional Generationcited by 3
- 2023EfficientFace: An Efficient Deep Network with Feature Enhancement for Accurate Face Detectioncited by 3
50 most cited of 103 All 103 (JSON)
- 2026Towards Unified Dynamic Face Landmark Detection11 Aug 2026
- 2026Variational Encoder--Multi-Decoder (VE-MD) for Privacy-by-functional-design (Group) Emotion Recognition2 Apr 2026
- 2026A Backbone Benchmarking Study on Self-supervised Learning as a Auxiliary Task with Texture-based Local Descriptors for Face Analysis23 Mar 2026
- 2026EgoAdapt: Enhancing Robustness in Egocentric Interactive Speaker Detection Under Missing Modalities18 Mar 2026
- 2025Silhouette-based Gait Foundation Model30 Nov 2025
- 2025Combo-Gait: Unified Transformer Framework for Multi-Modal Gait Recognition and Attribute Analysis12 Oct 2025
- 2025BiggerGait: Unlocking Gait Recognition with Layer-wise Representations from Large Vision Models23 May 2025
- 2025FaceInsight: A Multimodal Large Language Model for Face Perception22 Apr 2025
- 2025Exploring Reliable PPG Authentication on Smartwatches in Daily Scenarios31 Mar 2025
- 2025FaVChat: Hierarchical Prompt-Query Guided Facial Video Understanding with Data-Efficient GRPO12 Mar 2025
- 2024Face-MLLM: A Large Face Perception Model28 Oct 2024
- 2024DREB-Net: Dual-stream Restoration Embedding Blur-feature Fusion Network for High-mobility UAV Object Detection23 Oct 2024
38 more
- 2024Self-supervised Auxiliary Learning for Texture and Model-based Hybrid Robust and Fair Featuring in Face Analysis29 Sep 2024
- 2024Temporal2Seq: A Unified Framework for Temporal Video Understanding Tasks27 Sep 2024
- 2024Bidirectional Regression for Monocular 6DoF Head Pose Estimation and Reference System Alignment19 Jul 2024
- 2024DenseSeg: Joint Learning for Semantic Segmentation and Landmark Detection Using Dense Image-to-Shape Representation30 May 2024
- 2024Adversarial Attacks on Hidden Tasks in Multi-Task Learning24 May 2024
- 2024Task-adaptive Q-Face15 May 2024
- 2024Explainable Deepfake Video Detection using Convolutional Neural Network and CapsuleNet19 Apr 2024
- 2024Simple In-place Data Augmentation for Surveillance Object Detection17 Apr 2024
- 2024Semi-Supervised Unconstrained Head Pose Estimation in the Wild3 Apr 2024
- 2024FaceXFormer: A Unified Transformer for Facial Analysis19 Mar 2024
- 2024Faceptor: A Generalist Model for Face Perception14 Mar 2024
- 2024Location-guided Head Pose Estimation for Fisheye Image28 Feb 2024
- 2024A Comprehensive Survey of Convolutions in Deep Learning: Applications, Challenges, and Future Trends23 Feb 2024
- 2024Integrative Variational Autoencoders for Generative Modeling of an Image Outcome with Multiple Input Images5 Feb 2024
- 2024On the representation and methodology for wide and short range head pose estimation11 Jan 2024
- 2024CATFace: Cross-Attribute-Guided Transformer with Self-Attention Distillation for Low-Quality Face Recognition5 Jan 2024
- 2023FS-BAND: A Frequency-Sensitive Banding Detector30 Nov 2023
- 2023BAND-2k: Banding Artifact Noticeable Database for Banding Detection and Quality Assessment29 Nov 2023
- 2023Contrastive Modules with Temporal Attention for Multi-Task Reinforcement Learning2 Nov 2023
- 2023YOLOR-Based Multi-Task Learning29 Sep 2023
- 2023A Real-Time Multi-Task Learning System for Joint Detection of Face, Facial Landmark and Head Pose21 Sep 2023
- 2023Towards Robust and Unconstrained Full Range of Rotation Head Pose Estimation14 Sep 2023
- 2023Label Budget Allocation in Multi-Task Learning24 Aug 2023
- 2023SwinFace: A Multi-task Transformer for Face Recognition, Expression Recognition, Age Estimation and Attribute Estimation22 Aug 2023
- 2023AAFACE: Attribute-aware Attentional Network for Face Recognition14 Aug 2023
- 2023PGT-Net: Progressive Guided Multi-task Neural Network for Small-area Wet Fingerprint Denoising and Recognition14 Aug 2023
- 2023PIGEON: Predicting Image Geolocations11 Jul 2023
- 2023Model Spider: Learning to Rank Pre-Trained Models Efficiently6 Jun 2023
- 2023EfficientSRFace: An Efficient Network with Super-Resolution Enhancement for Accurate Face Detection4 Jun 2023
- 2023Robust Category-Level 3D Pose Estimation from Synthetic Data25 May 2023
- 2023Attacking All Tasks at Once Using Adversarial Examples in Multi-Task Learning20 May 2023
- 2023EfficientFace: An Efficient Deep Network with Feature Enhancement for Accurate Face Detection23 Feb 2023
- 2023DirectMHP: Direct 2D Multi-Person Head Pose Estimation with Full-range Angles2 Feb 2023
- 2022Need of 6G for the Metaverse Realization28 Dec 2022
- 2022An Intuitive and Unconstrained 2D Cube Representation for Simultaneous Head Detection and Pose Estimation7 Dec 2022
- 2022ViewNet: Unsupervised Viewpoint Estimation from Conditional Generation1 Dec 2022
- 2022Part-based Face Recognition with Vision Transformers30 Nov 2022
- 2022PrivacyProber: Assessment and Detection of Soft-Biometric Privacy-Enhancing Techniques16 Nov 2022
50 newest of 103 All 103 (JSON)
- 2024Face-MLLM: A Large Face Perception Modelcited by 11
- 2025FaceInsight: A Multimodal Large Language Model for Face Perceptioncited by 2
- 2025FaceInsight: A Multimodal Large Language Model for Face Perception22 Apr 2025
- 2024Face-MLLM: A Large Face Perception Model28 Oct 2024
- 2021Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forwardcited by 82
- 2021OTCE: A Transferability Metric for Cross-Domain Cross-Task Representationscited by 62
- 2022Where in the World is this Image? Transformer-based Geo-localization in the Wildcited by 58
- 2023PIGEON: Predicting Image Geolocationscited by 55
- 2021Deep Learning for Micro-expression Recognition: A Surveycited by 43
- 2022Task Adaptive Parameter Sharing for Multi-Task Learningcited by 42
- 2023SwinFace: A Multi-task Transformer for Face Recognition, Expression Recognition, Age Estimation and Attribute Estimationcited by 38
- 2024FaceXFormer: A Unified Transformer for Facial Analysiscited by 34
- 2023Model Spider: Learning to Rank Pre-Trained Models Efficientlycited by 32
- 2022DAD-3DHeads: A Large-scale Dense, Accurate and Diverse Dataset for 3D Head Alignment from a Single Imagecited by 31
- 2021Unsupervised Part Segmentation through Disentangling Appearance and Shapecited by 29
- 2021Pre-training strategies and datasets for facial representation learningcited by 25
12 most cited of 100 All 100 (JSON)
- 2026Towards Unified Dynamic Face Landmark Detection11 Aug 2026
- 2026Variational Encoder--Multi-Decoder (VE-MD) for Privacy-by-functional-design (Group) Emotion Recognition2 Apr 2026
- 2026A Backbone Benchmarking Study on Self-supervised Learning as a Auxiliary Task with Texture-based Local Descriptors for Face Analysis23 Mar 2026
- 2026EgoAdapt: Enhancing Robustness in Egocentric Interactive Speaker Detection Under Missing Modalities18 Mar 2026
- 2025Silhouette-based Gait Foundation Model30 Nov 2025
- 2025Combo-Gait: Unified Transformer Framework for Multi-Modal Gait Recognition and Attribute Analysis12 Oct 2025
- 2025BiggerGait: Unlocking Gait Recognition with Layer-wise Representations from Large Vision Models23 May 2025
- 2025Exploring Reliable PPG Authentication on Smartwatches in Daily Scenarios31 Mar 2025
- 2024DREB-Net: Dual-stream Restoration Embedding Blur-feature Fusion Network for High-mobility UAV Object Detection23 Oct 2024
- 2024Self-supervised Auxiliary Learning for Texture and Model-based Hybrid Robust and Fair Featuring in Face Analysis29 Sep 2024
- 2024Temporal2Seq: A Unified Framework for Temporal Video Understanding Tasks27 Sep 2024
- 2024Bidirectional Regression for Monocular 6DoF Head Pose Estimation and Reference System Alignment19 Jul 2024
12 newest of 100 All 100 (JSON)