Look at Boundary: A Boundary-Aware Face Alignment Algorithm
Not on the map. Why?
Abstract (arXiv)
We present a novel boundary-aware face alignment algorithm by utilising boundary lines as the geometric structure of a human face to help facial landmark localisation. Unlike the conventional heatmap based method and regression based method, our approach derives face landmarks from boundary lines which remove the ambiguities in the landmark definition. Three questions are explored and answered by this work: 1. Why using boundary? 2. How to use boundary? 3. What is the relationship between boundary estimation and landmarks localisation? Our boundary- aware face alignment algorithm achieves 3.49% mean error on 300-W Fullset, which outperforms state-of-the-art methods by a large margin. Our method can also easily integrate information from other datasets. By utilising boundary information of 300-W dataset, our method achieves 3.92% mean error with 0.39% failure rate on COFW dataset, and 1.25% mean error on AFLW-Full dataset. Moreover, we propose a new dataset WFLW to unify training and testing across different factors, including poses, expressions, illuminations, makeups, occlusions, and blurriness. Dataset and model will be publicly available at https://wywu.github.io/projects/LAB/LAB.html
Key facts. Cited by 138 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 39; 2022: 26; 2023: 22; 2024: 24; 2025: 15; 2026: 12.
138 papers.
Sort:
By area:
- 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 250
- 2021Fake It Till You Make It: Face analysis in the wild using synthetic data alonecited by 200
- 2022AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Timecited by 200
- 2021General Facial Representation Learning in a Visual-Linguistic Mannercited by 195
- 2021Audio-Driven Emotional Video Portraitscited by 180
- 2022Not All Tokens Are Equal: Human-centric Visual Analysis via Token Clustering Transformercited by 101
- 2023Diffusion Model as Representation Learnercited by 95
- 20223D face reconstruction with dense landmarkscited by 70
- 2022Sparse Local Patch Transformer for Robust Face Alignment and Landmarks Inherent Relation Learningcited by 47
- 2023RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatarscited by 45
- 2023STAR Loss: Reducing Semantic Ambiguity in Facial Landmark Detectioncited by 43
- 2023High-Fidelity and Freely Controllable Talking Head Video Generationcited by 42
38 more
- 2024KeyPoint Relative Position Encoding for Face Recognitioncited by 38
- 2022Pose for Everything: Towards Category-Agnostic Pose Estimationcited by 36
- 2021Zoo-Tuning: Adaptive Transfer from a Zoo of Modelscited by 35
- 2021ADNet: Leveraging Error-Bias Towards Normal Direction in Face Alignmentcited by 34
- 2024FaceXFormer: A Unified Transformer for Facial Analysiscited by 34
- 2021Deep Learning-based Face Super-Resolution: A Surveycited by 32
- 2022DAD-3DHeads: A Large-scale Dense, Accurate and Diverse Dataset for 3D Head Alignment from a Single Imagecited by 31
- 2022Towards Accurate Facial Landmark Detection via Cascaded Transformerscited by 31
- 2021Supervision by Registration and Triangulation for Landmark Detectioncited by 30
- 2021Synergy between 3DMM and 3D Landmarks for Accurate 3D Facial Geometrycited by 27
- 2023Recurrence without Recurrence: Stable Video Landmark Detection with Deep Equilibrium Modelscited by 27
- 2021Pre-training strategies and datasets for facial representation learningcited by 26
- 2021Sparse to Dense Motion Transfer for Face Image Animationcited by 25
- 2022Towards Realistic Visual Dubbing with Heterogeneous Sourcescited by 24
- 2022Multi-task head pose estimation in-the-wildcited by 23
- 2022ZoomNAS: Searching for Whole-body Human Pose Estimation in the Wildcited by 23
- 2022Shape Preserving Facial Landmarks with Graph Attention Networkscited by 23
- 2023Zero-shot Model Diagnosiscited by 23
- 2025Pixel3DMM: Versatile Screen-Space Priors for Single-Image 3D Face Reconstructioncited by 20
- 2024RTMW: Real-Time Multi-Person 2D and 3D Whole-body Pose Estimationcited by 19
- 2021Fast Facial Landmark Detection and Applications: A Surveycited by 18
- 2022DuetFace: Collaborative Privacy-Preserving Face Recognition via Channel Splitting in the Frequency Domaincited by 18
- 2021Inverting Generative Adversarial Renderer for Face Reconstructioncited by 17
- 2024Self-Supervised Facial Representation Learning with Facial Region Awarenesscited by 17
- 2021AGRNet: Adaptive Graph Representation Learning and Reasoning for Face Parsingcited by 16
- 2021Which images to label for few-shot medical landmark detection?cited by 16
- 2022Mask-FPAN: Semi-Supervised Face Parsing in the Wild With De-Occlusion and UV GANcited by 16
- 2023Precise Facial Landmark Detection by Reference Heatmap Transformercited by 16
- 2021HIH: Towards More Accurate Face Alignment via Heatmap in Heatmapcited by 15
- 2021Subpixel Heatmap Regression for Facial Landmark Localizationcited by 14
- 2022RePFormer: Refinement Pyramid Transformer for Robust Facial Landmark Detectioncited by 13
- 2023Reverse Knowledge Distillation: Training a Large Model using a Small One for Retinal Image Matching on Limited Datacited by 13
- 2024Faceptor: A Generalist Model for Face Perceptioncited by 13
- 2025FaceShot: Bring Any Character into Lifecited by 13
- 2025TokBench: Evaluating Your Visual Tokenizer before Visual Generationcited by 13
- 2023Open-Vocabulary Animal Keypoint Detection with Semantic-feature Matchingcited by 11
- 2021ASMNet: a Lightweight Deep Neural Network for Face Alignment and Pose Estimationcited by 10
- 2023Audio-Driven Dubbing for User Generated Contents via Style-Aware Semi-Parametric Synthesiscited by 10
50 most cited of 138 All 138 (JSON)
- 2026DIME: Scaling Facial Representation Learning via Differential Masked Autoencoding12 Oct 2026
- 2026FAHCD-Net: Frequency-Adaptive Heatmap-Conditional Diffusion Networks for Robust Facial Landmark Detection15 Sep 2026
- 2026FreqFLD: Towards All-in-One Facial Landmark Detection via Frequency Modulation9 Sep 2026
- 2026Towards Unified Dynamic Face Landmark Detection11 Aug 2026
- 2026Mirror-Fusion Attention for Reflection-Aware Self-Supervised Representation Learning1 Jul 2026
- 2026Sculpting NeRF Geometry: Human-Preference Fine-Tuning of a 3D-Aware Face GAN25 Jun 2026
- 2026NeoLoc-68: End-to-end 68-point neonatal facial landmark localisation in neonatal clinical environments18 Jun 2026
- 2026WorldComp2D: Spatio-semantic Representations of Object Identity and Location from Local Views12 May 2026
- 2026Auditing Demographic Bias in Facial Landmark Detection for Fair Human-Robot Interaction8 Apr 2026
- 2026OccFace: Unified Occlusion-Aware Facial Landmark Detection with Per-Point Visibility11 Feb 2026
- 2026Supervision-by-Hallucination-and-Transfer: A Weakly-Supervised Approach for Robust and Precise Facial Landmark Detection19 Jan 2026
- 2026FGTBT: Frequency-Guided Task-Balancing Transformer for Unified Facial Landmark Detection19 Jan 2026
38 more
- 2025Proto-Former: Unified Facial Landmark Detection by Prototype Transformer17 Oct 2025
- 2025Event-based Facial Keypoint Alignment via Cross-Modal Fusion Attention and Self-Supervised Multi-Event Representation Learning29 Sep 2025
- 2025Heatmap Regression without Soft-Argmax for Facial Landmark Detection19 Aug 2025
- 2025The Role of Radiographic Knee Alignment in Total Knee Replacement Outcomes and Opportunities for Artificial Intelligence-Driven Assessment13 Aug 2025
- 2025PaCo-FR: Patch-Pixel Aligned End-to-End Codebook Learning for Facial Representation Pre-training13 Aug 2025
- 2025KptLLM++: Towards Generic Keypoint Comprehension with Large Language Model15 Jul 2025
- 2025Learning an Ensemble Token from Task-driven Priors in Facial Analysis2 Jul 2025
- 2025OpenFace 3.0: A Lightweight Multitask System for Comprehensive Facial Behavior Analysis3 Jun 2025
- 2025TokBench: Evaluating Your Visual Tokenizer before Visual Generation23 May 2025
- 2025Semantic Style Transfer for Enhancing Animal Facial Landmark Detection8 May 2025
- 2025Pixel3DMM: Versatile Screen-Space Priors for Single-Image 3D Face Reconstruction1 May 2025
- 2025Kinship Verification through a Forest Neural Network26 Apr 2025
- 2025STSA: Spatial-Temporal Semantic Alignment for Visual Dubbing29 Mar 2025
- 2025Mitigating Knowledge Discrepancies among Multiple Datasets for Task-agnostic Unified Face Alignment28 Mar 2025
- 2025FaceShot: Bring Any Character into Life2 Mar 2025
- 20243D Face Reconstruction With Geometry Details From a Single Color Image Under Occluded Scenes25 Dec 2024
- 2024Generative Landmarks Guided Eyeglasses Removal 3D Face Reconstruction25 Dec 2024
- 2024SEREP: Semantic Facial Expression Representation for Robust In-the-Wild Capture and Retargeting18 Dec 2024
- 2024Spatio-Temporal Fuzzy-oriented Multi-Modal Meta-Learning for Fine-grained Emotion Recognition18 Dec 2024
- 2024FlexPose: Pose Distribution Adaptation with Limited Guidance18 Dec 2024
- 2024ORFormer: Occlusion-Robust Transformer for Accurate Facial Landmark Detection17 Dec 2024
- 2024Multi LoRA Meets Vision: Merging multiple adapters to create a multi task model21 Nov 2024
- 2024Cascaded Dual Vision Transformer for Accurate Facial Landmark Detection8 Nov 2024
- 2024KptLLM: Unveiling the Power of Large Language Model for Keypoint Comprehension4 Nov 2024
- 2024POPoS: Improving Efficient and Robust Facial Landmark Detection with Parallel Optimal Position Search12 Oct 2024
- 2024Efficient Facial Landmark Detection for Embedded Systems14 Jul 2024
- 2024RTMW: Real-Time Multi-Person 2D and 3D Whole-body Pose Estimation11 Jul 2024
- 2024On the power of data augmentation for head pose estimation7 Jul 2024
- 2024FaceLift: Semi-supervised 3D Facial Landmark Localization30 May 2024
- 2024MaSS: Multi-attribute Selective Suppression for Utility-preserving Data Transformation from an Information-theoretic Perspective23 May 2024
- 2024Generalizable Face Landmarking Guided by Conditional Face Warping18 Apr 2024
- 2024Rethinking Self-training for Semi-supervised Landmark Detection: A Selection-free Approach6 Apr 2024
- 2024KeyPoint Relative Position Encoding for Face Recognition21 Mar 2024
- 2024UP-FacE: User-predictable Fine-grained Face Shape Editing20 Mar 2024
- 2024FaceXFormer: A Unified Transformer for Facial Analysis19 Mar 2024
- 2024Faceptor: A Generalist Model for Face Perception14 Mar 2024
- 2024Self-Supervised Facial Representation Learning with Facial Region Awareness4 Mar 2024
- 2024Fiducial Focus Augmentation for Facial Landmark Detection23 Feb 2024
50 newest of 138 All 138 (JSON)
- 2023Reverse Knowledge Distillation: Training a Large Model using a Small One for Retinal Image Matching on Limited Datacited by 13
- 2021Facial Landmark Points Detection Using Knowledge Distillation-Based Neural Networkscited by 6
- 2023ProS: Facial Omni-Representation Learning via Prototype-based Self-Distillationcited by 3
- 2023ProS: Facial Omni-Representation Learning via Prototype-based Self-Distillation3 Nov 2023
- 2023Reverse Knowledge Distillation: Training a Large Model using a Small One for Retinal Image Matching on Limited Data20 Jul 2023
- 2021Facial Landmark Points Detection Using Knowledge Distillation-Based Neural Networks13 Nov 2021
- 2023Diffusion Model as Representation Learnercited by 95
- 2023Diffusion Model as Representation Learner21 Aug 2023
- 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 250
- 2021Fake It Till You Make It: Face analysis in the wild using synthetic data alonecited by 200
- 2022AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Timecited by 200
- 2021General Facial Representation Learning in a Visual-Linguistic Mannercited by 195
- 2021Audio-Driven Emotional Video Portraitscited by 180
- 2022Not All Tokens Are Equal: Human-centric Visual Analysis via Token Clustering Transformercited by 101
- 20223D face reconstruction with dense landmarkscited by 70
- 2022Sparse Local Patch Transformer for Robust Face Alignment and Landmarks Inherent Relation Learningcited by 47
- 2023RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatarscited by 45
- 2023STAR Loss: Reducing Semantic Ambiguity in Facial Landmark Detectioncited by 43
- 2023High-Fidelity and Freely Controllable Talking Head Video Generationcited by 42
- 2024KeyPoint Relative Position Encoding for Face Recognitioncited by 38
12 most cited of 132 All 132 (JSON)
- 2026DIME: Scaling Facial Representation Learning via Differential Masked Autoencoding12 Oct 2026
- 2026FAHCD-Net: Frequency-Adaptive Heatmap-Conditional Diffusion Networks for Robust Facial Landmark Detection15 Sep 2026
- 2026FreqFLD: Towards All-in-One Facial Landmark Detection via Frequency Modulation9 Sep 2026
- 2026Towards Unified Dynamic Face Landmark Detection11 Aug 2026
- 2026Mirror-Fusion Attention for Reflection-Aware Self-Supervised Representation Learning1 Jul 2026
- 2026Sculpting NeRF Geometry: Human-Preference Fine-Tuning of a 3D-Aware Face GAN25 Jun 2026
- 2026NeoLoc-68: End-to-end 68-point neonatal facial landmark localisation in neonatal clinical environments18 Jun 2026
- 2026WorldComp2D: Spatio-semantic Representations of Object Identity and Location from Local Views12 May 2026
- 2026Auditing Demographic Bias in Facial Landmark Detection for Fair Human-Robot Interaction8 Apr 2026
- 2026OccFace: Unified Occlusion-Aware Facial Landmark Detection with Per-Point Visibility11 Feb 2026
- 2026Supervision-by-Hallucination-and-Transfer: A Weakly-Supervised Approach for Robust and Precise Facial Landmark Detection19 Jan 2026
- 2026FGTBT: Frequency-Guided Task-Balancing Transformer for Unified Facial Landmark Detection19 Jan 2026
12 newest of 132 All 132 (JSON)