OccFace: Unified Occlusion-Aware Facial Landmark Detection with Per-Point Visibility
Not on the map. Why?
Abstract (arXiv)
Accurate facial landmark detection under occlusion remains challenging, especially for human-like faces with large appearance variation and rotation-driven self-occlusion. Existing detectors typically localize landmarks while handling occlusion implicitly, without predicting per-point visibility that downstream applications can benefits. We present OccFace, an occlusion-aware framework for universal human-like faces, including humans, stylized characters, and other non-human designs. OccFace adopts a unified dense 100-point layout and a heatmap-based backbone, and adds an occlusion module that jointly predicts landmark coordinates and per-point visibility by combining local evidence with cross-landmark context. Visibility supervision mixes manual labels with landmark-aware masking that derives pseudo visibility from mask-heatmap overlap. We also create an occlusion-aware evaluation suite reporting NME on visible vs. occluded landmarks and benchmarking visibility with Occ AP, [email protected], and ROC-AUC, together with a dataset annotated with 100-point landmarks and per-point visibility. Experiments show improved robustness under external occlusion and large head rotations, especially on occluded regions, while preserving accuracy on visible landmarks.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 23 of its 32 references that are in the map. First posted on arXiv 11 Feb 2026.
Builds on
23 of 32 references.
References · 23
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,623
- 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
- 2017Random Erasing Data Augmentationcited by 1,235
- 2016Stacked Hourglass Networks for Human Pose Estimationcited by 913
- 2022ViTPose: Simple Vision Transformer Baselines for Human Pose Estimationcited by 450
- 2018Look at Boundary: A Boundary-Aware Face Alignment Algorithmcited by 137
- 2019Adaptive Wing Loss for Robust Face Alignment via Heatmap Regressioncited by 127
- 2020GridMask Data Augmentationcited by 123
- 2020LUVLi Face Alignment: Estimating Landmarks' Location, Uncertainty, and Visibility Likelihoodcited by 87
- 2018Facial Landmark Detection: a Literature Surveycited by 63
- 2022Sparse Local Patch Transformer for Robust Face Alignment and Landmarks Inherent Relation Learningcited by 47
11 more
- 2023STAR Loss: Reducing Semantic Ambiguity in Facial Landmark Detectioncited by 41
- 2021ADNet: Leveraging Error-Bias Towards Normal Direction in Face Alignmentcited by 33
- 2024A Survey of AI-Generated Video Evaluationcited by 17
- 2021HIH: Towards More Accurate Face Alignment via Heatmap in Heatmapcited by 15
- 2020Landmark Detection and 3D Face Reconstruction for Caricature using a Nonlinear Parametric Modelcited by 13
- 2025AIGVE-Tool: AI-Generated Video Evaluation Toolkit with Multifaceted Benchmarkcited by 7
- 2023FusionViT: Hierarchical 3D Object Detection via LiDAR-Camera Vision Transformer Fusioncited by 5
- 20233DifFusionDet: Diffusion Model for 3D Object Detection with Robust LiDAR-Camera Fusioncited by 4
- 2018Facial Landmark Detection for Manga Imagescited by 2
- 2025Are AI-Generated Driving Videos Ready for Autonomous Driving? A Diagnostic Evaluation Frameworkcited by 2
- 2024ORFormer: Occlusion-Robust Transformer for Accurate Facial Landmark Detectioncited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.