Mask-FPAN: Semi-Supervised Face Parsing in the Wild With De-Occlusion and UV GAN
Not on the map. Why?
Abstract (arXiv)
Fine-grained semantic segmentation of a person's face and head, including facial parts and head components, has progressed a great deal in recent years. However, it remains a challenging task, whereby considering ambiguous occlusions and large pose variations are particularly difficult. To overcome these difficulties, we propose a novel framework termed Mask-FPAN. It uses a de-occlusion module that learns to parse occluded faces in a semi-supervised way. In particular, face landmark localization, face occlusionstimations, and detected head poses are taken into account. A 3D morphable face model combined with the UV GAN improves the robustness of 2D face parsing. In addition, we introduce two new datasets named FaceOccMask-HQ and CelebAMaskOcc-HQ for face paring work. The proposed Mask-FPAN framework addresses the face parsing problem in the wild and shows significant performance improvements with MIOU from 0.7353 to 0.9013 compared to the state-of-the-art on challenging face datasets.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 30 of its 48 references that are in the map. First posted on arXiv 18 Dec 2022.
Builds on
30 of 48 references.
References · 30
- 2017Mask R-CNNcited by 7,259
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
- 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,483
- 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
- 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 624
- 2018Image Inpainting for Irregular Holes Using Partial Convolutionscited by 505
- 2016ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentationcited by 291
- 2017ICNet for Real-Time Semantic Segmentation on High-Resolution Imagescited by 261
- 2017Fine-Grained Head Pose Estimation Without Keypointscited by 163
- 2018Look at Boundary: A Boundary-Aware Face Alignment Algorithmcited by 137
- 2019Adaptive Wing Loss for Robust Face Alignment via Heatmap Regressioncited by 127
18 more
- 2017Wing Loss for Robust Facial Landmark Localisation with Convolutional Neural Networkscited by 108
- 2019TensorMask: A Foundation for Dense Object Segmentationcited by 101
- 2017UV-GAN: Adversarial Facial UV Map Completion for Pose-invariant Face Recognitioncited by 62
- 2018Style Aggregated Network for Facial Landmark Detectioncited by 60
- 2017Not All Pixels Are Equal: Difficulty-aware Semantic Segmentation via Deep Layer Cascadecited by 53
- 2018Supervision-by-Registration: An Unsupervised Approach to Improve the Precision of Facial Landmark Detectorscited by 49
- 2022Sparse Local Patch Transformer for Robust Face Alignment and Landmarks Inherent Relation Learningcited by 47
- 2019Face Parsing with RoI Tanh-Warpingcited by 33
- 2022RTFormer: Efficient Design for Real-Time Semantic Segmentation with Transformercited by 31
- 2019PFLD: A Practical Facial Landmark Detectorcited by 25
- 2016Robust LSTM-Autoencoders for Face De-Occlusion in the Wildcited by 17
- 2018Interlinked Convolutional Neural Networks for Face Parsingcited by 16
- 2021AGRNet: Adaptive Graph Representation Learning and Reasoning for Face Parsingcited by 15
- 2017Face Parsing via Recurrent Propagationcited by 14
- 2016Real-Time Facial Segmentation and Performance Capture from RGB Inputcited by 13
- 2016A CNN Cascade for Landmark Guided Semantic Part Segmentationcited by 12
- 2021Deep Learning Based 3D Point Cloud Regression for Estimating Forest Biomasscited by 11
- 2021LOTR: Face Landmark Localization Using Localization Transformercited by 6
Built on by
Citing papers per year: 2023: 4; 2024: 9; 2025: 2; 2026: 1.
16 papers.
Sort:
By area:
- 2024ConsistentID: Portrait Generation with Multimodal Fine-Grained Identity Preservingcited by 42
- 2024Human Motion Instruction Tuningcited by 29
- 2023CPSeg: Finer-grained Image Semantic Segmentation via Chain-of-Thought Language Promptingcited by 28
- 2024Credit Card Fraud Detection Using Advanced Transformer Modelcited by 26
- 2024Rumor Detection with a novel graph neural network approachcited by 14
- 2024CAS-ViT: Convolutional Additive Self-attention Vision Transformers for Efficient Mobile Applicationscited by 12
- 2026RAM: Recover Any 3D Human Motion in-the-Wildcited by 11
- 2023Segment Any Buildingcited by 8
- 2025Wav2Sem: Plug-and-Play Audio Semantic Decoupling for 3D Speech-Driven Facial Animationcited by 8
- 2024You Only Speak Once to Seecited by 4
- 2023Edge Aware Learning for 3D Point Cloudcited by 3
- 2024Tree Counting by Bridging 3D Point Clouds with Imagerycited by 1
4 more
- 2024End-To-End Training and Testing Gamification Framework to Learn Human Highway Drivingcited by 1
- 2025CNSocialDepress: A Chinese Social Media Dataset for Depression Risk Detection and Structured Analysiscited by 1
- 2023Occlusion-Aware Deep Convolutional Neural Network via Homogeneous Tanh-transforms for Face Parsingcited by 0
- 2024MedFLIP: Medical Vision-and-Language Self-supervised Fast Pre-Training with Masked Autoencodercited by 0
- 2026RAM: Recover Any 3D Human Motion in-the-Wild20 Mar 2026
- 2025CNSocialDepress: A Chinese Social Media Dataset for Depression Risk Detection and Structured Analysis13 Oct 2025
- 2025Wav2Sem: Plug-and-Play Audio Semantic Decoupling for 3D Speech-Driven Facial Animation29 May 2025
- 2024Human Motion Instruction Tuning25 Nov 2024
- 2024You Only Speak Once to See27 Sep 2024
- 2024CAS-ViT: Convolutional Additive Self-attention Vision Transformers for Efficient Mobile Applications7 Aug 2024
- 2024Credit Card Fraud Detection Using Advanced Transformer Model6 Jun 2024
- 2024ConsistentID: Portrait Generation with Multimodal Fine-Grained Identity Preserving25 Apr 2024
- 2024End-To-End Training and Testing Gamification Framework to Learn Human Highway Driving16 Apr 2024
- 2024Rumor Detection with a novel graph neural network approach24 Mar 2024
- 2024MedFLIP: Medical Vision-and-Language Self-supervised Fast Pre-Training with Masked Autoencoder7 Mar 2024
- 2024Tree Counting by Bridging 3D Point Clouds with Imagery4 Mar 2024
4 more
- 2023CPSeg: Finer-grained Image Semantic Segmentation via Chain-of-Thought Language Prompting24 Oct 2023
- 2023Segment Any Building2 Oct 2023
- 2023Edge Aware Learning for 3D Point Cloud23 Sep 2023
- 2023Occlusion-Aware Deep Convolutional Neural Network via Homogeneous Tanh-transforms for Face Parsing29 Aug 2023
- 2024ConsistentID: Portrait Generation with Multimodal Fine-Grained Identity Preservingcited by 42
- 2024Human Motion Instruction Tuningcited by 29
- 2024Credit Card Fraud Detection Using Advanced Transformer Modelcited by 26
- 2024Rumor Detection with a novel graph neural network approachcited by 14
- 2024CAS-ViT: Convolutional Additive Self-attention Vision Transformers for Efficient Mobile Applicationscited by 12
- 2026RAM: Recover Any 3D Human Motion in-the-Wildcited by 11
- 2023Segment Any Buildingcited by 8
- 2025Wav2Sem: Plug-and-Play Audio Semantic Decoupling for 3D Speech-Driven Facial Animationcited by 8
- 2024You Only Speak Once to Seecited by 4
- 2023Edge Aware Learning for 3D Point Cloudcited by 3
- 2024Tree Counting by Bridging 3D Point Clouds with Imagerycited by 1
- 2025CNSocialDepress: A Chinese Social Media Dataset for Depression Risk Detection and Structured Analysiscited by 1
12 most cited of 14 All 14 (JSON)
- 2026RAM: Recover Any 3D Human Motion in-the-Wild20 Mar 2026
- 2025CNSocialDepress: A Chinese Social Media Dataset for Depression Risk Detection and Structured Analysis13 Oct 2025
- 2025Wav2Sem: Plug-and-Play Audio Semantic Decoupling for 3D Speech-Driven Facial Animation29 May 2025
- 2024Human Motion Instruction Tuning25 Nov 2024
- 2024You Only Speak Once to See27 Sep 2024
- 2024CAS-ViT: Convolutional Additive Self-attention Vision Transformers for Efficient Mobile Applications7 Aug 2024
- 2024Credit Card Fraud Detection Using Advanced Transformer Model6 Jun 2024
- 2024ConsistentID: Portrait Generation with Multimodal Fine-Grained Identity Preserving25 Apr 2024
- 2024Rumor Detection with a novel graph neural network approach24 Mar 2024
- 2024MedFLIP: Medical Vision-and-Language Self-supervised Fast Pre-Training with Masked Autoencoder7 Mar 2024
- 2024Tree Counting by Bridging 3D Point Clouds with Imagery4 Mar 2024
- 2023Segment Any Building2 Oct 2023
12 newest of 14 All 14 (JSON)