Privacy-Preserving Portrait Matting
Not on the map. Why?
Abstract (arXiv)
Recently, there has been an increasing concern about the privacy issue raised by using personally identifiable information in machine learning. However, previous portrait matting methods were all based on identifiable portrait images. To fill the gap, we present P3M-10k in this paper, which is the first large-scale anonymized benchmark for Privacy-Preserving Portrait Matting. P3M-10k consists of 10,000 high-resolution face-blurred portrait images along with high-quality alpha mattes. We systematically evaluate both trimap-free and trimap-based matting methods on P3M-10k and find that existing matting methods show different generalization capabilities when following the Privacy-Preserving Training (PPT) setting, i.e., training on face-blurred images and testing on arbitrary images. To devise a better trimap-free portrait matting model, we propose P3M-Net, which leverages the power of a unified framework for both semantic perception and detail matting, and specifically emphasizes the interaction between them and the encoder to facilitate the matting process. Extensive experiments on P3M-10k demonstrate that P3M-Net outperforms the state-of-the-art methods in terms of both objective metrics and subjective visual quality. Besides, it shows good generalization capacity under the PPT setting, confirming the value of P3M-10k for facilitating future research and enabling potential real-world applications. The source code and dataset are available at https://github.com/JizhiziLi/P3M
Key facts. Cited by 60 papers in the map (data through 14 Oct 2026). Builds on 27 of its 48 references that are in the map. First posted on arXiv 29 Apr 2021.
Builds on
27 of 48 references.
References · 27
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2016Deep Learning with Differential Privacycited by 2,728
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
- 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
- 2018The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networkscited by 864
- 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 525
- 2018Deep Face Recognition: A Surveycited by 276
- 2020Auditing Differentially Private Machine Learning: How Private is Private SGD?cited by 218
- 2020Real-Time High-Resolution Background Mattingcited by 173
- 2020Empowering Things with Intelligence: A Survey of the Progress, Challenges, and Opportunities in Artificial Intelligence of Thingscited by 111
15 more
- 2020Background Matting: The World is Your Green Screencited by 105
- 2019Indices Matter: Learning to Index for Deep Image Mattingcited by 93
- 2020Mask Guided Matting via Progressive Refinement Networkcited by 84
- 2021A Study of Face Obfuscation in ImageNetcited by 83
- 2019Context-Aware Image Matting for Simultaneous Foreground and Alpha Estimationcited by 79
- 2020Natural Image Matting via Guided Contextual Attentioncited by 78
- 2019Membership Inference Attacks on Sequence-to-Sequence Models: Is My Data In Your Machine Translation System?cited by 71
- 2018Semantic Human Mattingcited by 67
- 2017Information-Flow Mattingcited by 59
- 2018AlphaGAN: Generative adversarial networks for natural image mattingcited by 50
- 2020F, B, Alpha Mattingcited by 50
- 2020Boosting Semantic Human Matting with Coarse Annotationscited by 48
- 2020Towards High Performance Human Keypoint Detectioncited by 20
- 2019Privacy Protection in Street-View Panoramas using Depth and Multi-View Imagerycited by 18
- 2017Privacy-Preserving Visual Learning Using Doubly Permuted Homomorphic Encryptioncited by 14
Built on by
Citing papers per year: 2021: 2; 2022: 5; 2023: 12; 2024: 19; 2025: 9; 2026: 13.
60 papers.
Sort:
By area:
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
- 2024What Matters When Repurposing Diffusion Models for General Dense Perception Tasks?cited by 74
- 2021Making Images Real Again: A Comprehensive Survey on Deep Image Compositioncited by 63
- 2021Deep Automatic Natural Image Mattingcited by 59
- 2023Matte Anything: Interactive Natural Image Matting with Segment Anything Modelscited by 39
- 2025DICEPTION: A Generalist Diffusion Model for Visual Perceptual Taskscited by 39
- 2024Generative Omnimatte: Learning to Decompose Video into Layerscited by 38
- 2022Rethinking Portrait Matting with Privacy Preservingcited by 25
- 2022Referring Image Mattingcited by 22
- 2024MaGGIe: Masked Guided Gradual Human Instance Mattingcited by 18
- 2023Ethical Considerations for Responsible Data Curationcited by 17
- 2024ZIM: Zero-Shot Image Matting for Anythingcited by 16
38 more
- 2024DiffuMatting: Synthesizing Arbitrary Objects with Matting-level Annotationcited by 13
- 2024Matting by Generationcited by 13
- 2022Robust Human Matting via Semantic Guidancecited by 12
- 2023Deep Image Matting: A Comprehensive Surveycited by 12
- 2023Does Image Anonymization Impact Computer Vision Training?cited by 12
- 2025DAViD: Data-efficient and Accurate Vision Models from Synthetic Datacited by 11
- 2025AlphaVAE: Unified End-to-End RGBA Image Reconstruction and Generation with Alpha-Aware Representation Learningcited by 8
- 2025MatAnyone 2: Scaling Video Matting via a Learned Quality Evaluatorcited by 7
- 2022Exposure Correction Model to Enhance Image Qualitycited by 6
- 2023Revisiting Context Aggregation for Image Mattingcited by 5
- 2024WheelPose: Data Synthesis Techniques to Improve Pose Estimation Performance on Wheelchair Userscited by 5
- 2024FiffDepth: Feed-forward Transformation of Diffusion-Based Generators for Detailed Depth Estimationcited by 5
- 2025Edit2Perceive: Image Editing Diffusion Models Are Strong Dense Perceiverscited by 5
- 2026THFM: A Unified Video Foundation Model for 4D Human Perception and Beyondcited by 5
- 2023Adversarially-Guided Portrait Mattingcited by 4
- 2023dugMatting: Decomposed-Uncertainty-Guided Mattingcited by 4
- 2023Lightweight Portrait Matting via Regional Attention and Refinementcited by 4
- 2024End-to-End Human Instance Mattingcited by 4
- 2024Training Matting Models without Alpha Labelscited by 4
- 2025SDMatte: Grafting Diffusion Models for Interactive Mattingcited by 4
- 2025Your Latent Mask is Wrong: Pixel-Equivalent Latent Compositing for Diffusion Modelscited by 4
- 2026VideoMaMa: Mask-Guided Video Matting via Generative Priorcited by 4
- 2024In-Context Mattingcited by 3
- 2024Learning Trimaps via Clicks for Image Mattingcited by 3
- 2024Towards Label-Efficient Human Matting: A Simple Baseline for Weakly Semi-Supervised Trimap-Free Human Mattingcited by 3
- 2024Towards Natural Image Matting in the Wild via Real-Scenario Priorcited by 3
- 2025Generative Video Mattingcited by 3
- 2026CineMatte: Background Matting for Virtual Production and Beyondcited by 3
- 2023OmniForce: On Human-Centered, Large Model Empowered and Cloud-Edge Collaborative AutoML Systemcited by 2
- 2023DiffusionMat: Alpha Matting as Sequential Refinement Learningcited by 2
- 2024DFIMat: Decoupled Flexible Interactive Matting in Multi-Person Scenarioscited by 2
- 2026Guardians of the Hair: Rescuing Soft Boundaries in Depth, Stereo, and Novel Viewscited by 2
- 2022SGM-Net: Semantic Guided Matting Netcited by 1
- 2023Color-aware Deep Temporal Backdrop Duplex Matting Systemcited by 1
- 2026From RGB Generation to Dense Field Readout: Pixel-Space Dense Prediction with Text-to-Image Modelscited by 1
- 2023EasyPortrait -- Face Parsing and Portrait Segmentation Datasetcited by 0
- 2024Dual-Context Aggregation for Universal Image Mattingcited by 0
- 2024Learning Multiple Representations with Inconsistency-Guided Detail Regularization for Mask-Guided Mattingcited by 0
50 most cited of 60 All 60 (JSON)
- 2026An Evaluation Framework for Generating Multi-View Images of a Person in a Scene4 Sep 2026
- 2026RenderMatte: Exact-Alpha Rendering and Group-Relative Alignment for Image Matting9 Aug 2026
- 2026Parallax Portrait Matting13 Jul 2026
- 2026Self-supervised Automatic Matting11 Jul 2026
- 2026From RGB Generation to Dense Field Readout: Pixel-Space Dense Prediction with Text-to-Image Models7 Jul 2026
- 2026SAM2Matting: Generalized Image and Video Matting25 Jun 2026
- 2026αDepth: Learning Single-Pass Soft Boundary Decomposition for Stereo Conversion29 May 2026
- 2026CineMatte: Background Matting for Virtual Production and Beyond18 May 2026
- 2026THFM: A Unified Video Foundation Model for 4D Human Perception and Beyond26 Mar 2026
- 2026VideoMaMa: Mask-Guided Video Matting via Generative Prior20 Jan 2026
- 2026Segment and Matte Anything in a Unified Model17 Jan 2026
- 2026Toward Real-World High-Precision Image Matting and Segmentation17 Jan 2026
38 more
- 2026Guardians of the Hair: Rescuing Soft Boundaries in Depth, Stereo, and Novel Views6 Jan 2026
- 2025MatAnyone 2: Scaling Video Matting via a Learned Quality Evaluator12 Dec 2025
- 2025D3-Predictor: Noise-Free Deterministic Diffusion for Dense Prediction8 Dec 2025
- 2025Your Latent Mask is Wrong: Pixel-Equivalent Latent Compositing for Diffusion Models4 Dec 2025
- 2025Edit2Perceive: Image Editing Diffusion Models Are Strong Dense Perceivers24 Nov 2025
- 2025Generative Video Matting11 Aug 2025
- 2025SDMatte: Grafting Diffusion Models for Interactive Matting1 Aug 2025
- 2025DAViD: Data-efficient and Accurate Vision Models from Synthetic Data21 Jul 2025
- 2025AlphaVAE: Unified End-to-End RGBA Image Reconstruction and Generation with Alpha-Aware Representation Learning12 Jul 2025
- 2025DICEPTION: A Generalist Diffusion Model for Visual Perceptual Tasks24 Feb 2025
- 2024UNet--: Memory-Efficient and Feature-Enhanced Network Architecture based on U-Net with Reduced Skip-Connections24 Dec 2024
- 2024FiffDepth: Feed-forward Transformation of Diffusion-Based Generators for Detailed Depth Estimation1 Dec 2024
- 2024Generative Omnimatte: Learning to Decompose Video into Layers25 Nov 2024
- 2024ZIM: Zero-Shot Image Matting for Anything1 Nov 2024
- 2024DFIMat: Decoupled Flexible Interactive Matting in Multi-Person Scenarios13 Oct 2024
- 2024Towards Natural Image Matting in the Wild via Real-Scenario Prior9 Oct 2024
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Second2 Oct 2024
- 2024Training Matting Models without Alpha Labels20 Aug 2024
- 2024Matting by Generation30 Jul 2024
- 2024WheelPose: Data Synthesis Techniques to Improve Pose Estimation Performance on Wheelchair Users25 Apr 2024
- 2024MaGGIe: Masked Guided Gradual Human Instance Matting24 Apr 2024
- 2024Towards Label-Efficient Human Matting: A Simple Baseline for Weakly Semi-Supervised Trimap-Free Human Matting1 Apr 2024
- 2024Learning Trimaps via Clicks for Image Matting30 Mar 2024
- 2024Learning Multiple Representations with Inconsistency-Guided Detail Regularization for Mask-Guided Matting28 Mar 2024
- 2024In-Context Matting23 Mar 2024
- 2024DiffuMatting: Synthesizing Arbitrary Objects with Matting-level Annotation10 Mar 2024
- 2024What Matters When Repurposing Diffusion Models for General Dense Perception Tasks?10 Mar 2024
- 2024End-to-End Human Instance Matting3 Mar 2024
- 2024Dual-Context Aggregation for Universal Image Matting28 Feb 2024
- 2023DiffusionMat: Alpha Matting as Sequential Refinement Learning22 Nov 2023
- 2023Lightweight Portrait Matting via Regional Attention and Refinement7 Nov 2023
- 2023Does Image Anonymization Impact Computer Vision Training?8 Jun 2023
- 2023Matte Anything: Interactive Natural Image Matting with Segment Anything Models7 Jun 2023
- 2023Color-aware Deep Temporal Backdrop Duplex Matting System5 Jun 2023
- 2023dugMatting: Decomposed-Uncertainty-Guided Matting2 Jun 2023
- 2023Adversarially-Guided Portrait Matting4 May 2023
- 2023EasyPortrait -- Face Parsing and Portrait Segmentation Dataset26 Apr 2023
- 2023Deep Image Matting: A Comprehensive Survey10 Apr 2023
50 newest of 60 All 60 (JSON)
- 2024What Matters When Repurposing Diffusion Models for General Dense Perception Tasks?cited by 74
- 2025DICEPTION: A Generalist Diffusion Model for Visual Perceptual Taskscited by 39
- 2025AlphaVAE: Unified End-to-End RGBA Image Reconstruction and Generation with Alpha-Aware Representation Learningcited by 8
- 2024FiffDepth: Feed-forward Transformation of Diffusion-Based Generators for Detailed Depth Estimationcited by 5
- 2025Edit2Perceive: Image Editing Diffusion Models Are Strong Dense Perceiverscited by 5
- 2026THFM: A Unified Video Foundation Model for 4D Human Perception and Beyondcited by 5
- 2025SDMatte: Grafting Diffusion Models for Interactive Mattingcited by 4
- 2025Your Latent Mask is Wrong: Pixel-Equivalent Latent Compositing for Diffusion Modelscited by 4
- 2023DiffusionMat: Alpha Matting as Sequential Refinement Learningcited by 2
- 2025D3-Predictor: Noise-Free Deterministic Diffusion for Dense Predictioncited by 0
- 2026An Evaluation Framework for Generating Multi-View Images of a Person in a Scenecited by 0
- 2026An Evaluation Framework for Generating Multi-View Images of a Person in a Scene4 Sep 2026
- 2026THFM: A Unified Video Foundation Model for 4D Human Perception and Beyond26 Mar 2026
- 2025D3-Predictor: Noise-Free Deterministic Diffusion for Dense Prediction8 Dec 2025
- 2025Your Latent Mask is Wrong: Pixel-Equivalent Latent Compositing for Diffusion Models4 Dec 2025
- 2025Edit2Perceive: Image Editing Diffusion Models Are Strong Dense Perceivers24 Nov 2025
- 2025SDMatte: Grafting Diffusion Models for Interactive Matting1 Aug 2025
- 2025AlphaVAE: Unified End-to-End RGBA Image Reconstruction and Generation with Alpha-Aware Representation Learning12 Jul 2025
- 2025DICEPTION: A Generalist Diffusion Model for Visual Perceptual Tasks24 Feb 2025
- 2024FiffDepth: Feed-forward Transformation of Diffusion-Based Generators for Detailed Depth Estimation1 Dec 2024
- 2024What Matters When Repurposing Diffusion Models for General Dense Perception Tasks?10 Mar 2024
- 2023DiffusionMat: Alpha Matting as Sequential Refinement Learning22 Nov 2023
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
- 2021Making Images Real Again: A Comprehensive Survey on Deep Image Compositioncited by 63
- 2021Deep Automatic Natural Image Mattingcited by 59
- 2023Matte Anything: Interactive Natural Image Matting with Segment Anything Modelscited by 39
- 2024Generative Omnimatte: Learning to Decompose Video into Layerscited by 38
- 2022Rethinking Portrait Matting with Privacy Preservingcited by 25
- 2022Referring Image Mattingcited by 22
- 2024MaGGIe: Masked Guided Gradual Human Instance Mattingcited by 18
- 2023Ethical Considerations for Responsible Data Curationcited by 17
- 2024ZIM: Zero-Shot Image Matting for Anythingcited by 16
- 2024DiffuMatting: Synthesizing Arbitrary Objects with Matting-level Annotationcited by 13
- 2024Matting by Generationcited by 13
12 most cited of 49 All 49 (JSON)
- 2026RenderMatte: Exact-Alpha Rendering and Group-Relative Alignment for Image Matting9 Aug 2026
- 2026Parallax Portrait Matting13 Jul 2026
- 2026Self-supervised Automatic Matting11 Jul 2026
- 2026From RGB Generation to Dense Field Readout: Pixel-Space Dense Prediction with Text-to-Image Models7 Jul 2026
- 2026SAM2Matting: Generalized Image and Video Matting25 Jun 2026
- 2026αDepth: Learning Single-Pass Soft Boundary Decomposition for Stereo Conversion29 May 2026
- 2026CineMatte: Background Matting for Virtual Production and Beyond18 May 2026
- 2026VideoMaMa: Mask-Guided Video Matting via Generative Prior20 Jan 2026
- 2026Segment and Matte Anything in a Unified Model17 Jan 2026
- 2026Toward Real-World High-Precision Image Matting and Segmentation17 Jan 2026
- 2026Guardians of the Hair: Rescuing Soft Boundaries in Depth, Stereo, and Novel Views6 Jan 2026
- 2025MatAnyone 2: Scaling Video Matting via a Learned Quality Evaluator12 Dec 2025
12 newest of 49 All 49 (JSON)