Connecting Pixels to Privacy and Utility: Automatic Redaction of Private Information in Images
Not on the map. Why?
Abstract (arXiv)
Images convey a broad spectrum of personal information. If such images are shared on social media platforms, this personal information is leaked which conflicts with the privacy of depicted persons. Therefore, we aim for automated approaches to redact such private information and thereby protect privacy of the individual. By conducting a user study we find that obfuscating the image regions related to the private information leads to privacy while retaining utility of the images. Moreover, by varying the size of the regions different privacy-utility trade-offs can be achieved. Our findings argue for a "redaction by segmentation" paradigm. Hence, we propose the first sizable dataset of private images "in the wild" annotated with pixel and instance level labels across a broad range of privacy classes. We present the first model for automatic redaction of diverse private information.
Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Dec 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 3; 2023: 3; 2024: 4; 2025: 5; 2026: 6.
24 papers.
Sort:
By area:
- 2021A Study of Face Obfuscation in ImageNetcited by 83
- 2022Evaluation Gaps in Machine Learning Practicecited by 48
- 2023Ethical Considerations for Responsible Data Curationcited by 17
- 2024Resampled Datasets Are Not Enough: Mitigating Societal Bias Beyond Single Attributescited by 7
- 2023Modeling the Trade-off of Privacy Preservation and Activity Recognition on Low-Resolution Imagescited by 6
- 2024BIV-Priv-Seg: Locating Private Content in Images Taken by People With Visual Impairmentscited by 5
- 2022Privacy of Autonomous Vehicles: Risks, Protection Methods, and Future Directionscited by 4
- 2024Privacy-preserving Optics for Enhancing Protection in Face De-identificationcited by 4
- 2022GMFIM: A Generative Mask-guided Facial Image Manipulation Model for Privacy Preservationcited by 2
- 2023On Responsible Machine Learning Datasets with Fairness, Privacy, and Regulatory Normscited by 2
- 2025Who Can See Through You? Adversarial Shielding Against VLM-Based Attribute Inference Attackscited by 2
- 2021Privacy-preserving Object Detectioncited by 1
12 more
- 2024Facial Expression Recognition with Controlled Privacy Preservation and Feature Compensationcited by 1
- 2025Privacy-Preserving Semantic Segmentation from Ultra-Low-Resolution RGB Inputscited by 1
- 2025Through Their Eyes: User Perceptions on Sensitive Attribute Inference of Social Media Videos by Visual Language Modelscited by 1
- 2025When Privacy Meets Recovery: The Overlooked Half of Surrogate-Driven Privacy Preservation for MLLM Editingcited by 1
- 2026Towards Context-Aware Image Anonymization with Multi-Agent Reasoningcited by 1
- 2026Vision Language Model Helps Private Information De-Identification in Vision Datacited by 1
- 2021Deep Learning Approach Protecting Privacy in Camera-Based Critical Applicationscited by 0
- 2025From See to Shield: ML-Assisted Fine-Grained Access Control for Visual Datacited by 0
- 2026When Recovery Matters: The Blind Spot of Surrogate Privacy in MLLM Editingcited by 0
- 2026CAPED: Context-Aware Privacy Exposure Defense for Mobile GUI Agentscited by 0
- 2026PriMobiBench: Characterizing Visual Privacy Leakage in VLM-Driven Mobile GUI Agentscited by 0
- 2026Privacy-Preserving Semantic Segmentation from High-Resolution Depth and Ultra-Low-Resolution RGBcited by 0
- 2026Privacy-Preserving Semantic Segmentation from High-Resolution Depth and Ultra-Low-Resolution RGB23 Sep 2026
- 2026PriMobiBench: Characterizing Visual Privacy Leakage in VLM-Driven Mobile GUI Agents12 Sep 2026
- 2026CAPED: Context-Aware Privacy Exposure Defense for Mobile GUI Agents10 Jun 2026
- 2026Vision Language Model Helps Private Information De-Identification in Vision Data8 Jun 2026
- 2026When Recovery Matters: The Blind Spot of Surrogate Privacy in MLLM Editing5 Jun 2026
- 2026Towards Context-Aware Image Anonymization with Multi-Agent Reasoning29 Mar 2026
- 2025Who Can See Through You? Adversarial Shielding Against VLM-Based Attribute Inference Attacks20 Dec 2025
- 2025When Privacy Meets Recovery: The Overlooked Half of Surrogate-Driven Privacy Preservation for MLLM Editing8 Dec 2025
- 2025From See to Shield: ML-Assisted Fine-Grained Access Control for Visual Data22 Oct 2025
- 2025Through Their Eyes: User Perceptions on Sensitive Attribute Inference of Social Media Videos by Visual Language Models11 Aug 2025
- 2025Privacy-Preserving Semantic Segmentation from Ultra-Low-Resolution RGB Inputs21 Jul 2025
- 2024Facial Expression Recognition with Controlled Privacy Preservation and Feature Compensation29 Nov 2024
12 more
- 2024BIV-Priv-Seg: Locating Private Content in Images Taken by People With Visual Impairments25 Jul 2024
- 2024Resampled Datasets Are Not Enough: Mitigating Societal Bias Beyond Single Attributes4 Jul 2024
- 2024Privacy-preserving Optics for Enhancing Protection in Face De-identification31 Mar 2024
- 2023On Responsible Machine Learning Datasets with Fairness, Privacy, and Regulatory Norms24 Oct 2023
- 2023Modeling the Trade-off of Privacy Preservation and Activity Recognition on Low-Resolution Images18 Mar 2023
- 2023Ethical Considerations for Responsible Data Curation7 Feb 2023
- 2022Privacy of Autonomous Vehicles: Risks, Protection Methods, and Future Directions8 Sep 2022
- 2022Evaluation Gaps in Machine Learning Practice11 May 2022
- 2022GMFIM: A Generative Mask-guided Facial Image Manipulation Model for Privacy Preservation10 Jan 2022
- 2021Deep Learning Approach Protecting Privacy in Camera-Based Critical Applications4 Oct 2021
- 2021Privacy-preserving Object Detection11 Mar 2021
- 2021A Study of Face Obfuscation in ImageNet10 Mar 2021
- 2025Who Can See Through You? Adversarial Shielding Against VLM-Based Attribute Inference Attackscited by 2
- 2025Through Their Eyes: User Perceptions on Sensitive Attribute Inference of Social Media Videos by Visual Language Modelscited by 1
- 2026Vision Language Model Helps Private Information De-Identification in Vision Datacited by 1
- 2026When Recovery Matters: The Blind Spot of Surrogate Privacy in MLLM Editingcited by 0
- 2026Vision Language Model Helps Private Information De-Identification in Vision Data8 Jun 2026
- 2026When Recovery Matters: The Blind Spot of Surrogate Privacy in MLLM Editing5 Jun 2026
- 2025Who Can See Through You? Adversarial Shielding Against VLM-Based Attribute Inference Attacks20 Dec 2025
- 2025Through Their Eyes: User Perceptions on Sensitive Attribute Inference of Social Media Videos by Visual Language Models11 Aug 2025
- 2021A Study of Face Obfuscation in ImageNetcited by 83
- 2022Evaluation Gaps in Machine Learning Practicecited by 48
- 2023Ethical Considerations for Responsible Data Curationcited by 17
- 2024Resampled Datasets Are Not Enough: Mitigating Societal Bias Beyond Single Attributescited by 7
- 2023Modeling the Trade-off of Privacy Preservation and Activity Recognition on Low-Resolution Imagescited by 6
- 2024BIV-Priv-Seg: Locating Private Content in Images Taken by People With Visual Impairmentscited by 5
- 2022Privacy of Autonomous Vehicles: Risks, Protection Methods, and Future Directionscited by 4
- 2024Privacy-preserving Optics for Enhancing Protection in Face De-identificationcited by 4
- 2022GMFIM: A Generative Mask-guided Facial Image Manipulation Model for Privacy Preservationcited by 2
- 2023On Responsible Machine Learning Datasets with Fairness, Privacy, and Regulatory Normscited by 2
- 2021Privacy-preserving Object Detectioncited by 1
- 2024Facial Expression Recognition with Controlled Privacy Preservation and Feature Compensationcited by 1
12 most cited of 19 All 19 (JSON)
- 2026Privacy-Preserving Semantic Segmentation from High-Resolution Depth and Ultra-Low-Resolution RGB23 Sep 2026
- 2026CAPED: Context-Aware Privacy Exposure Defense for Mobile GUI Agents10 Jun 2026
- 2026Towards Context-Aware Image Anonymization with Multi-Agent Reasoning29 Mar 2026
- 2025When Privacy Meets Recovery: The Overlooked Half of Surrogate-Driven Privacy Preservation for MLLM Editing8 Dec 2025
- 2025From See to Shield: ML-Assisted Fine-Grained Access Control for Visual Data22 Oct 2025
- 2025Privacy-Preserving Semantic Segmentation from Ultra-Low-Resolution RGB Inputs21 Jul 2025
- 2024Facial Expression Recognition with Controlled Privacy Preservation and Feature Compensation29 Nov 2024
- 2024BIV-Priv-Seg: Locating Private Content in Images Taken by People With Visual Impairments25 Jul 2024
- 2024Resampled Datasets Are Not Enough: Mitigating Societal Bias Beyond Single Attributes4 Jul 2024
- 2024Privacy-preserving Optics for Enhancing Protection in Face De-identification31 Mar 2024
- 2023On Responsible Machine Learning Datasets with Fairness, Privacy, and Regulatory Norms24 Oct 2023
- 2023Modeling the Trade-off of Privacy Preservation and Activity Recognition on Low-Resolution Images18 Mar 2023
12 newest of 19 All 19 (JSON)