mlsanityData to 7 Oct 2026

VerA: Versatile Anonymization Applicable to Clinical Facial Photographs

arXiv 2312.02124 ↗First posted 4 Dec 2023cs.CV cs.GR cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

The demand for privacy in facial image dissemination is gaining ground internationally, echoed by the proliferation of regulations such as GDPR, DPDPA, CCPA, PIPL, and APPI. While recent advances in anonymization surpass pixelation or blur methods, additional constraints to the task pose challenges. Largely unaddressed by current anonymization methods are clinical images and pairs of before-and-after clinical images illustrating facial medical interventions, e.g., facial surgeries or dental procedures. We present VerA, the first Versatile Anonymization framework that solves two challenges in clinical applications: A) it preserves selected semantic areas (e.g., mouth region) to show medical intervention results, that is, anonymization is only applied to the areas outside the preserved area; and B) it produces anonymized images with consistent personal identity across multiple photographs, which is crucial for anonymizing photographs of the same person taken before and after a clinical intervention. We validate our results on both single and paired anonymization of clinical images through extensive quantitative and qualitative evaluation. We also demonstrate that VerA reaches the state of the art on established anonymization tasks, in terms of photorealism and de-identification.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 63 of its 85 references that are in the map. First posted on arXiv 4 Dec 2023.

Builds on

63 of 85 references.

References · 63

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  6. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  7. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  8. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  9. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  10. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  11. 2016HyperNetworkscited by 1,003
  12. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
38 more
  1. 2017VGGFace2: A dataset for recognising faces across pose and agecited by 911
  2. 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 895
  3. 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 691
  4. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
  5. 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 624
  6. 2020GANSpace: Discovering Interpretable GAN Controlscited by 612
  7. 2014Learning Face Representation from Scratchcited by 451
  8. 2020StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flowscited by 348
  9. 2021Towards Real-World Blind Face Restoration with Generative Facial Priorcited by 347
  10. 2019SEAN: Image Synthesis with Semantic Region-Adaptive Normalizationcited by 253
  11. 2021ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinementcited by 248
  12. 2022Towards Robust Blind Face Restoration with Codebook Lookup Transformercited by 230
  13. 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 216
  14. 2021HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editingcited by 208
  15. 2021High-Fidelity GAN Inversion for Image Attribute Editingcited by 197
  16. 2021General Facial Representation Learning in a Visual-Linguistic Mannercited by 193
  17. 2017Fine-Grained Head Pose Estimation Without Keypointscited by 163
  18. 2021Semantic Segmentation with Generative Models: Semi-Supervised Learning and Strong Out-of-Domain Generalizationcited by 141
  19. 2019DeepPrivacy: A Generative Adversarial Network for Face Anonymizationcited by 108
  20. 2022Understanding Contrastive Learning Requires Incorporating Inductive Biasescited by 96
  21. 2021GAN-Control: Explicitly Controllable GANscited by 91
  22. 2022Protecting Facial Privacy: Generating Adversarial Identity Masks via Style-robust Makeup Transfercited by 77
  23. 2021A Latent Transformer for Disentangled Face Editing in Images and Videoscited by 67
  24. 2018Learning to Anonymize Faces for Privacy Preserving Action Detectioncited by 63
  25. 20226D Rotation Representation For Unconstrained Head Pose Estimationcited by 63
  26. 2020Towards Face Encryption by Generating Adversarial Identity Maskscited by 62
  27. 2017Natural and Effective Obfuscation by Head Inpaintingcited by 60
  28. 2021SemanticStyleGAN: Learning Compositional Generative Priors for Controllable Image Synthesis and Editingcited by 58
  29. 2019Reconstructing continuous distributions of 3D protein structure from cryo-EM imagescited by 56
  30. 2022DeepPrivacy2: Towards Realistic Full-Body Anonymizationcited by 51
  31. 2019AnonymousNet: Natural Face De-Identification with Measurable Privacycited by 50
  32. 2019Live Face De-Identification in Videocited by 48
  33. 2018A Hybrid Model for Identity Obfuscation by Face Replacementcited by 43
  34. 2023Attribute-preserving Face Dataset Anonymization via Latent Code Optimizationcited by 43
  35. 2022Do More Negative Samples Necessarily Hurt in Contrastive Learning?cited by 39
  36. 2022Spatially-Adaptive Multilayer Selection for GAN Inversion and Editingcited by 39
  37. 2022Style Transformer for Image Inversion and Editingcited by 37
  38. 2022TransEditor: Transformer-Based Dual-Space GAN for Highly Controllable Facial Editingcited by 36

50 most cited of 63 All 63 (JSON)

Built on by

Not cited yet.