mlsanityData to 7 Oct 2026

Towards a Visual Privacy Advisor: Understanding and Predicting Privacy Risks in Images

arXiv 1703.10660 ↗First posted 30 Mar 2017cs.CV cs.CR cs.CYcited by 101

Not on the map. Why?

Abstract (arXiv)

With an increasing number of users sharing information online, privacy implications entailing such actions are a major concern. For explicit content, such as user profile or GPS data, devices (e.g. mobile phones) as well as web services (e.g. Facebook) offer to set privacy settings in order to enforce the users' privacy preferences. We propose the first approach that extends this concept to image content in the spirit of a Visual Privacy Advisor. First, we categorize personal information in images into 68 image attributes and collect a dataset, which allows us to train models that predict such information directly from images. Second, we run a user study to understand the privacy preferences of different users w.r.t. such attributes. Third, we propose models that predict user specific privacy score from images in order to enforce the users' privacy preferences. Our model is trained to predict the user specific privacy risk and even outperforms the judgment of the users, who often fail to follow their own privacy preferences on image data.

Key facts. Cited by 101 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Mar 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 12; 2022: 24; 2023: 17; 2024: 13; 2025: 22; 2026: 13.

101 papers.

Sort:

By area:

  1. 2021VisualGPT: Data-efficient Adaptation of Pretrained Language Models for Image Captioningcited by 190
  2. 2021From Show to Tell: A Survey on Deep Learning-based Image Captioningcited by 137
  3. 2021A Review of the Gumbel-max Trick and its Extensions for Discrete Stochasticity in Machine Learningcited by 82
  4. 2023Positive-Augmented Contrastive Learning for Image and Video Captioning Evaluationcited by 78
  5. 2023Rank2Tell: A Multimodal Driving Dataset for Joint Importance Ranking and Reasoningcited by 63
  6. 2022SPAct: Self-supervised Privacy Preservation for Action Recognitioncited by 47
  7. 2022Deep Learning Approaches on Image Captioning: A Reviewcited by 43
  8. 2021Generate, Prune, Select: A Pipeline for Counterspeech Generation against Online Hate Speechcited by 42
  9. 2021Human-like Controllable Image Captioning with Verb-specific Semantic Rolescited by 41
  10. 2023Image Shortcut Squeezing: Countering Perturbative Availability Poisons with Compressioncited by 39
  11. 2022Gradient Obfuscation Gives a False Sense of Security in Federated Learningcited by 37
  12. 2022Measuring Representational Harms in Image Captioningcited by 36
38 more
  1. 2021Probabilistic Modeling of Semantic Ambiguity for Scene Graph Generationcited by 35
  2. 2023HowToCaption: Prompting LLMs to Transform Video Annotations at Scalecited by 34
  3. 2023Multi-modal Machine Learning in Engineering Design: A Review and Future Directionscited by 27
  4. 2022VLTinT: Visual-Linguistic Transformer-in-Transformer for Coherent Video Paragraph Captioningcited by 25
  5. 2023Movie101: A New Movie Understanding Benchmarkcited by 25
  6. 2023TeD-SPAD: Temporal Distinctiveness for Self-supervised Privacy-preservation for video Anomaly Detectioncited by 23
  7. 2021Towards Diverse Paragraph Captioning for Untrimmed Videoscited by 22
  8. 2023IC3: Image Captioning by Committee Consensuscited by 20
  9. 2022VLCap: Vision-Language with Contrastive Learning for Coherent Video Paragraph Captioningcited by 19
  10. 2022Affection: Learning Affective Explanations for Real-World Visual Datacited by 19
  11. 2022PrivHAR: Recognizing Human Actions From Privacy-preserving Lenscited by 16
  12. 2022Privacy-Preserving Action Recognition via Motion Difference Quantizationcited by 14
  13. 2022Learning Distinct and Representative Styles for Image Captioningcited by 12
  14. 2024Privacy-Aware Visual Language Modelscited by 12
  15. 2022CapOnImage: Context-driven Dense-Captioning on Imagecited by 11
  16. 2023Simple Token-Level Confidence Improves Caption Correctnesscited by 11
  17. 2021Going Grayscale: The Road to Understanding and Improving Unlearnable Examplescited by 10
  18. 2022Show, Interpret and Tell: Entity-aware Contextualised Image Captioning in Wikipediacited by 10
  19. 2022Rethinking the Reference-based Distinctive Image Captioningcited by 8
  20. 2021Discriminative Latent Semantic Graph for Video Captioningcited by 7
  21. 2022On Distinctive Image Captioning via Comparing and Reweightingcited by 7
  22. 2022Distinctive Image Captioning via CLIP Guided Group Optimizationcited by 6
  23. 2023Modeling the Trade-off of Privacy Preservation and Activity Recognition on Low-Resolution Imagescited by 6
  24. 2023Free-ATM: Exploring Unsupervised Learning on Diffusion-Generated Images with Free Attention Maskscited by 6
  25. 2022MaSS: Multi-attribute Selective Suppressioncited by 5
  26. 2022CapEnrich: Enriching Caption Semantics for Web Images via Cross-modal Pre-trained Knowledgecited by 5
  27. 2022Contextual Explainable Video Representation: Human Perception-based Understandingcited by 5
  28. 2024BIV-Priv-Seg: Locating Private Content in Images Taken by People With Visual Impairmentscited by 5
  29. 2025REVAL: A Comprehension Evaluation on Reliability and Values of Large Vision-Language Modelscited by 5
  30. 2025Evaluation of Human Visual Privacy Protection: A Three-Dimensional Framework and Benchmark Datasetcited by 5
  31. 2022DRAG: Dynamic Region-Aware GCN for Privacy-Leaking Image Detectioncited by 4
  32. 2022Content-based Graph Privacy Advisorcited by 4
  33. 2023Improving Reference-based Distinctive Image Captioning with Contrastive Rewardscited by 4
  34. 2024Image-guided topic modeling for interpretable privacy classificationcited by 4
  35. 2024FG-CXR: A Radiologist-Aligned Gaze Dataset for Enhancing Interpretability in Chest X-Ray Report Generationcited by 4
  36. 2025EgoPrivacy: What Your First-Person Camera Says About You?cited by 4
  37. 2025Unveiling Trust in Multimodal Large Language Models: Evaluation, Analysis, and Mitigationcited by 4
  38. 2025Privy: Envisioning and Mitigating Privacy Risks for Consumer-facing AI Product Conceptscited by 4

50 most cited of 101 All 101 (JSON)