mlsanityData to 14 Oct 2026

What Your Posts Reveal: A Benchmark and Agentic Framework for User-Level Privacy Leakage on Social Media

arXiv 2606.06784 ↗First posted 5 Jun 2026cs.CR cs.AI cs.CYcited by 2

Not on the map. Why?

Abstract (arXiv)

Public social media posts can reveal private information through weak cues scattered across text, images, or metadata. Such leakage is often cumulative and cross-post: cues that appear harmless in isolation may jointly expose a user's home, workplace, or routine. However, current research lacks a unified benchmark for user-level multimodal privacy leakage and an evaluation metric that captures exposure severity beyond binary accuracy. To address these gaps, we propose SopriBench, a synthetic benchmark guided by leakage patterns abstracted from a private reference corpus of Rednote and Instagram accounts, covering 50 user profiles and 1,569 images with attributes, contextual sensitivity, granularity, leakage type, inference difficulty, and supporting evidence. We further introduce the Privacy Exposure Score (PES), which weights value granularity by contextual sensitivity. Inspired by abductive reasoning, we introduce Argus, a training-free agentic framework for cumulative leakage inference. Argus forms hypotheses from accumulated evidence, verifies supporting evidence, and aggregates cross-post cues into privacy profiles, achieving 0.55 PES, a 25% improvement over the strongest baseline, with the largest gain on cross-post leakage.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 24 of its 44 references that are in the map. First posted on arXiv 5 Jun 2026.

Builds on

24 of 44 references.

References · 24

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  4. 2020Google Landmarks Dataset v2 -- A Large-Scale Benchmark for Instance-Level Recognition and Retrievalcited by 309
  5. 2023Automated Annotation with Generative AI Requires Validationcited by 76
  6. 2026PaddleOCR-VL-1.5: Towards a Multi-Task 0.9B VLM for Robust In-the-Wild Document Parsingcited by 57
  7. 2024Private Attribute Inference from Images with Vision-Language Modelscited by 37
  8. 2024Measuring and Reducing LLM Hallucination without Gold-Standard Answerscited by 31
  9. 2025Recognition through Reasoning: Reinforcing Image Geo-localization with Large Vision-Language Modelscited by 28
  10. 2018Privacy in Social Media: Identification, Mitigation and Applicationscited by 19
  11. 2024Automatic Dataset Construction (ADC): Sample Collection, Data Curation, and Beyondcited by 18
  12. 2025Unsafe LLM-Based Search: Quantitative Analysis and Mitigation of Safety Risks in AI Web Searchcited by 16
12 more
  1. 2026Large-scale online deanonymization with LLMscited by 14
  2. 2025Automated Profile Inference with Language Model Agentscited by 9
  3. 2025The Eye of Sherlock Holmes: Uncovering User Private Attribute Profiling via Vision-Language Model Agentic Frameworkcited by 9
  4. 2025Auditing Data Membership in Reinforcement Learning With Verifiable Rewardscited by 8
  5. 2025Assessing Visual Privacy Risks in Multimodal AI: A Novel Taxonomy-Grounded Evaluation of Vision-Language Modelscited by 6
  6. 2025GasAgent: A Multi-Agent Framework for Automated Gas Optimization in Smart Contractscited by 5
  7. 2023Client-side Gradient Inversion Against Federated Learning from Poisoningcited by 4
  8. 2025Protecting Vulnerable Voices: Synthetic Dataset Generation for Self-Disclosure Detectioncited by 3
  9. 2026PII-VisBench: Evaluating Personally Identifiable Information Safety in Vision Language Models Along a Continuum of Visibilitycited by 3
  10. 2019Please Forget Where I Was Last Summer: The Privacy Risks of Public Location (Meta)Datacited by 2
  11. 2026CHASM: Unveiling Covert Advertisements on Chinese Social Mediacited by 2
  12. 2025TxSum: User-Centered Ethereum Transaction Understanding with Micro-Level Semantic Groundingcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Auditing M-LLMs for Privacy Risks: A Synthetic Benchmark and Evaluation Framework ↗
  2. 2025MultiPriv: Benchmarking Individual-Level Privacy Reasoning in Vision-Language Models
  3. 2025Through Their Eyes: User Perceptions on Sensitive Attribute Inference of Social Media Videos by Visual Language Models
  4. 2024Shake to Leak: Fine-tuning Diffusion Models Can Amplify the Generative Privacy Risk
  5. 2025PrivacyBench: A Conversational Benchmark for Evaluating Privacy in Personalized AI
  6. 2023Beyond Memorization: Violating Privacy Via Inference with Large Language Models
  7. 2026The Poisoned Conversation: Privacy-Leaking Watermarks in Unified Multimodal Models
  8. 2026NLP Privacy Risk Identification in Social Media (NLP-PRISM): A Survey