PriMod4AI: Lifecycle-Aware Privacy Threat Modeling for AI Systems using LLM
Not on the map. Why?
Abstract (arXiv)
Artificial intelligence systems introduce complex privacy risks throughout their lifecycle, especially when processing sensitive or high-dimensional data. Beyond the seven traditional privacy threat categories defined by the LINDDUN framework, AI systems are also exposed to model-centric privacy attacks such as membership inference and model inversion, which LINDDUN does not cover. To address both classical LINDDUN threats and additional AI-driven privacy attacks, PriMod4AI introduces a hybrid privacy threat modeling approach that unifies two structured knowledge sources, a LINDDUN knowledge base representing the established taxonomy, and a model-centric privacy attack knowledge base capturing threats outside LINDDUN. These knowledge bases are embedded into a vector database for semantic retrieval and combined with system level metadata derived from Data Flow Diagram. PriMod4AI uses retrieval-augmented and Data Flow specific prompt generation to guide large language models (LLMs) in identifying, explaining, and categorizing privacy threats across lifecycle stages. The framework produces justified and taxonomy-grounded threat assessments that integrate both classical and AI-driven perspectives. Evaluation on two AI systems indicates that PriMod4AI provides broad coverage of classical privacy categories while additionally identifying model-centric privacy threats. The framework produces consistent, knowledge-grounded outputs across LLMs, as reflected in agreement scores in the observed range.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 62 references that are in the map. First posted on arXiv 4 Feb 2026.
Builds on
25 of 62 references.
References · 25
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2017Billion-scale similarity search with GPUscited by 2,477
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,221
- 2020Extracting Training Data from Large Language Modelscited by 2,144
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,414
- 2019Deep Leakage from Gradientscited by 1,004
- 2018How To Backdoor Federated Learningcited by 745
- 2023Extracting Training Data from Diffusion Modelscited by 723
- 2016Stealing Machine Learning Models via Prediction APIscited by 602
- 2019The Secret Revealer: Generative Model-Inversion Attacks Against Deep Neural Networkscited by 241
- 2023From ChatGPT to ThreatGPT: Impact of Generative AI in Cybersecurity and Privacycited by 137
- 2019Reconstruction and Membership Inference Attacks against Generative Modelscited by 122
13 more
- 2021Survey: Leakage and Privacy at Inference Timecited by 44
- 2021MEGEX: Data-Free Model Extraction Attack against Gradient-Based Explainable AIcited by 35
- 2025A Survey on Privacy Risks and Protection in Large Language Modelscited by 20
- 2024Model Inversion Attacks: A Survey of Approaches and Countermeasurescited by 11
- 2024ThreatModeling-LLM: Automating Threat Modeling using Large Language Models for Banking Systemcited by 10
- 2024MoRSE: Bridging the Gap in Cybersecurity Expertise with Retrieval Augmented Generationcited by 8
- 2022Data Leakage in Notebooks: Static Detection and Better Processescited by 7
- 2025ThreatLens: LLM-guided Threat Modeling and Test Plan Generation for Hardware Security Verificationcited by 7
- 2024State-of-the-Art Approaches to Enhancing Privacy Preservation of Machine Learning Datasets: A Surveycited by 5
- 2024Privacy Risks of General-Purpose AI Systems: A Foundation for Investigating Practitioner Perspectivescited by 5
- 2024PILLAR: an AI-Powered Privacy Threat Modeling Toolcited by 4
- 2024A Survey on Privacy Attacks Against Digital Twin Systems in AI-Roboticscited by 3
- 2025Auspex: Building Threat Modeling Tradecraft into an Artificial Intelligence-based Copilotcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026On the Privacy of LLMs: An Ablation Study
- 2025Ensemble Privacy Defense for Knowledge-Intensive LLMs against Membership Inference Attacks
- 2023Can Language Models be Instructed to Protect Personal Information?
- 2024Unique Security and Privacy Threats of Large Language Models: A Comprehensive Survey
- 2023Can LLMs Keep a Secret? Testing Privacy Implications of Language Models via Contextual Integrity Theory
- 2025CTIGuardian: A Few-Shot Framework for Mitigating Privacy Leakage in Fine-Tuned LLMs
- 2025Fine-Grained Privacy Extraction from Retrieval-Augmented Generation Systems via Knowledge Asymmetry Exploitation
- 2025SoK: The Privacy Paradox of Large Language Models: Advancements, Privacy Risks, and Mitigation