Knowledge-Enriched Distributional Model Inversion Attacks
Not on the map. Why?
Abstract (arXiv)
Model inversion (MI) attacks are aimed at reconstructing training data from model parameters. Such attacks have triggered increasing concerns about privacy, especially given a growing number of online model repositories. However, existing MI attacks against deep neural networks (DNNs) have large room for performance improvement. We present a novel inversion-specific GAN that can better distill knowledge useful for performing attacks on private models from public data. In particular, we train the discriminator to differentiate not only the real and fake samples but the soft-labels provided by the target model. Moreover, unlike previous work that directly searches for a single data point to represent a target class, we propose to model a private data distribution for each target class. Our experiments show that the combination of these techniques can significantly boost the success rate of the state-of-the-art MI attacks by 150%, and generalize better to a variety of datasets and models. Our code is available at https://github.com/SCccc21/Knowledge-Enriched-DMI.
Key facts. Cited by 65 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 9; 2023: 19; 2024: 18; 2025: 13; 2026: 6.
65 papers.
Sort:
By area:
- 2022Plug & Play Attacks: Towards Robust and Flexible Model Inversion Attackscited by 58
- 2022Label-Only Model Inversion Attacks via Boundary Repulsioncited by 56
- 2023FedFed: Feature Distillation against Data Heterogeneity in Federated Learningcited by 54
- 2023Re-thinking Model Inversion Attacks Against Deep Neural Networkscited by 39
- 2023Reinforcement Learning-Based Black-Box Model Inversion Attackscited by 33
- 2022Bilateral Dependency Optimization: Defending Against Model-inversion Attackscited by 30
- 2024Privacy Leakage on DNNs: A Survey of Model Inversion Attacks and Defensescited by 30
- 2023Pseudo Label-Guided Model Inversion Attack via Conditional Generative Adversarial Networkcited by 28
- 2023A Survey of What to Share in Federated Learning: Perspectives on Model Utility, Privacy Leakage, and Communication Efficiencycited by 21
- 2023Label-Only Model Inversion Attacks via Knowledge Transfercited by 21
- 2024A Closer Look at GAN Priors: Exploiting Intermediate Features for Enhanced Model Inversion Attackscited by 17
- 2023On Strengthening and Defending Graph Reconstruction Attack with Markov Chain Approximationcited by 16
38 more
- 2023Challenges and Remedies to Privacy and Security in AIGC: Exploring the Potential of Privacy Computing, Blockchain, and Beyondcited by 14
- 2023Unstoppable Attack: Label-Only Model Inversion via Conditional Diffusion Modelcited by 14
- 2023Be Careful What You Smooth For: Label Smoothing Can Be a Privacy Shield but Also a Catalyst for Model Inversion Attackscited by 12
- 2024Model Inversion Robustness: Can Transfer Learning Help?cited by 11
- 2024Model Inversion Attacks: A Survey of Approaches and Countermeasurescited by 11
- 2024Model Inversion Attacks Through Target-Specific Conditional Diffusion Modelscited by 8
- 2024On the Vulnerability of Skip Connections to Model Inversion Attackscited by 8
- 2022Get your Foes Fooled: Proximal Gradient Split Learning for Defense against Model Inversion Attacks on IoMT datacited by 7
- 2022SecretGen: Privacy Recovery on Pre-Trained Models via Distribution Discriminationcited by 7
- 2023Boosting Model Inversion Attacks with Adversarial Examplescited by 7
- 2023DANAA: Towards transferable attacks with double adversarial neuron attributioncited by 7
- 2024BrainLeaks: On the Privacy-Preserving Properties of Neuromorphic Architectures against Model Inversion Attackscited by 7
- 2023Model Inversion Attack via Dynamic Memory Learningcited by 6
- 2023SoK: Pitfalls in Evaluating Black-Box Attackscited by 6
- 2024CGI-DM: Digital Copyright Authentication for Diffusion Models via Contrasting Gradient Inversioncited by 6
- 2022Roadmap for Cybersecurity in Autonomous Vehiclescited by 5
- 2024Understanding Data Importance in Machine Learning Attacks: Does Valuable Data Pose Greater Harm?cited by 5
- 2024MIBench: A Comprehensive Framework for Benchmarking Model Inversion Attack and Defensecited by 5
- 2025SoK: Data Reconstruction Attacks Against Machine Learning Models: Definition, Metrics, and Benchmarkcited by 5
- 2023Balancing Transparency and Risk: The Security and Privacy Risks of Open-Source Machine Learning Modelscited by 4
- 2023All Rivers Run to the Sea: Private Learning with Asymmetric Flowscited by 4
- 2024Rank Matters: Understanding and Defending Model Inversion Attacks via Low-Rank Feature Filteringcited by 4
- 2024Trap-MID: Trapdoor-based Defense against Model Inversion Attackscited by 4
- 2025From Centralized to Decentralized Federated Learning: Theoretical Insights, Privacy Preservation, and Robustness Challengescited by 4
- 2025LeakyCLIP: Extracting Training Data from CLIPcited by 4
- 2022FedComm: Federated Learning as a Medium for Covert Communicationcited by 3
- 2022Data Stealing Attack on Medical Images: Is it Safe to Export Networks from Data Lakes?cited by 2
- 2023Class Attribute Inference Attacks: Inferring Sensitive Class Information by Diffusion-Based Attribute Manipulationscited by 2
- 2024Direct Acquisition Optimization for Low-Budget Active Learningcited by 2
- 2024Prediction Exposes Your Face: Black-box Model Inversion via Prediction Alignmentcited by 2
- 2024Random Erasing vs. Model Inversion: A Promising Defense or a False Hope?cited by 2
- 2025A Sample-Level Evaluation and Generative Framework for Model Inversion Attackscited by 2
- 2024Distributional Black-Box Model Inversion Attack with Multi-Agent Reinforcement Learningcited by 1
- 2025Revisiting Model Inversion Evaluation: From Misleading Standards to Reliable Privacy Assessmentcited by 1
- 2025Generative Model Inversion Through the Lens of the Manifold Hypothesiscited by 1
- 2026Guarding the Middle: Protecting Intermediate Representations in Federated Split Learningcited by 1
- 2026AI Security in the Foundation Model Era: A Comprehensive Survey from a Unified Perspectivecited by 1
- 2022Turning a Curse into a Blessing: Enabling In-Distribution-Data-Free Backdoor Removal via Stabilized Model Inversioncited by 0
50 most cited of 65 All 65 (JSON)
- 2026On the Relationship between Model Quantization and Model Inversion Attacks30 Sep 2026
- 2026Steering the Flow: Inverting Face Recognition Models via Gradient-Guided Flow Matching17 Aug 2026
- 2026Reducing information dependency does not cause training data privacy. Adversarially non-robust features do14 Jul 2026
- 2026AI Security in the Foundation Model Era: A Comprehensive Survey from a Unified Perspective25 Mar 2026
- 2026Guarding the Middle: Protecting Intermediate Representations in Federated Split Learning19 Feb 2026
- 2026Robust Privacy: Inference-Stage Privacy through Certified Robustness24 Jan 2026
- 2025Model Inversion Attack Against Deep Hashing15 Nov 2025
- 2025Model Inversion meets Cryptographic Fuzzy Extractors29 Oct 2025
- 2025Generative Model Inversion Through the Lens of the Manifold Hypothesis24 Sep 2025
- 2025Do Vision-Language Models Leak What They Learn? Adaptive Token-Weighted Model Inversion Attacks6 Aug 2025
- 2025LeakyCLIP: Extracting Training Data from CLIP1 Aug 2025
- 2025SoK: Data Reconstruction Attacks Against Machine Learning Models: Definition, Metrics, and Benchmark9 Jun 2025
38 more
- 2025Revisiting Model Inversion Evaluation: From Misleading Standards to Reliable Privacy Assessment6 May 2025
- 2025PEEL the Layers and Find Yourself: Revisiting Inference-time Data Leakage for Residual Neural Networks8 Apr 2025
- 2025Defending Against Gradient Inversion Attacks for Biomedical Images via Learnable Data Perturbation19 Mar 2025
- 2025Revealing Unintentional Information Leakage in Low-Dimensional Facial Portrait Representations12 Mar 2025
- 2025From Centralized to Decentralized Federated Learning: Theoretical Insights, Privacy Preservation, and Robustness Challenges10 Mar 2025
- 2025A Sample-Level Evaluation and Generative Framework for Model Inversion Attacks26 Feb 2025
- 2025PPO-MI: Efficient Black-Box Model Inversion via Proximal Policy Optimization20 Feb 2025
- 2024Model Inversion Attacks: A Survey of Approaches and Countermeasures15 Nov 2024
- 2024Trap-MID: Trapdoor-based Defense against Model Inversion Attacks13 Nov 2024
- 2024Rank Matters: Understanding and Defending Model Inversion Attacks via Low-Rank Feature Filtering8 Oct 2024
- 2024MIBench: A Comprehensive Framework for Benchmarking Model Inversion Attack and Defense7 Oct 2024
- 2024Understanding Data Importance in Machine Learning Attacks: Does Valuable Data Pose Greater Harm?5 Sep 2024
- 2024On the Vulnerability of Skip Connections to Model Inversion Attacks3 Sep 2024
- 2024Random Erasing vs. Model Inversion: A Promising Defense or a False Hope?2 Sep 2024
- 2024A Closer Look at GAN Priors: Exploiting Intermediate Features for Enhanced Model Inversion Attacks18 Jul 2024
- 2024Model Inversion Attacks Through Target-Specific Conditional Diffusion Models16 Jul 2024
- 2024Prediction Exposes Your Face: Black-box Model Inversion via Prediction Alignment11 Jul 2024
- 2024Model Inversion Robustness: Can Transfer Learning Help?9 May 2024
- 2024Distributional Black-Box Model Inversion Attack with Multi-Agent Reinforcement Learning22 Apr 2024
- 2024CGI-DM: Digital Copyright Authentication for Diffusion Models via Contrasting Gradient Inversion17 Mar 2024
- 2024Adaptive Hybrid Masking Strategy for Privacy-Preserving Face Recognition Against Model Inversion Attack14 Mar 2024
- 2024Breaking the Black-Box: Confidence-Guided Model Inversion Attack for Distribution Shift28 Feb 2024
- 2024Direct Acquisition Optimization for Low-Budget Active Learning8 Feb 2024
- 2024Privacy Leakage on DNNs: A Survey of Model Inversion Attacks and Defenses6 Feb 2024
- 2024BrainLeaks: On the Privacy-Preserving Properties of Neuromorphic Architectures against Model Inversion Attacks1 Feb 2024
- 2023Rethinking Model Inversion Attacks With Patch-Wise Reconstruction12 Dec 2023
- 2023All Rivers Run to the Sea: Private Learning with Asymmetric Flows5 Dec 2023
- 2023Label-Only Model Inversion Attacks via Knowledge Transfer30 Oct 2023
- 2023SoK: Pitfalls in Evaluating Black-Box Attacks26 Oct 2023
- 2023Facial Data Minimization: Shallow Model as Your Privacy Filter24 Oct 2023
- 2023DANAA: Towards transferable attacks with double adversarial neuron attribution16 Oct 2023
- 2023Be Careful What You Smooth For: Label Smoothing Can Be a Privacy Shield but Also a Catalyst for Model Inversion Attacks10 Oct 2023
- 2023FedFed: Feature Distillation against Data Heterogeneity in Federated Learning8 Oct 2023
- 2023Model Inversion Attack via Dynamic Memory Learning24 Aug 2023
- 2023Balancing Transparency and Risk: The Security and Privacy Risks of Open-Source Machine Learning Models18 Aug 2023
- 2023A Survey of What to Share in Federated Learning: Perspectives on Model Utility, Privacy Leakage, and Communication Efficiency20 Jul 2023
- 2023Unstoppable Attack: Label-Only Model Inversion via Conditional Diffusion Model17 Jul 2023
- 2023Boosting Model Inversion Attacks with Adversarial Examples24 Jun 2023
50 newest of 65 All 65 (JSON)
- 2023Unstoppable Attack: Label-Only Model Inversion via Conditional Diffusion Modelcited by 14
- 2024Model Inversion Attacks Through Target-Specific Conditional Diffusion Modelscited by 8
- 2024CGI-DM: Digital Copyright Authentication for Diffusion Models via Contrasting Gradient Inversioncited by 6
- 2025LeakyCLIP: Extracting Training Data from CLIPcited by 4
- 2026Steering the Flow: Inverting Face Recognition Models via Gradient-Guided Flow Matchingcited by 0
- 2026Steering the Flow: Inverting Face Recognition Models via Gradient-Guided Flow Matching17 Aug 2026
- 2025LeakyCLIP: Extracting Training Data from CLIP1 Aug 2025
- 2024Model Inversion Attacks Through Target-Specific Conditional Diffusion Models16 Jul 2024
- 2024CGI-DM: Digital Copyright Authentication for Diffusion Models via Contrasting Gradient Inversion17 Mar 2024
- 2023Unstoppable Attack: Label-Only Model Inversion via Conditional Diffusion Model17 Jul 2023
- 2022Plug & Play Attacks: Towards Robust and Flexible Model Inversion Attackscited by 58
- 2022Label-Only Model Inversion Attacks via Boundary Repulsioncited by 56
- 2023FedFed: Feature Distillation against Data Heterogeneity in Federated Learningcited by 54
- 2023Re-thinking Model Inversion Attacks Against Deep Neural Networkscited by 39
- 2023Reinforcement Learning-Based Black-Box Model Inversion Attackscited by 33
- 2022Bilateral Dependency Optimization: Defending Against Model-inversion Attackscited by 30
- 2024Privacy Leakage on DNNs: A Survey of Model Inversion Attacks and Defensescited by 30
- 2023Pseudo Label-Guided Model Inversion Attack via Conditional Generative Adversarial Networkcited by 28
- 2023A Survey of What to Share in Federated Learning: Perspectives on Model Utility, Privacy Leakage, and Communication Efficiencycited by 21
- 2023Label-Only Model Inversion Attacks via Knowledge Transfercited by 21
- 2024A Closer Look at GAN Priors: Exploiting Intermediate Features for Enhanced Model Inversion Attackscited by 17
- 2023On Strengthening and Defending Graph Reconstruction Attack with Markov Chain Approximationcited by 16
12 most cited of 57 All 57 (JSON)
- 2026On the Relationship between Model Quantization and Model Inversion Attacks30 Sep 2026
- 2026Reducing information dependency does not cause training data privacy. Adversarially non-robust features do14 Jul 2026
- 2026Guarding the Middle: Protecting Intermediate Representations in Federated Split Learning19 Feb 2026
- 2026Robust Privacy: Inference-Stage Privacy through Certified Robustness24 Jan 2026
- 2025Model Inversion Attack Against Deep Hashing15 Nov 2025
- 2025Model Inversion meets Cryptographic Fuzzy Extractors29 Oct 2025
- 2025Generative Model Inversion Through the Lens of the Manifold Hypothesis24 Sep 2025
- 2025SoK: Data Reconstruction Attacks Against Machine Learning Models: Definition, Metrics, and Benchmark9 Jun 2025
- 2025Revisiting Model Inversion Evaluation: From Misleading Standards to Reliable Privacy Assessment6 May 2025
- 2025PEEL the Layers and Find Yourself: Revisiting Inference-time Data Leakage for Residual Neural Networks8 Apr 2025
- 2025Defending Against Gradient Inversion Attacks for Biomedical Images via Learnable Data Perturbation19 Mar 2025
- 2025Revealing Unintentional Information Leakage in Low-Dimensional Facial Portrait Representations12 Mar 2025
12 newest of 57 All 57 (JSON)