Plug & Play Attacks: Towards Robust and Flexible Model Inversion Attacks
Not on the map. Why?
Abstract (arXiv)
Model inversion attacks (MIAs) aim to create synthetic images that reflect the class-wise characteristics from a target classifier's private training data by exploiting the model's learned knowledge. Previous research has developed generative MIAs that use generative adversarial networks (GANs) as image priors tailored to a specific target model. This makes the attacks time- and resource-consuming, inflexible, and susceptible to distributional shifts between datasets. To overcome these drawbacks, we present Plug & Play Attacks, which relax the dependency between the target model and image prior, and enable the use of a single GAN to attack a wide range of targets, requiring only minor adjustments to the attack. Moreover, we show that powerful MIAs are possible even with publicly available pre-trained GANs and under strong distributional shifts, for which previous approaches fail to produce meaningful results. Our extensive evaluation confirms the improved robustness and flexibility of Plug & Play Attacks and their ability to create high-quality images revealing sensitive class characteristics.
Key facts. Cited by 58 papers in the map (data through 7 Oct 2026). Builds on 38 of its 52 references that are in the map. First posted on arXiv 28 Jan 2022.
Builds on
38 of 52 references.
References · 38
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2013Intriguing properties of neural networkscited by 5,114
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
26 more
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
- 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,509
- 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
- 2021Alias-Free Generative Adversarial Networkscited by 1,181
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
- 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
- 2017VGGFace2: A dataset for recognising faces across pose and agecited by 911
- 2014Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Imagescited by 774
- 2017Poincar'e Embeddings for Learning Hierarchical Representationscited by 674
- 2020ResNeSt: Split-Attention Networkscited by 445
- 2020Reliable Fidelity and Diversity Metrics for Generative Modelscited by 425
- 2019Dreaming to Distill: Data-free Knowledge Transfer via DeepInversioncited by 419
- 2020Label-Only Membership Inference Attackscited by 371
- 2018Invertible Residual Networkscited by 364
- 2018Why ReLU networks yield high-confidence predictions far away from the training data and how to mitigate the problemcited by 323
- 2019The Secret Revealer: Generative Model-Inversion Attacks Against Deep Neural Networkscited by 241
- 2015Inverting Visual Representations with Convolutional Networkscited by 168
- 2020Membership Leakage in Label-Only Exposurescited by 156
- 2018Poincar'e GloVe: Hyperbolic Word Embeddingscited by 155
- 2019Continuous Hierarchical Representations with Poincar'e Variational Auto-Encoderscited by 111
- 2022Variational Model Inversion Attackscited by 75
- 2020Knowledge-Enriched Distributional Model Inversion Attackscited by 65
- 2021Exploiting Explanations for Model Inversion Attackscited by 48
- 2019MintNet: Building Invertible Neural Networks with Masked Convolutionscited by 35
- 2018Inverting Supervised Representations with Autoregressive Neural Density Modelscited by 12
Built on by
Citing papers per year: 2022: 4; 2023: 15; 2024: 22; 2025: 10; 2026: 7.
58 papers.
Sort:
By area:
- 2022Rickrolling the Artist: Injecting Backdoors into Text Encoders for Text-to-Image Synthesiscited by 59
- 2024Finding NeMo: Localizing Neurons Responsible For Memorization in Diffusion Modelscited by 36
- 2024Privacy Leakage on DNNs: A Survey of Model Inversion Attacks and Defensescited by 30
- 2022Exploiting Cultural Biases via Homoglyphs in Text-to-Image Synthesiscited by 29
- 2023Pseudo Label-Guided Model Inversion Attack via Conditional Generative Adversarial Networkcited by 28
- 2023Label-Only Model Inversion Attacks via Knowledge Transfercited by 21
- 2022Does CLIP Know My Face?cited by 19
- 2024A Closer Look at GAN Priors: Exploiting Intermediate Features for Enhanced Model Inversion Attackscited by 17
- 2023On Strengthening and Defending Graph Reconstruction Attack with Markov Chain Approximationcited by 16
- 2023Unstoppable Attack: Label-Only Model Inversion via Conditional Diffusion Modelcited by 14
- 2023Be Careful What You Smooth For: Label Smoothing Can Be a Privacy Shield but Also a Catalyst for Model Inversion Attackscited by 12
- 2024Model Reconstruction Using Counterfactual Explanations: A Perspective From Polytope Theorycited by 12
38 more
- 2024Model Inversion Robustness: Can Transfer Learning Help?cited by 11
- 2024Improving Robustness to Model Inversion Attacks via Sparse Coding Architecturescited by 8
- 2024Model Inversion Attacks Through Target-Specific Conditional Diffusion Modelscited by 8
- 2024On the Vulnerability of Skip Connections to Model Inversion Attackscited by 8
- 2023Boosting Model Inversion Attacks with Adversarial Examplescited by 7
- 2023DANAA: Towards transferable attacks with double adversarial neuron attributioncited by 7
- 2023Model Inversion Attack via Dynamic Memory Learningcited by 6
- 2025Theoretical Insights in Model Inversion Robustness and Conditional Entropy Maximization for Collaborative Inference Systemscited by 6
- 2024Rethinking the impact of noisy labels in graph classification: A utility and privacy perspectivecited by 5
- 2024Understanding Data Importance in Machine Learning Attacks: Does Valuable Data Pose Greater Harm?cited by 5
- 2024MIBench: A Comprehensive Framework for Benchmarking Model Inversion Attack and Defensecited by 5
- 2025SoK: Data Reconstruction Attacks Against Machine Learning Models: Definition, Metrics, and Benchmarkcited by 5
- 2023Balancing Transparency and Risk: The Security and Privacy Risks of Open-Source Machine Learning Modelscited by 4
- 2023Client-side Gradient Inversion Against Federated Learning from Poisoningcited by 4
- 2023Defending Our Privacy With Backdoorscited by 4
- 2023All Rivers Run to the Sea: Private Learning with Asymmetric Flowscited by 4
- 2024MAP: MAsk-Pruning for Source-Free Model Intellectual Property Protectioncited by 4
- 2024Rank Matters: Understanding and Defending Model Inversion Attacks via Low-Rank Feature Filteringcited by 4
- 2024Trap-MID: Trapdoor-based Defense against Model Inversion Attackscited by 4
- 2025LeakyCLIP: Extracting Training Data from CLIPcited by 4
- 2025DiffMI: Breaking Face Recognition Privacy via Diffusion-Driven Training-Free Model Inversioncited by 3
- 2023Class Attribute Inference Attacks: Inferring Sensitive Class Information by Diffusion-Based Attribute Manipulationscited by 2
- 2024Prediction Exposes Your Face: Black-box Model Inversion via Prediction Alignmentcited by 2
- 2024Random Erasing vs. Model Inversion: A Promising Defense or a False Hope?cited by 2
- 2025Intellectual Property in Graph-Based Machine Learning as a Service: Attacks and Defensescited by 2
- 2024Inference Attacks Against Face Recognition Model without Classification Layerscited by 1
- 2024LazyDP: Co-Designing Algorithm-Software for Scalable Training of Differentially Private Recommendation Modelscited by 1
- 2025Do Spikes Protect Privacy? Investigating Black-Box Model Inversion Attacks in Spiking Neural Networkscited by 1
- 2025Revisiting Model Inversion Evaluation: From Misleading Standards to Reliable Privacy Assessmentcited by 1
- 2025Inverting Black-Box Face Recognition Systems via Zero-Order Optimization in Eigenface Spacecited by 1
- 2025Generative Model Inversion Through the Lens of the Manifold Hypothesiscited by 1
- 2022Turning a Curse into a Blessing: Enabling In-Distribution-Data-Free Backdoor Removal via Stabilized Model Inversioncited by 0
- 2023Facial Data Minimization: Shallow Model as Your Privacy Filtercited by 0
- 2023Rethinking Model Inversion Attacks With Patch-Wise Reconstructioncited by 0
- 2024Unraveling Attacks in Machine Learning-based IoT Ecosystems: A Survey and the Open Libraries Behind Themcited by 0
- 2024Breaking the Black-Box: Confidence-Guided Model Inversion Attack for Distribution Shiftcited by 0
- 2024Efficient Knowledge Deletion from Trained Models through Layer-wise Partial Machine Unlearningcited by 0
- 2024Adaptive Hybrid Masking Strategy for Privacy-Preserving Face Recognition Against Model Inversion Attackcited by 0
50 most cited of 58 All 58 (JSON)
- 2026On the Relationship between Model Quantization and Model Inversion Attacks30 Sep 2026
- 2026CLeaR: A Unified Framework for Resolving the Leakage-Degradation Dilemma in Style Transfer29 Sep 2026
- 2026Steering the Flow: Inverting Face Recognition Models via Gradient-Guided Flow Matching17 Aug 2026
- 2026Reducing information dependency does not cause training data privacy. Adversarially non-robust features do14 Jul 2026
- 2026TrustCLIP: Learning Private Visual Features via Adversarial Reconstruction5 Jul 2026
- 2026From Measurement to Mitigation: Quantifying and Reducing Identity Leakage in Image Representation Encoders with Linear Subspace Removal7 Apr 2026
- 2026Responsible AI for General-Purpose Systems: Overview, Challenges, and A Path Forward19 Jan 2026
- 2025Generative Model Inversion Through the Lens of the Manifold Hypothesis24 Sep 2025
- 2025Intellectual Property in Graph-Based Machine Learning as a Service: Attacks and Defenses27 Aug 2025
- 2025Do Vision-Language Models Leak What They Learn? Adaptive Token-Weighted Model Inversion Attacks6 Aug 2025
- 2025LeakyCLIP: Extracting Training Data from CLIP1 Aug 2025
- 2025Inverting Black-Box Face Recognition Systems via Zero-Order Optimization in Eigenface Space11 Jun 2025
38 more
- 2025SoK: Data Reconstruction Attacks Against Machine Learning Models: Definition, Metrics, and Benchmark9 Jun 2025
- 2025Revisiting Model Inversion Evaluation: From Misleading Standards to Reliable Privacy Assessment6 May 2025
- 2025DiffMI: Breaking Face Recognition Privacy via Diffusion-Driven Training-Free Model Inversion25 Apr 2025
- 2025Theoretical Insights in Model Inversion Robustness and Conditional Entropy Maximization for Collaborative Inference Systems1 Mar 2025
- 2025Do Spikes Protect Privacy? Investigating Black-Box Model Inversion Attacks in Spiking Neural Networks8 Feb 2025
- 2024Trap-MID: Trapdoor-based Defense against Model Inversion Attacks13 Nov 2024
- 2024Rank Matters: Understanding and Defending Model Inversion Attacks via Low-Rank Feature Filtering8 Oct 2024
- 2024MIBench: A Comprehensive Framework for Benchmarking Model Inversion Attack and Defense7 Oct 2024
- 2024Understanding Data Importance in Machine Learning Attacks: Does Valuable Data Pose Greater Harm?5 Sep 2024
- 2024On the Vulnerability of Skip Connections to Model Inversion Attacks3 Sep 2024
- 2024Random Erasing vs. Model Inversion: A Promising Defense or a False Hope?2 Sep 2024
- 2024A Closer Look at GAN Priors: Exploiting Intermediate Features for Enhanced Model Inversion Attacks18 Jul 2024
- 2024Model Inversion Attacks Through Target-Specific Conditional Diffusion Models16 Jul 2024
- 2024Prediction Exposes Your Face: Black-box Model Inversion via Prediction Alignment11 Jul 2024
- 2024Rethinking the impact of noisy labels in graph classification: A utility and privacy perspective11 Jun 2024
- 2024Finding NeMo: Localizing Neurons Responsible For Memorization in Diffusion Models4 Jun 2024
- 2024Model Inversion Robustness: Can Transfer Learning Help?9 May 2024
- 2024Model Reconstruction Using Counterfactual Explanations: A Perspective From Polytope Theory8 May 2024
- 2024LazyDP: Co-Designing Algorithm-Software for Scalable Training of Differentially Private Recommendation Models12 Apr 2024
- 2024Improving Robustness to Model Inversion Attacks via Sparse Coding Architectures21 Mar 2024
- 2024Adaptive Hybrid Masking Strategy for Privacy-Preserving Face Recognition Against Model Inversion Attack14 Mar 2024
- 2024Efficient Knowledge Deletion from Trained Models through Layer-wise Partial Machine Unlearning12 Mar 2024
- 2024MAP: MAsk-Pruning for Source-Free Model Intellectual Property Protection7 Mar 2024
- 2024Breaking the Black-Box: Confidence-Guided Model Inversion Attack for Distribution Shift28 Feb 2024
- 2024Privacy Leakage on DNNs: A Survey of Model Inversion Attacks and Defenses6 Feb 2024
- 2024Inference Attacks Against Face Recognition Model without Classification Layers24 Jan 2024
- 2024Unraveling Attacks in Machine Learning-based IoT Ecosystems: A Survey and the Open Libraries Behind Them22 Jan 2024
- 2023Rethinking Model Inversion Attacks With Patch-Wise Reconstruction12 Dec 2023
- 2023All Rivers Run to the Sea: Private Learning with Asymmetric Flows5 Dec 2023
- 2023Label-Only Model Inversion Attacks via Knowledge Transfer30 Oct 2023
- 2023Facial Data Minimization: Shallow Model as Your Privacy Filter24 Oct 2023
- 2023DANAA: Towards transferable attacks with double adversarial neuron attribution16 Oct 2023
- 2023Defending Our Privacy With Backdoors12 Oct 2023
- 2023Be Careful What You Smooth For: Label Smoothing Can Be a Privacy Shield but Also a Catalyst for Model Inversion Attacks10 Oct 2023
- 2023Client-side Gradient Inversion Against Federated Learning from Poisoning14 Sep 2023
- 2023Model Inversion Attack via Dynamic Memory Learning24 Aug 2023
- 2023Balancing Transparency and Risk: The Security and Privacy Risks of Open-Source Machine Learning Models18 Aug 2023
- 2023Unstoppable Attack: Label-Only Model Inversion via Conditional Diffusion Model17 Jul 2023
50 newest of 58 All 58 (JSON)
- 2024Finding NeMo: Localizing Neurons Responsible For Memorization in Diffusion Modelscited by 36
- 2022Exploiting Cultural Biases via Homoglyphs in Text-to-Image Synthesiscited by 29
- 2023Unstoppable Attack: Label-Only Model Inversion via Conditional Diffusion Modelcited by 14
- 2024Model Inversion Attacks Through Target-Specific Conditional Diffusion Modelscited by 8
- 2025LeakyCLIP: Extracting Training Data from CLIPcited by 4
- 2026Steering the Flow: Inverting Face Recognition Models via Gradient-Guided Flow Matchingcited by 0
- 2026Steering the Flow: Inverting Face Recognition Models via Gradient-Guided Flow Matching17 Aug 2026
- 2025LeakyCLIP: Extracting Training Data from CLIP1 Aug 2025
- 2024Model Inversion Attacks Through Target-Specific Conditional Diffusion Models16 Jul 2024
- 2024Finding NeMo: Localizing Neurons Responsible For Memorization in Diffusion Models4 Jun 2024
- 2023Unstoppable Attack: Label-Only Model Inversion via Conditional Diffusion Model17 Jul 2023
- 2022Exploiting Cultural Biases via Homoglyphs in Text-to-Image Synthesis19 Sep 2022
- 2022Rickrolling the Artist: Injecting Backdoors into Text Encoders for Text-to-Image Synthesiscited by 59
- 2024Understanding Data Importance in Machine Learning Attacks: Does Valuable Data Pose Greater Harm?cited by 5
- 2024Inference Attacks Against Face Recognition Model without Classification Layerscited by 1
- 2024Efficient Knowledge Deletion from Trained Models through Layer-wise Partial Machine Unlearningcited by 0
- 2024Understanding Data Importance in Machine Learning Attacks: Does Valuable Data Pose Greater Harm?5 Sep 2024
- 2024Efficient Knowledge Deletion from Trained Models through Layer-wise Partial Machine Unlearning12 Mar 2024
- 2024Inference Attacks Against Face Recognition Model without Classification Layers24 Jan 2024
- 2022Rickrolling the Artist: Injecting Backdoors into Text Encoders for Text-to-Image Synthesis4 Nov 2022
- 2024Privacy Leakage on DNNs: A Survey of Model Inversion Attacks and Defensescited by 30
- 2023Pseudo Label-Guided Model Inversion Attack via Conditional Generative Adversarial Networkcited by 28
- 2023Label-Only Model Inversion Attacks via Knowledge Transfercited by 21
- 2022Does CLIP Know My Face?cited by 19
- 2024A Closer Look at GAN Priors: Exploiting Intermediate Features for Enhanced Model Inversion Attackscited by 17
- 2023On Strengthening and Defending Graph Reconstruction Attack with Markov Chain Approximationcited by 16
- 2023Be Careful What You Smooth For: Label Smoothing Can Be a Privacy Shield but Also a Catalyst for Model Inversion Attackscited by 12
- 2024Model Reconstruction Using Counterfactual Explanations: A Perspective From Polytope Theorycited by 12
- 2024Model Inversion Robustness: Can Transfer Learning Help?cited by 11
- 2024Improving Robustness to Model Inversion Attacks via Sparse Coding Architecturescited by 8
- 2024On the Vulnerability of Skip Connections to Model Inversion Attackscited by 8
- 2023Boosting Model Inversion Attacks with Adversarial Examplescited by 7
12 most cited of 46 All 46 (JSON)
- 2026On the Relationship between Model Quantization and Model Inversion Attacks30 Sep 2026
- 2026CLeaR: A Unified Framework for Resolving the Leakage-Degradation Dilemma in Style Transfer29 Sep 2026
- 2026Reducing information dependency does not cause training data privacy. Adversarially non-robust features do14 Jul 2026
- 2026From Measurement to Mitigation: Quantifying and Reducing Identity Leakage in Image Representation Encoders with Linear Subspace Removal7 Apr 2026
- 2026Responsible AI for General-Purpose Systems: Overview, Challenges, and A Path Forward19 Jan 2026
- 2025Generative Model Inversion Through the Lens of the Manifold Hypothesis24 Sep 2025
- 2025Intellectual Property in Graph-Based Machine Learning as a Service: Attacks and Defenses27 Aug 2025
- 2025Inverting Black-Box Face Recognition Systems via Zero-Order Optimization in Eigenface Space11 Jun 2025
- 2025SoK: Data Reconstruction Attacks Against Machine Learning Models: Definition, Metrics, and Benchmark9 Jun 2025
- 2025Revisiting Model Inversion Evaluation: From Misleading Standards to Reliable Privacy Assessment6 May 2025
- 2025DiffMI: Breaking Face Recognition Privacy via Diffusion-Driven Training-Free Model Inversion25 Apr 2025
- 2025Theoretical Insights in Model Inversion Robustness and Conditional Entropy Maximization for Collaborative Inference Systems1 Mar 2025
12 newest of 46 All 46 (JSON)