GI-NAS: Boosting Gradient Inversion Attacks Through Adaptive Neural Architecture Search
Not on the map. Why?
Abstract (arXiv)
Gradient Inversion Attacks invert the transmitted gradients in Federated Learning (FL) systems to reconstruct the sensitive data of local clients and have raised considerable privacy concerns. A majority of gradient inversion methods rely heavily on explicit prior knowledge (e.g., a well pre-trained generative model), which is often unavailable in realistic scenarios. This is because real-world client data distributions are often highly heterogeneous, domain-specific, and unavailable to attackers, making it impractical for attackers to obtain perfectly matched pre-trained models, which inevitably suffer from fundamental distribution shifts relative to target private data. To alleviate this issue, researchers have proposed to leverage the implicit prior knowledge of an over-parameterized network. However, they only utilize a fixed neural architecture for all the attack settings. This would hinder the adaptive use of implicit architectural priors and consequently limit the generalizability. In this paper, we further exploit such implicit prior knowledge by proposing Gradient Inversion via Neural Architecture Search (GI-NAS), which adaptively searches the network and captures the implicit priors behind neural architectures. Extensive experiments verify that our proposed GI-NAS can achieve superior attack performance compared to state-of-the-art gradient inversion methods, even under more practical settings with high-resolution images, large-sized batches, and advanced defense strategies. To the best of our knowledge, we are the first to successfully introduce NAS to the gradient inversion community. We believe that this work exposes critical vulnerabilities in real-world federated learning by demonstrating high-fidelity reconstruction of sensitive data without requiring domain-specific priors, forcing urgent reassessment of FL privacy safeguards.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 48 of its 79 references that are in the map. First posted on arXiv 31 May 2024.
Builds on
48 of 79 references.
References · 48
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Generative Adversarial Networkscited by 5,627
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2016Neural Architecture Search with Reinforcement Learningcited by 1,499
- 2017Deep Image Priorcited by 1,098
- 2019Deep Leakage from Gradientscited by 1,021
36 more
- 2020Inverting Gradients -- How easy is it to break privacy in federated learning?cited by 712
- 2018ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardwarecited by 673
- 2017Generative Adversarial Networks: An Overviewcited by 590
- 2018Exploiting Unintended Feature Leakage in Collaborative Learningcited by 520
- 2017Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Trainingcited by 478
- 2017Differentially Private Federated Learning: A Client Level Perspectivecited by 459
- 2020iDLG: Improved Deep Leakage from Gradientscited by 382
- 2020FLTrust: Byzantine-robust Federated Learning via Trust Bootstrappingcited by 346
- 2021See through Gradients: Image Batch Recovery via GradInversioncited by 326
- 2018SNAS: Stochastic Neural Architecture Searchcited by 289
- 2016Designing Neural Network Architectures using Reinforcement Learningcited by 279
- 2019Auto-DeepLab: Hierarchical Neural Architecture Search for Semantic Image Segmentationcited by 260
- 2017Sparse Communication for Distributed Gradient Descentcited by 249
- 2021Evaluating Gradient Inversion Attacks and Defenses in Federated Learningcited by 196
- 2020Threats to Federated Learning: A Surveycited by 178
- 2023Heterogeneous Federated Learning: State-of-the-art and Research Challengescited by 161
- 2020Feature Inference Attack on Model Predictions in Vertical Federated Learningcited by 106
- 2021Gradient Inversion with Generative Image Priorcited by 101
- 2020R-GAP: Recursive Gradient Attack on Privacycited by 97
- 2017Evolving Deep Neural Networkscited by 95
- 2020Provable Defense against Privacy Leakage in Federated Learning from Representation Perspectivecited by 94
- 2022Auditing Privacy Defenses in Federated Learning via Generative Gradient Leakagecited by 72
- 2019Fast, Accurate and Lightweight Super-Resolution with Neural Architecture Searchcited by 66
- 2019A Bayesian Perspective on the Deep Image Priorcited by 52
- 2023GIFD: A Generative Gradient Inversion Method with Feature Domain Optimizationcited by 45
- 2021Gradient-Leakage Resilient Federated Learningcited by 40
- 2022A Survey on Gradient Inversion: Attacks, Defenses and Future Directionscited by 40
- 2018Fast Neural Architecture Search of Compact Semantic Segmentation Models via Auxiliary Cellscited by 39
- 2022Training-free Transformer Architecture Searchcited by 33
- 2020NAS-DIP: Learning Deep Image Prior with Neural Architecture Searchcited by 20
- 2018Exploiting the Potential of Standard Convolutional Autoencoders for Image Restoration by Evolutionary Searchcited by 19
- 2016Survey on the attention based RNN model and its applications in computer visioncited by 15
- 2021ISNAS-DIP: Image-Specific Neural Architecture Search for Deep Image Priorcited by 12
- 2023The Devil is in the Upsampling: Architectural Decisions Made Simpler for Denoising with Deep Image Priorcited by 11
- 2018MaskConnect: Connectivity Learning by Gradient Descentcited by 9
- 2023Training-free Neural Architecture Search for RNNs and Transformerscited by 9
Built on by
Citing papers per year: 2024: 4; 2025: 7; 2026: 3.
14 papers.
Sort:
By area:
- 2024One Perturbation is Enough: On Generating Universal Adversarial Perturbations against Vision-Language Pre-training Modelscited by 40
- 2024CLIP-Guided Generative Networks for Transferable Targeted Adversarial Attackscited by 19
- 2024A Closer Look at GAN Priors: Exploiting Intermediate Features for Enhanced Model Inversion Attackscited by 18
- 2025Revisiting Backdoor Attacks on LLMs: A Stealthy and Practical Poisoning Framework via Harmless Inputscited by 10
- 2025Exploring the Vulnerabilities of Federated Learning: A Deep Dive into Gradient Inversion Attackscited by 9
- 2024Editable-DeepSC: Reliable Cross-Modal Semantic Communications for Facial Editingcited by 3
- 2025Trajectory-Aware Information Matching for Multi-Step Gradient Inversion in Federated Learningcited by 2
- 2025FedMPDD: Communication-Efficient Federated Learning with Privacy Preservation Attributes via Projected Directional Derivativecited by 2
- 2026Enhancing Gradient Inversion Attacks in Federated Learning via Hierarchical Feature Optimizationcited by 2
- 2026Bypassing Copyright Protection in Diffusion-based Customization via Two-Stage Latent Feature Optimizationcited by 2
- 2025Neural Antidote: Class-Wise Prompt Tuning for Purifying Backdoors in CLIPcited by 1
- 2025Revisiting the Privacy Risks of Split Inference: A GAN-Based Data Reconstruction Attack via Progressive Feature Optimizationcited by 0
- 2026A Path Integral Surrogate for Multi-Step Gradient Inversion in Federated Learning2 Oct 2026
- 2026Bypassing Copyright Protection in Diffusion-based Customization via Two-Stage Latent Feature Optimization6 Jun 2026
- 2026Enhancing Gradient Inversion Attacks in Federated Learning via Hierarchical Feature Optimization1 Apr 2026
- 2025FedMPDD: Communication-Efficient Federated Learning with Privacy Preservation Attributes via Projected Directional Derivative23 Dec 2025
- 2025Trajectory-Aware Information Matching for Multi-Step Gradient Inversion in Federated Learning26 Sep 2025
- 2025MAGIA: Sensing Per-Image Signals from Single-Round Averaged Gradients for Label-Inference-Free Gradient Inversion17 Sep 2025
- 2025Revisiting the Privacy Risks of Split Inference: A GAN-Based Data Reconstruction Attack via Progressive Feature Optimization28 Aug 2025
- 2025Revisiting Backdoor Attacks on LLMs: A Stealthy and Practical Poisoning Framework via Harmless Inputs23 May 2025
- 2025Exploring the Vulnerabilities of Federated Learning: A Deep Dive into Gradient Inversion Attacks13 Mar 2025
- 2025Neural Antidote: Class-Wise Prompt Tuning for Purifying Backdoors in CLIP26 Feb 2025
- 2024Editable-DeepSC: Reliable Cross-Modal Semantic Communications for Facial Editing24 Nov 2024
- 2024A Closer Look at GAN Priors: Exploiting Intermediate Features for Enhanced Model Inversion Attacks18 Jul 2024
- 2024CLIP-Guided Generative Networks for Transferable Targeted Adversarial Attackscited by 19
- 2024A Closer Look at GAN Priors: Exploiting Intermediate Features for Enhanced Model Inversion Attackscited by 18
- 2025Exploring the Vulnerabilities of Federated Learning: A Deep Dive into Gradient Inversion Attackscited by 9
- 2024Editable-DeepSC: Reliable Cross-Modal Semantic Communications for Facial Editingcited by 3
- 2025Trajectory-Aware Information Matching for Multi-Step Gradient Inversion in Federated Learningcited by 2
- 2025FedMPDD: Communication-Efficient Federated Learning with Privacy Preservation Attributes via Projected Directional Derivativecited by 2
- 2026Enhancing Gradient Inversion Attacks in Federated Learning via Hierarchical Feature Optimizationcited by 2
- 2025Revisiting the Privacy Risks of Split Inference: A GAN-Based Data Reconstruction Attack via Progressive Feature Optimizationcited by 0
- 2025MAGIA: Sensing Per-Image Signals from Single-Round Averaged Gradients for Label-Inference-Free Gradient Inversioncited by 0
- 2026A Path Integral Surrogate for Multi-Step Gradient Inversion in Federated Learningcited by 0
- 2026A Path Integral Surrogate for Multi-Step Gradient Inversion in Federated Learning2 Oct 2026
- 2026Enhancing Gradient Inversion Attacks in Federated Learning via Hierarchical Feature Optimization1 Apr 2026
- 2025FedMPDD: Communication-Efficient Federated Learning with Privacy Preservation Attributes via Projected Directional Derivative23 Dec 2025
- 2025Trajectory-Aware Information Matching for Multi-Step Gradient Inversion in Federated Learning26 Sep 2025
- 2025MAGIA: Sensing Per-Image Signals from Single-Round Averaged Gradients for Label-Inference-Free Gradient Inversion17 Sep 2025
- 2025Revisiting the Privacy Risks of Split Inference: A GAN-Based Data Reconstruction Attack via Progressive Feature Optimization28 Aug 2025
- 2025Exploring the Vulnerabilities of Federated Learning: A Deep Dive into Gradient Inversion Attacks13 Mar 2025
- 2024Editable-DeepSC: Reliable Cross-Modal Semantic Communications for Facial Editing24 Nov 2024
- 2024A Closer Look at GAN Priors: Exploiting Intermediate Features for Enhanced Model Inversion Attacks18 Jul 2024
- 2024CLIP-Guided Generative Networks for Transferable Targeted Adversarial Attacks14 Jul 2024