mlsanityData to 14 Oct 2026

GI-NAS: Boosting Gradient Inversion Attacks Through Adaptive Neural Architecture Search

arXiv 2405.20725 ↗First posted 31 May 2024cs.AI cs.CVcited by 14

Not on the map. Why?

Abstract (arXiv)

Gradient Inversion Attacks invert the transmitted gradients in Federated Learning (FL) systems to reconstruct the sensitive data of local clients and have raised considerable privacy concerns. A majority of gradient inversion methods rely heavily on explicit prior knowledge (e.g., a well pre-trained generative model), which is often unavailable in realistic scenarios. This is because real-world client data distributions are often highly heterogeneous, domain-specific, and unavailable to attackers, making it impractical for attackers to obtain perfectly matched pre-trained models, which inevitably suffer from fundamental distribution shifts relative to target private data. To alleviate this issue, researchers have proposed to leverage the implicit prior knowledge of an over-parameterized network. However, they only utilize a fixed neural architecture for all the attack settings. This would hinder the adaptive use of implicit architectural priors and consequently limit the generalizability. In this paper, we further exploit such implicit prior knowledge by proposing Gradient Inversion via Neural Architecture Search (GI-NAS), which adaptively searches the network and captures the implicit priors behind neural architectures. Extensive experiments verify that our proposed GI-NAS can achieve superior attack performance compared to state-of-the-art gradient inversion methods, even under more practical settings with high-resolution images, large-sized batches, and advanced defense strategies. To the best of our knowledge, we are the first to successfully introduce NAS to the gradient inversion community. We believe that this work exposes critical vulnerabilities in real-world federated learning by demonstrating high-fidelity reconstruction of sensitive data without requiring domain-specific priors, forcing urgent reassessment of FL privacy safeguards.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 48 of its 79 references that are in the map. First posted on arXiv 31 May 2024.

Builds on

48 of 79 references.

References · 48

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  6. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  7. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  8. 2022Generative Adversarial Networkscited by 5,627
  9. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
  10. 2016Neural Architecture Search with Reinforcement Learningcited by 1,499
  11. 2017Deep Image Priorcited by 1,098
  12. 2019Deep Leakage from Gradientscited by 1,021
36 more
  1. 2020Inverting Gradients -- How easy is it to break privacy in federated learning?cited by 712
  2. 2018ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardwarecited by 673
  3. 2017Generative Adversarial Networks: An Overviewcited by 590
  4. 2018Exploiting Unintended Feature Leakage in Collaborative Learningcited by 520
  5. 2017Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Trainingcited by 478
  6. 2017Differentially Private Federated Learning: A Client Level Perspectivecited by 459
  7. 2020iDLG: Improved Deep Leakage from Gradientscited by 382
  8. 2020FLTrust: Byzantine-robust Federated Learning via Trust Bootstrappingcited by 346
  9. 2021See through Gradients: Image Batch Recovery via GradInversioncited by 326
  10. 2018SNAS: Stochastic Neural Architecture Searchcited by 289
  11. 2016Designing Neural Network Architectures using Reinforcement Learningcited by 279
  12. 2019Auto-DeepLab: Hierarchical Neural Architecture Search for Semantic Image Segmentationcited by 260
  13. 2017Sparse Communication for Distributed Gradient Descentcited by 249
  14. 2021Evaluating Gradient Inversion Attacks and Defenses in Federated Learningcited by 196
  15. 2020Threats to Federated Learning: A Surveycited by 178
  16. 2023Heterogeneous Federated Learning: State-of-the-art and Research Challengescited by 161
  17. 2020Feature Inference Attack on Model Predictions in Vertical Federated Learningcited by 106
  18. 2021Gradient Inversion with Generative Image Priorcited by 101
  19. 2020R-GAP: Recursive Gradient Attack on Privacycited by 97
  20. 2017Evolving Deep Neural Networkscited by 95
  21. 2020Provable Defense against Privacy Leakage in Federated Learning from Representation Perspectivecited by 94
  22. 2022Auditing Privacy Defenses in Federated Learning via Generative Gradient Leakagecited by 72
  23. 2019Fast, Accurate and Lightweight Super-Resolution with Neural Architecture Searchcited by 66
  24. 2019A Bayesian Perspective on the Deep Image Priorcited by 52
  25. 2023GIFD: A Generative Gradient Inversion Method with Feature Domain Optimizationcited by 45
  26. 2021Gradient-Leakage Resilient Federated Learningcited by 40
  27. 2022A Survey on Gradient Inversion: Attacks, Defenses and Future Directionscited by 40
  28. 2018Fast Neural Architecture Search of Compact Semantic Segmentation Models via Auxiliary Cellscited by 39
  29. 2022Training-free Transformer Architecture Searchcited by 33
  30. 2020NAS-DIP: Learning Deep Image Prior with Neural Architecture Searchcited by 20
  31. 2018Exploiting the Potential of Standard Convolutional Autoencoders for Image Restoration by Evolutionary Searchcited by 19
  32. 2016Survey on the attention based RNN model and its applications in computer visioncited by 15
  33. 2021ISNAS-DIP: Image-Specific Neural Architecture Search for Deep Image Priorcited by 12
  34. 2023The Devil is in the Upsampling: Architectural Decisions Made Simpler for Denoising with Deep Image Priorcited by 11
  35. 2018MaskConnect: Connectivity Learning by Gradient Descentcited by 9
  36. 2023Training-free Neural Architecture Search for RNNs and Transformerscited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 4; 2025: 7; 2026: 3.

14 papers.

Sort:

By area:

  1. 2024One Perturbation is Enough: On Generating Universal Adversarial Perturbations against Vision-Language Pre-training Modelscited by 40
  2. 2024CLIP-Guided Generative Networks for Transferable Targeted Adversarial Attackscited by 19
  3. 2024A Closer Look at GAN Priors: Exploiting Intermediate Features for Enhanced Model Inversion Attackscited by 18
  4. 2025Revisiting Backdoor Attacks on LLMs: A Stealthy and Practical Poisoning Framework via Harmless Inputscited by 10
  5. 2025Exploring the Vulnerabilities of Federated Learning: A Deep Dive into Gradient Inversion Attackscited by 9
  6. 2024Editable-DeepSC: Reliable Cross-Modal Semantic Communications for Facial Editingcited by 3
  7. 2025Trajectory-Aware Information Matching for Multi-Step Gradient Inversion in Federated Learningcited by 2
  8. 2025FedMPDD: Communication-Efficient Federated Learning with Privacy Preservation Attributes via Projected Directional Derivativecited by 2
  9. 2026Enhancing Gradient Inversion Attacks in Federated Learning via Hierarchical Feature Optimizationcited by 2
  10. 2026Bypassing Copyright Protection in Diffusion-based Customization via Two-Stage Latent Feature Optimizationcited by 2
  11. 2025Neural Antidote: Class-Wise Prompt Tuning for Purifying Backdoors in CLIPcited by 1
  12. 2025Revisiting the Privacy Risks of Split Inference: A GAN-Based Data Reconstruction Attack via Progressive Feature Optimizationcited by 0
2 more
  1. 2025MAGIA: Sensing Per-Image Signals from Single-Round Averaged Gradients for Label-Inference-Free Gradient Inversioncited by 0
  2. 2026A Path Integral Surrogate for Multi-Step Gradient Inversion in Federated Learningcited by 0