mlsanityData to 14 Oct 2026

Multi-conditioned Graph Diffusion for Neural Architecture Search

arXiv 2403.06020 ↗First posted 9 Mar 2024cs.LG cs.CVcited by 14

Not on the map. Why?

Abstract (arXiv)

Neural architecture search automates the design of neural network architectures usually by exploring a large and thus complex architecture search space. To advance the architecture search, we present a graph diffusion-based NAS approach that uses discrete conditional graph diffusion processes to generate high-performing neural network architectures. We then propose a multi-conditioned classifier-free guidance approach applied to graph diffusion networks to jointly impose constraints such as high accuracy and low hardware latency. Unlike the related work, our method is completely differentiable and requires only a single model training. In our evaluations, we show promising results on six standard benchmarks, yielding novel and unique architectures at a fast speed, i.e. less than 0.2 seconds per architecture. Furthermore, we demonstrate the generalisability and efficiency of our method through experiments on ImageNet dataset.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 50 of its 64 references that are in the map. First posted on arXiv 9 Mar 2024.

Builds on

50 of 64 references.

References · 50

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  5. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  7. 2022Classifier-Free Diffusion Guidancecited by 5,847
  8. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  9. 2019Searching for MobileNetV3cited by 1,994
  10. 2018DARTS: Differentiable Architecture Searchcited by 1,798
  11. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
  12. 2016Neural Architecture Search with Reinforcement Learningcited by 1,499
38 more
  1. 2017Learning Transferable Architectures for Scalable Image Recognitioncited by 1,101
  2. 2018Regularized Evolution for Image Classifier Architecture Searchcited by 909
  3. 2018Efficient Neural Architecture Search via Parameter Sharingcited by 837
  4. 2022Equivariant Diffusion for Molecule Generation in 3Dcited by 677
  5. 2020A Generalization of Transformer Networks to Graphscited by 661
  6. 2022DiGress: Discrete Denoising diffusion for graph generationcited by 520
  7. 2018FBNet: Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture Searchcited by 485
  8. 2020NAS-Bench-201: Extending the Scope of Reproducible Neural Architecture Searchcited by 416
  9. 2017Large-Scale Evolution of Image Classifierscited by 348
  10. 2019NAS-Bench-101: Towards Reproducible Neural Architecture Searchcited by 344
  11. 2015Scalable Bayesian Optimization Using Deep Neural Networkscited by 284
  12. 2016Designing Neural Network Architectures using Reinforcement Learningcited by 279
  13. 2019Random Search and Reproducibility for Neural Architecture Searchcited by 254
  14. 2017SMASH: One-Shot Model Architecture Search through HyperNetworkscited by 202
  15. 2019BANANAS: Bayesian Optimization with Neural Architectures for Neural Architecture Searchcited by 179
  16. 2018Auto-Keras: An Efficient Neural Architecture Search Systemcited by 171
  17. 2021Neural Architecture Search on ImageNet in Four GPU Hours: A Theoretically Inspired Perspectivecited by 169
  18. 2018Neural Architecture Optimizationcited by 167
  19. 2019D-VAE: A Variational Autoencoder for Directed Acyclic Graphscited by 98
  20. 2021HW-NAS-Bench:Hardware-Aware Neural Architecture Search Benchmarkcited by 84
  21. 2020DrNAS: Dirichlet Neural Architecture Searchcited by 73
  22. 2022β-DARTS: Beta-Decay Regularization for Differentiable Architecture Searchcited by 64
  23. 2020NAS-Bench-NLP: Neural Architecture Search Benchmark for Natural Language Processingcited by 60
  24. 2020Does Unsupervised Architecture Representation Learning Help Neural Architecture Search?cited by 59
  25. 2020ISTA-NAS: Efficient and Consistent Neural Architecture Search by Sparse Codingcited by 36
  26. 2021Rapid Neural Architecture Search by Learning to Generate Graphs from Datasetscited by 33
  27. 2020Sample-Efficient Automated Deep Reinforcement Learningcited by 32
  28. 2021Stronger NAS with Weaker Predictorscited by 28
  29. 2020Off-Policy Reinforcement Learning for Efficient and Effective GAN Architecture Searchcited by 25
  30. 2019Multi-Objective Reinforced Evolution in Mobile Neural Architecture Searchcited by 24
  31. 2020Exploring the Loss Landscape in Neural Architecture Searchcited by 20
  32. 2021NAS-Bench-x11 and the Power of Learning Curvescited by 20
  33. 2021Searching by Generating: Flexible and Efficient One-Shot NAS with Architecture Generatorcited by 15
  34. 2022Learning Where To Look -- Generative NAS is Surprisingly Efficientcited by 15
  35. 2022An Invertible Graph Diffusion Neural Network for Source Localizationcited by 14
  36. 2020Smooth Variational Graph Embeddings for Efficient Neural Architecture Searchcited by 12
  37. 2021Generative Adversarial Neural Architecture Searchcited by 9
  38. 2023Conditioning Diffusion Models via Attributes and Semantic Masks for Face Generationcited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 3; 2025: 6; 2026: 5.

14 papers.

Sort:

By area:

  1. 2024Diffusion Model Guided Sampling with Pixel-Wise Aleatoric Uncertainty Estimationcited by 20
  2. 2024Generative Modelling of Structurally Constrained Graphscited by 19
  3. 2025Pluggable Pruning with Contiguous Layer Distillation for Diffusion Transformerscited by 7
  4. 2026Principled Latent Diffusion for Graphs via Laplacian Autoencoderscited by 4
  5. 2025Generating Directed Graphs with Dual Attention and Asymmetric Encodingcited by 3
  6. 2024Designing a Classifier for Active Fire Detection from Multispectral Satellite Imagery Using Neural Architecture Searchcited by 2
  7. 2026Detecting and Mitigating Memorization in Diffusion Models through Anisotropy of the Log-Probabilitycited by 2
  8. 2025Probabilistic Graph Circuits: Deep Generative Models for Tractable Probabilistic Inference over Graphscited by 1
  9. 2025Evolution Meets Diffusion: Efficient Neural Architecture Generationcited by 1
  10. 2025Dextr: Zero-Shot Neural Architecture Search with Singular Value Decomposition and Extrinsic Curvaturecited by 1
  11. 2025OptiProxy-NAS: Optimization Proxy based End-to-End Neural Architecture Searchcited by 0
  12. 2026GraDE: A Graph Diffusion Estimator for Frequent Subgraph Discovery in Neural Architecturescited by 0
2 more
  1. 2026DGPO: RL-Steered Graph Diffusion for Neural Architecture Generationcited by 0
  2. 2026Efficient Graph Generation via Direct Prediction and Flow Matchingcited by 0