mlsanityData to 14 Oct 2026

SNAC-Pack 2.0: Scaled-Out Surrogate Neural Architecture Codesign

arXiv 2605.16138 ↗First posted 15 May 2026cs.LG cs.AI hep-excited by 0

Not on the map. Why?

Abstract (arXiv)

Neural architecture search (NAS) is a powerful approach for automating model design, but existing methods often optimize for accuracy alone or rely on proxy metrics such as bit operations (BOPs) that correlate poorly with hardware cost. This gap is particularly large for FPGA deployment, where cost is dominated by a multi-dimensional budget of lookup tables, DSPs, flip-flops, BRAM, and latency. We present the Surrogate Neural Architecture Codesign Package (SNAC-Pack), an open-source AutoML framework for hardware-aware neural architecture codesign and end-to-end FPGA deployment. SNAC-Pack runs a multi-objective global search with Optuna and NSGA-II, loading trials to a shared SQLite store that enables parallel workers across compute nodes. A hardware surrogate model outputs per-trial resource and latency estimates, avoiding the synthesis cost that would otherwise dominate the search loop. A local search stage then applies quantization-aware training (QAT) together with iterative magnitude pruning in a combined compression loop, after which the final model is synthesized to FPGA firmware via the hls4ml Python library. A YAML configuration and an optional agentic frontend let users run the pipeline on new datasets without modifying the framework. We demonstrate SNAC-Pack on jet classification at the Large Hadron Collider and superconducting qubit readout, discovering compact Pareto-optimal architectures that either match baseline task performance while reducing FPGA resource utilization or substantially reduce hardware utilization with only modest decreases in task performance. In the qubit readout case, SNAC-Pack also reduces the design space exploration process from months of manual fine-tuning to hours of automated search.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 42 references that are in the map. First posted on arXiv 15 May 2026.

Builds on

31 of 42 references.

References · 31

  1. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
  2. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
  3. 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,329
  4. 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,262
  5. 2018DARTS: Differentiable Architecture Searchcited by 1,798
  6. 2018MnasNet: Platform-Aware Neural Architecture Search for Mobilecited by 943
  7. 2018Efficient Neural Architecture Search via Parameter Sharingcited by 837
  8. 2019Once-for-All: Train One Network and Specialize it for Efficient Deploymentcited by 787
  9. 2018ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardwarecited by 673
  10. 2019Linear Mode Connectivity and the Lottery Ticket Hypothesiscited by 637
  11. 2018FBNet: Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture Searchcited by 485
  12. 2018Efficient Multi-objective Neural Architecture Search via Lamarckian Evolutioncited by 153
19 more
  1. 2020A Survey on Evolutionary Neural Architecture Searchcited by 142
  2. 2018Fast inference of deep neural networks in FPGAs for particle physicscited by 133
  3. 2020BRP-NAS: Prediction-based NAS using GCNscited by 111
  4. 2019FLAML: A Fast and Lightweight AutoML Librarycited by 106
  5. 2020APQ: Joint Search for Network Architecture, Pruning and Quantization Policycited by 99
  6. 2021HW-NAS-Bench:Hardware-Aware Neural Architecture Search Benchmarkcited by 84
  7. 2019Accuracy vs. Efficiency: Achieving Both through FPGA-Implementation Aware Neural Architecture Searchcited by 38
  8. 2024AutoGluon-Multimodal (AutoMM): Supercharging Multimodal AutoML with Foundation Modelscited by 30
  9. 2022High-Level Synthesis Performance Prediction using GNNs: Benchmarking, Modeling, and Advancingcited by 26
  10. 2021Neural Network Quantization for Efficient Inference: A Surveycited by 14
  11. 2024AutoMMLab: Automatically Generating Deployable Models from Language Instructions for Computer Vision Taskscited by 14
  12. 2024Ultrafast jet classification on FPGAs for the HL-LHCcited by 12
  13. 2025hls4ml: A Flexible, Open-Source Platform for Deep Learning Acceleration on Reconfigurable Hardwarecited by 9
  14. 2025End-to-end workflow for machine learning-based qubit readout with QICK and hls4mlcited by 8
  15. 2024On Latency Predictors for Neural Architecture Searchcited by 7
  16. 2024Multi-Objective Hardware Aware Neural Architecture Search using Hardware Cost Diversitycited by 5
  17. 2025Neural Architecture Codesign for Fast Physics Applicationscited by 5
  18. 2024rule4ml: An Open-Source Tool for Resource Utilization and Latency Estimation for ML Models on FPGAcited by 3
  19. 2025wa-hls4ml: A Benchmark and Surrogate Models for hls4ml Resource and Latency Estimationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Hardware-Aware Neural Network Compilation with Learned Optimization: A RISC-V Accelerator Approach
  2. 2022HQNAS: Auto CNN deployment framework for joint quantization and architecture search
  3. 2021HAO: Hardware-aware neural Architecture Optimization for Efficient Inference
  4. 2026Transformer-Guided Swarm Intelligence for Frugal Neural Architecture Search
  5. 2026NAS-Driven Hardware Accelerator Exploration for Edge AI and Quantization Effects on the Pareto Space
  6. 2026PrototypeNAS: Rapid Design of Deep Neural Networks for Microcontroller Units
  7. 2025CIMNAS: A Joint Framework for Compute-In-Memory-Aware Neural Architecture Search
  8. 2026VQ4SNN: Vector Quantization for Memory-Efficient FPGA Spiking Neural Networks