HADAS: Hardware-Aware Dynamic Neural Architecture Search for Edge Performance Scaling
Not on the map. Why?
Abstract (arXiv)
Dynamic neural networks (DyNNs) have become viable techniques to enable intelligence on resource-constrained edge devices while maintaining computational efficiency. In many cases, the implementation of DyNNs can be sub-optimal due to its underlying backbone architecture being developed at the design stage independent of both: (i) the dynamic computing features, e.g. early exiting, and (ii) the resource efficiency features of the underlying hardware, e.g., dynamic voltage and frequency scaling (DVFS). Addressing this, we present HADAS, a novel Hardware-Aware Dynamic Neural Architecture Search framework that realizes DyNN architectures whose backbone, early exiting features, and DVFS settings have been jointly optimized to maximize performance and resource efficiency. Our experiments using the CIFAR-100 dataset and a diverse set of edge computing platforms have seen HADAS dynamic models achieve up to 57% energy efficiency gains compared to the conventional dynamic ones while maintaining the desired level of accuracy scores. Our code is available at https://github.com/HalimaBouzidi/HADAS
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 11 of its 17 references that are in the map. First posted on arXiv 6 Dec 2022.
Builds on
11 of 17 references.
References · 11
- 2019Once-for-All: Train One Network and Specialize it for Efficient Deploymentcited by 778
- 2017BranchyNet: Fast Inference via Early Exiting from Deep Neural Networkscited by 591
- 2021Dynamic Neural Networks: A Surveycited by 405
- 2020EdgeBERT: Sentence-Level Energy Optimizations for Latency-Aware Multi-Task NLP Inferencecited by 69
- 2015Conditional Deep Learning for Energy-Efficient and Enhanced Pattern Recognitioncited by 67
- 2020AttentiveNAS: Improving Neural Architecture Search via Attentive Samplingcited by 65
- 2020HAPI: Hardware-Aware Progressive Inferencecited by 30
- 2022Predictive Exit: Prediction of Fine-Grained Early Exits for Computation- and Energy-Efficient Inferencecited by 24
- 2021Dynamic-OFA: Runtime DNN Architecture Switching for Performance Scaling on Heterogeneous Embedded Platformscited by 18
- 2019S2DNAS:Transforming Static CNN Model for Dynamic Inference via Neural Architecture Searchcited by 14
- 2019A Novel Design of Adaptive and Hierarchical Convolutional Neural Networks using Partial Reconfiguration on FPGAcited by 6
Built on by
Citing papers per year: 2023: 3; 2024: 5; 2025: 3; 2026: 3.
14 papers.
Sort:
By area:
- 2023Map-and-Conquer: Energy-Efficient Mapping of Dynamic Neural Nets onto Heterogeneous MPSoCscited by 9
- 2023MaGNAS: A Mapping-Aware Graph Neural Architecture Search Framework for Heterogeneous MPSoC Deploymentcited by 9
- 2024NACHOS: Neural Architecture Search for Hardware Constrained Early Exit Neural Networkscited by 9
- 2023Harmonic-NAS: Hardware-Aware Multimodal Neural Architecture Search on Resource-constrained Devicescited by 8
- 2025HH-PIM: Dynamic Optimization of Power and Performance with Heterogeneous-Hybrid PIM for Edge AI Devicescited by 2
- 2024SONATA: Self-adaptive Evolutionary Framework for Hardware-aware Neural Architecture Searchcited by 1
- 2024CARIn: Constraint-Aware and Responsive Inference on Heterogeneous Devices for Single- and Multi-DNN Workloadscited by 1
- 2025AEBNAS: Strengthening Exit Branches in Early-Exit Networks through Hardware-Aware Neural Architecture Searchcited by 1
- 2024Fluid Dynamic DNNs for Reliable and Adaptive Distributed Inference on Edge Devicescited by 0
- 2024Efficient Post-Training Augmentation for Adaptive Inference in Heterogeneous and Distributed IoT Environmentscited by 0
- 2025Hardware-Algorithm Co-Optimization of Early-Exit Neural Networks for Multi-Core Edge Acceleratorscited by 0
- 2026Efficient Deep Learning for Biometrics: Overview, Challenges and Trends in Ear of Frugal AIcited by 0
- 2026Deep Learning for Anomaly Detection in Railway Systems: A Structured Survey30 Sep 2026
- 2026HERCULES: Hardware-Efficient, Robust, Continual Learning Neural Architecture Search3 May 2026
- 2026Efficient Deep Learning for Biometrics: Overview, Challenges and Trends in Ear of Frugal AI9 Feb 2026
- 2025AEBNAS: Strengthening Exit Branches in Early-Exit Networks through Hardware-Aware Neural Architecture Search11 Dec 2025
- 2025Hardware-Algorithm Co-Optimization of Early-Exit Neural Networks for Multi-Core Edge Accelerators4 Dec 2025
- 2025HH-PIM: Dynamic Optimization of Power and Performance with Heterogeneous-Hybrid PIM for Edge AI Devices2 Apr 2025
- 2024CARIn: Constraint-Aware and Responsive Inference on Heterogeneous Devices for Single- and Multi-DNN Workloads2 Sep 2024
- 2024Efficient Post-Training Augmentation for Adaptive Inference in Heterogeneous and Distributed IoT Environments12 Mar 2024
- 2024SONATA: Self-adaptive Evolutionary Framework for Hardware-aware Neural Architecture Search20 Feb 2024
- 2024NACHOS: Neural Architecture Search for Hardware Constrained Early Exit Neural Networks24 Jan 2024
- 2024Fluid Dynamic DNNs for Reliable and Adaptive Distributed Inference on Edge Devices17 Jan 2024
- 2023Harmonic-NAS: Hardware-Aware Multimodal Neural Architecture Search on Resource-constrained Devices12 Sep 2023
- 2023Map-and-Conquer: Energy-Efficient Mapping of Dynamic Neural Nets onto Heterogeneous MPSoCscited by 9
- 2023MaGNAS: A Mapping-Aware Graph Neural Architecture Search Framework for Heterogeneous MPSoC Deploymentcited by 9
- 2024NACHOS: Neural Architecture Search for Hardware Constrained Early Exit Neural Networkscited by 9
- 2023Harmonic-NAS: Hardware-Aware Multimodal Neural Architecture Search on Resource-constrained Devicescited by 8
- 2025HH-PIM: Dynamic Optimization of Power and Performance with Heterogeneous-Hybrid PIM for Edge AI Devicescited by 2
- 2024SONATA: Self-adaptive Evolutionary Framework for Hardware-aware Neural Architecture Searchcited by 1
- 2024CARIn: Constraint-Aware and Responsive Inference on Heterogeneous Devices for Single- and Multi-DNN Workloadscited by 1
- 2024Fluid Dynamic DNNs for Reliable and Adaptive Distributed Inference on Edge Devicescited by 0
- 2024Efficient Post-Training Augmentation for Adaptive Inference in Heterogeneous and Distributed IoT Environmentscited by 0
- 2025Hardware-Algorithm Co-Optimization of Early-Exit Neural Networks for Multi-Core Edge Acceleratorscited by 0
- 2026Efficient Deep Learning for Biometrics: Overview, Challenges and Trends in Ear of Frugal AIcited by 0
- 2026HERCULES: Hardware-Efficient, Robust, Continual Learning Neural Architecture Searchcited by 0
12 most cited of 13 All 13 (JSON)
- 2026Deep Learning for Anomaly Detection in Railway Systems: A Structured Survey30 Sep 2026
- 2026HERCULES: Hardware-Efficient, Robust, Continual Learning Neural Architecture Search3 May 2026
- 2026Efficient Deep Learning for Biometrics: Overview, Challenges and Trends in Ear of Frugal AI9 Feb 2026
- 2025Hardware-Algorithm Co-Optimization of Early-Exit Neural Networks for Multi-Core Edge Accelerators4 Dec 2025
- 2025HH-PIM: Dynamic Optimization of Power and Performance with Heterogeneous-Hybrid PIM for Edge AI Devices2 Apr 2025
- 2024CARIn: Constraint-Aware and Responsive Inference on Heterogeneous Devices for Single- and Multi-DNN Workloads2 Sep 2024
- 2024Efficient Post-Training Augmentation for Adaptive Inference in Heterogeneous and Distributed IoT Environments12 Mar 2024
- 2024SONATA: Self-adaptive Evolutionary Framework for Hardware-aware Neural Architecture Search20 Feb 2024
- 2024NACHOS: Neural Architecture Search for Hardware Constrained Early Exit Neural Networks24 Jan 2024
- 2024Fluid Dynamic DNNs for Reliable and Adaptive Distributed Inference on Edge Devices17 Jan 2024
- 2023Harmonic-NAS: Hardware-Aware Multimodal Neural Architecture Search on Resource-constrained Devices12 Sep 2023
- 2023MaGNAS: A Mapping-Aware Graph Neural Architecture Search Framework for Heterogeneous MPSoC Deployment16 Jul 2023
12 newest of 13 All 13 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2021A Competitive Edge: Can FPGAs Beat GPUs at DCNN Inference Acceleration in Resource-Limited Edge Computing Applications?
- 2022Fluid Batching: Exit-Aware Preemptive Serving of Early-Exit Neural Networks on Edge NPUs
- 2026A Comparative Study of CNN Optimization Methods for Edge AI: Exploring the Role of Early Exits
- 2026Enabling Spatially Fine-Grained DVFS in Neural Processing Units for Energy-Efficient LLM Serving
- 2023AdaMEC: Towards a Context-Adaptive and Dynamically-Combinable DNN Deployment Framework for Mobile Edge Computing
- 2026EdgeServing: Deadline-Aware Multi-DNN Serving at the Edge
- 2025Enabling Efficient Processing of Spiking Neural Networks with On-Chip Learning on Commodity Neuromorphic Processors for Edge AI Systems
- 2025E4: Energy-Efficient DNN Inference for Edge Video Analytics Via Early-Exit and DVFS