Accelerator-aware Neural Network Design using AutoML
Not on the map. Why?
Abstract (arXiv)
While neural network hardware accelerators provide a substantial amount of raw compute throughput, the models deployed on them must be co-designed for the underlying hardware architecture to obtain the optimal system performance. We present a class of computer vision models designed using hardware-aware neural architecture search and customized to run on the Edge TPU, Google's neural network hardware accelerator for low-power, edge devices. For the Edge TPU in Coral devices, these models enable real-time image classification performance while achieving accuracy typically seen only with larger, compute-heavy models running in data centers. On Pixel 4's Edge TPU, these models improve the accuracy-latency tradeoff over existing SoTA mobile models.
Key facts. Cited by 30 papers in the map (data through 14 Oct 2026). First posted on arXiv 5 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 8; 2023: 7; 2024: 6.
30 papers.
Sort:
By area:
- 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,135
- 2021A Comprehensive Survey on Hardware-Aware Neural Architecture Searchcited by 61
- 2023Making AI Less "Thirsty": Uncovering and Addressing the Secret Water Footprint of AI Modelscited by 44
- 2024Lightweight Deep Learning for Resource-Constrained Environments: A Surveycited by 38
- 2021Data-Driven Offline Optimization For Architecting Hardware Acceleratorscited by 29
- 2021Apollo: Transferable Architecture Explorationcited by 17
- 2021Rethinking Co-design of Neural Architectures and Hardware Acceleratorscited by 12
- 2023Towards Environmentally Equitable AI via Geographical Load Balancingcited by 10
- 2023CAFE: Carbon-Aware Federated Learning in Geographically Distributed Data Centerscited by 6
- 2022Searching for Efficient Neural Architectures for On-Device ML on Edge TPUscited by 4
- 2022QAPPA: Quantization-Aware Power, Performance, and Area Modeling of DNN Acceleratorscited by 4
- 2023PerfSAGE: Generalized Inference Performance Predictor for Arbitrary Deep Learning Models on Edge Devicescited by 4
18 more
- 2024Realtime Facial Expression Recognition: Neuromorphic Hardware vs. Edge AI Acceleratorscited by 4
- 2024Evaluating Pre-trained Convolutional Neural Networks and Foundation Models as Feature Extractors for Content-based Medical Image Retrievalcited by 4
- 2021Deep Learning on Edge TPUscited by 3
- 2022QADAM: Quantization-Aware DNN Accelerator Modeling for Pareto-Optimalitycited by 3
- 2021FuSeConv: Fully Separable Convolutions for Fast Inference on Systolic Arrayscited by 2
- 2022U-Boost NAS: Utilization-Boosted Differentiable Neural Architecture Searchcited by 2
- 2022Revisiting Architecture-aware Knowledge Distillation: Smaller Models and Faster Searchcited by 2
- 2022QUIDAM: A Framework for Quantization-Aware DNN Accelerator and Model Co-Explorationcited by 2
- 2021Design and Scaffolded Training of an Efficient DNN Operator for Computer Vision on the Edgecited by 1
- 2021ISyNet: Convolutional Neural Networks design for AI acceleratorcited by 1
- 2022Hardware-aware mobile building block evaluation for computer visioncited by 1
- 2023SequeL: A Continual Learning Library in PyTorch and JAXcited by 1
- 2023Comparison between transformers and convolutional models for fine-grained classification of insectscited by 1
- 2024Performance of computer vision algorithms for fine-grained classification using crowdsourced insect imagescited by 1
- 2022Tech Report: One-stage Lightweight Object Detectorscited by 0
- 2023Enabling Hard Constraints in Differentiable Neural Network and Accelerator Co-Explorationcited by 0
- 2024Accel-NASBench: Sustainable Benchmarking for Accelerator-Aware NAScited by 0
- 2024Efficient Deep Learning Board: Training Feedback Is Not All You Needcited by 0
- 2024Efficient Deep Learning Board: Training Feedback Is Not All You Need17 Oct 2024
- 2024Evaluating Pre-trained Convolutional Neural Networks and Foundation Models as Feature Extractors for Content-based Medical Image Retrieval14 Sep 2024
- 2024Accel-NASBench: Sustainable Benchmarking for Accelerator-Aware NAS9 Apr 2024
- 2024Lightweight Deep Learning for Resource-Constrained Environments: A Survey8 Apr 2024
- 2024Performance of computer vision algorithms for fine-grained classification using crowdsourced insect images4 Apr 2024
- 2024Realtime Facial Expression Recognition: Neuromorphic Hardware vs. Edge AI Accelerators30 Jan 2024
- 2023CAFE: Carbon-Aware Federated Learning in Geographically Distributed Data Centers6 Nov 2023
- 2023Comparison between transformers and convolutional models for fine-grained classification of insects20 Jul 2023
- 2023Towards Environmentally Equitable AI via Geographical Load Balancing20 Jun 2023
- 2023SequeL: A Continual Learning Library in PyTorch and JAX21 Apr 2023
- 2023Making AI Less "Thirsty": Uncovering and Addressing the Secret Water Footprint of AI Models6 Apr 2023
- 2023PerfSAGE: Generalized Inference Performance Predictor for Arbitrary Deep Learning Models on Edge Devices26 Jan 2023
18 more
- 2023Enabling Hard Constraints in Differentiable Neural Network and Accelerator Co-Exploration23 Jan 2023
- 2022Tech Report: One-stage Lightweight Object Detectors31 Oct 2022
- 2022Hardware-aware mobile building block evaluation for computer vision26 Aug 2022
- 2022QUIDAM: A Framework for Quantization-Aware DNN Accelerator and Model Co-Exploration30 Jun 2022
- 2022Revisiting Architecture-aware Knowledge Distillation: Smaller Models and Faster Search27 Jun 2022
- 2022QADAM: Quantization-Aware DNN Accelerator Modeling for Pareto-Optimality20 May 2022
- 2022QAPPA: Quantization-Aware Power, Performance, and Area Modeling of DNN Accelerators17 May 2022
- 2022Searching for Efficient Neural Architectures for On-Device ML on Edge TPUs9 Apr 2022
- 2022U-Boost NAS: Utilization-Boosted Differentiable Neural Architecture Search23 Mar 2022
- 2021Data-Driven Offline Optimization For Architecting Hardware Accelerators20 Oct 2021
- 2021ISyNet: Convolutional Neural Networks design for AI accelerator4 Sep 2021
- 2021Deep Learning on Edge TPUs31 Aug 2021
- 2021Design and Scaffolded Training of an Efficient DNN Operator for Computer Vision on the Edge25 Aug 2021
- 2021FuSeConv: Fully Separable Convolutions for Fast Inference on Systolic Arrays27 May 2021
- 2021EfficientNetV2: Smaller Models and Faster Training1 Apr 2021
- 2021Rethinking Co-design of Neural Architectures and Hardware Accelerators17 Feb 2021
- 2021Apollo: Transferable Architecture Exploration2 Feb 2021
- 2021A Comprehensive Survey on Hardware-Aware Neural Architecture Search22 Jan 2021
- 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,135
- 2021A Comprehensive Survey on Hardware-Aware Neural Architecture Searchcited by 61
- 2023Making AI Less "Thirsty": Uncovering and Addressing the Secret Water Footprint of AI Modelscited by 44
- 2024Lightweight Deep Learning for Resource-Constrained Environments: A Surveycited by 38
- 2021Data-Driven Offline Optimization For Architecting Hardware Acceleratorscited by 29
- 2021Apollo: Transferable Architecture Explorationcited by 17
- 2021Rethinking Co-design of Neural Architectures and Hardware Acceleratorscited by 12
- 2023Towards Environmentally Equitable AI via Geographical Load Balancingcited by 10
- 2023CAFE: Carbon-Aware Federated Learning in Geographically Distributed Data Centerscited by 6
- 2022Searching for Efficient Neural Architectures for On-Device ML on Edge TPUscited by 4
- 2022QAPPA: Quantization-Aware Power, Performance, and Area Modeling of DNN Acceleratorscited by 4
- 2023PerfSAGE: Generalized Inference Performance Predictor for Arbitrary Deep Learning Models on Edge Devicescited by 4
12 most cited of 29 All 29 (JSON)
- 2024Efficient Deep Learning Board: Training Feedback Is Not All You Need17 Oct 2024
- 2024Evaluating Pre-trained Convolutional Neural Networks and Foundation Models as Feature Extractors for Content-based Medical Image Retrieval14 Sep 2024
- 2024Accel-NASBench: Sustainable Benchmarking for Accelerator-Aware NAS9 Apr 2024
- 2024Lightweight Deep Learning for Resource-Constrained Environments: A Survey8 Apr 2024
- 2024Performance of computer vision algorithms for fine-grained classification using crowdsourced insect images4 Apr 2024
- 2024Realtime Facial Expression Recognition: Neuromorphic Hardware vs. Edge AI Accelerators30 Jan 2024
- 2023CAFE: Carbon-Aware Federated Learning in Geographically Distributed Data Centers6 Nov 2023
- 2023Comparison between transformers and convolutional models for fine-grained classification of insects20 Jul 2023
- 2023Towards Environmentally Equitable AI via Geographical Load Balancing20 Jun 2023
- 2023SequeL: A Continual Learning Library in PyTorch and JAX21 Apr 2023
- 2023Making AI Less "Thirsty": Uncovering and Addressing the Secret Water Footprint of AI Models6 Apr 2023
- 2023PerfSAGE: Generalized Inference Performance Predictor for Arbitrary Deep Learning Models on Edge Devices26 Jan 2023
12 newest of 29 All 29 (JSON)