# Neural Architecture Design for GPU-Efficient Networks

arXiv: https://arxiv.org/abs/2006.14090 · HTML: https://mlsanity.com/paper/2006.14090/

## Key facts

- Cited by 13 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 24 Jun 2020.

## Built on by (most cited first, 13 of 13)

- [YOLOv10: Real-Time End-to-End Object Detection](https://mlsanity.com/paper/2405.14458/) (2024)
- [Combined Depth Space based Architecture Search For Person Re-identification](https://mlsanity.com/paper/2104.04163/) (2021)
- [What Can We Learn From The Selective Prediction And Uncertainty Estimation Performance Of 523 Imagenet Classifiers](https://mlsanity.com/paper/2302.11874/) (2023)
- [CNN Filter DB: An Empirical Investigation of Trained Convolutional Filters](https://mlsanity.com/paper/2203.15331/) (2022)
- [FAST: Faster Arbitrarily-Shaped Text Detector with Minimalist Kernel Representation](https://mlsanity.com/paper/2111.02394/) (2021)
- [Deepbet: Fast brain extraction of T1-weighted MRI using Convolutional Neural Networks](https://mlsanity.com/paper/2308.07003/) (2023)
- [Making EfficientNet More Efficient: Exploring Batch-Independent Normalization, Group Convolutions and Reduced Resolution Training](https://mlsanity.com/paper/2106.03640/) (2021)
- [Improving Normalization with the James-Stein Estimator](https://mlsanity.com/paper/2312.00313/) (2023)
- [Maximizing Spatio-Temporal Entropy of Deep 3D CNNs for Efficient Video Recognition](https://mlsanity.com/paper/2303.02693/) (2023)
- [Which models are innately best at uncertainty estimation?](https://mlsanity.com/paper/2206.02152/) (2022)
- [depyf: Open the Opaque Box of PyTorch Compiler for Machine Learning Researchers](https://mlsanity.com/paper/2403.13839/) (2024)
- [Tiered Pruning for Efficient Differentialble Inference-Aware Neural Architecture Search](https://mlsanity.com/paper/2209.11785/) (2022)
- [ShellfishNet: A Domain-Specific Benchmark for Visual Recognition of Marine Molluscs](https://mlsanity.com/paper/2605.07338/) (2026)

## Abstract (arXiv)

Many mission-critical systems are based on GPU for inference. It requires not only high recognition accuracy but also low latency in responding time. Although many studies are devoted to optimizing the structure of deep models for efficient inference, most of them do not leverage the architecture of modern GPU for fast inference, leading to suboptimal performance. To address this issue, we propose a general principle for designing GPU-efficient networks based on extensive empirical studies. This design principle enables us to search for GPU-efficient network structures effectively by a simple and lightweight method as opposed to most Neural Architecture Search (NAS) methods that are complicated and computationally expensive. Based on the proposed framework, we design a family of GPU-Efficient Networks, or GENets in short. We did extensive evaluations on multiple GPU platforms and inference engines. While achieving ≥ 81.3% top-1 accuracy on ImageNet, GENet is up to 6.4 times faster than EfficienNet on GPU. It also outperforms most state-of-the-art models that are more efficient than EfficientNet in high precision regimes. Our source code and pre-trained models are available from urlhttps://github.com/idstcv/GPU-Efficient-Networks.