NetAdapt: Platform-Aware Neural Network Adaptation for Mobile Applications
Not on the map. Why?
Abstract (arXiv)
This work proposes an algorithm, called NetAdapt, that automatically adapts a pre-trained deep neural network to a mobile platform given a resource budget. While many existing algorithms simplify networks based on the number of MACs or weights, optimizing those indirect metrics may not necessarily reduce the direct metrics, such as latency and energy consumption. To solve this problem, NetAdapt incorporates direct metrics into its adaptation algorithm. These direct metrics are evaluated using empirical measurements, so that detailed knowledge of the platform and toolchain is not required. NetAdapt automatically and progressively simplifies a pre-trained network until the resource budget is met while maximizing the accuracy. Experiment results show that NetAdapt achieves better accuracy versus latency trade-offs on both mobile CPU and mobile GPU, compared with the state-of-the-art automated network simplification algorithms. For image classification on the ImageNet dataset, NetAdapt achieves up to a 1.7× speedup in measured inference latency with equal or higher accuracy on MobileNets (V1&V2).
Key facts. Cited by 146 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Apr 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 59; 2022: 30; 2023: 21; 2024: 10; 2025: 10; 2026: 16.
146 papers.
Sort:
By area:
- 2021A Survey of Quantization Methods for Efficient Neural Network Inferencecited by 798
- 2022EfficientFormer: Vision Transformers at MobileNet Speedcited by 240
- 2023DepGraph: Towards Any Structural Pruningcited by 202
- 2021Split Computing and Early Exiting for Deep Learning Applications: Survey and Research Challengescited by 114
- 2024MobileNetV4 -- Universal Models for the Mobile Ecosystemcited by 98
- 2021A Survey of Modern Deep Learning based Object Detection Modelscited by 97
- 2021Dynamic Slimmable Networkcited by 83
- 2023Full Stack Optimization of Transformer Inference: a Surveycited by 79
- 2021Adaptive Inference through Early-Exit Networks: Design, Challenges and Directionscited by 74
- 2022Vision Transformer Slimming: Multi-Dimension Searching in Continuous Optimization Spacecited by 66
- 2021A Comprehensive Survey on Hardware-Aware Neural Architecture Searchcited by 60
- 2024Efficient Expert Pruning for Sparse Mixture-of-Experts Language Models: Enhancing Performance and Reducing Inference Costscited by 51
38 more
- 2021FedGEMS: Federated Learning of Larger Server Models via Selective Knowledge Fusioncited by 49
- 2022Online Continual Learning for Embedded Devicescited by 48
- 2021Hessian-Aware Pruning and Optimal Neural Implantcited by 43
- 2022Structural Pruning via Latency-Saliency Knapsackcited by 40
- 2024Lightweight Deep Learning for Resource-Constrained Environments: A Surveycited by 38
- 2022CHEX: CHannel EXploration for CNN Model Compressioncited by 36
- 2021Single Image Depth Prediction with Wavelet Decompositioncited by 34
- 2021A Review on Deep Learning in UAV Remote Sensingcited by 32
- 2022Enable Deep Learning on Mobile Devices: Methods, Systems, and Applicationscited by 32
- 2021Topology-Aware Network Pruning using Multi-stage Graph Embedding and Reinforcement Learningcited by 30
- 2021Auto-Split: A General Framework of Collaborative Edge-Cloud AIcited by 29
- 2021GDP: Stabilized Neural Network Pruning via Gates with Differentiable Polarizationcited by 29
- 2021Carrying out CNN Channel Pruning in a White Boxcited by 22
- 2022Compiler-Aware Neural Architecture Search for On-Mobile Real-time Super-Resolutioncited by 20
- 2023AdaptiveNet: Post-deployment Neural Architecture Adaptation for Diverse Edge Environmentscited by 19
- 2021Dynamic-OFA: Runtime DNN Architecture Switching for Performance Scaling on Heterogeneous Embedded Platformscited by 18
- 2021Towards Accurate and Compact Architectures via Neural Architecture Transformercited by 17
- 2021An Information Theory-inspired Strategy for Automatic Network Pruningcited by 17
- 2023Adaptive Sharpness-Aware Pruning for Robust Sparse Networkscited by 17
- 2022Pruning Networks with Cross-Layer Ranking & k-Reciprocal Nearest Filterscited by 16
- 2022PVNAS: 3D Neural Architecture Search with Point-Voxel Convolutioncited by 16
- 2022Lite Pose: Efficient Architecture Design for 2D Human Pose Estimationcited by 16
- 2021Piggyback GAN: Efficient Lifelong Learning for Image Conditioned Generationcited by 14
- 2022Lightweight Monocular Depth Estimation through Guided Decodingcited by 14
- 2021Enabling Design Methodologies and Future Trends for Edge AI: Specialization and Co-designcited by 13
- 2021NetAdaptV2: Efficient Neural Architecture Search with Fast Super-Network Training and Architecture Optimizationcited by 13
- 2021Automated Deep Learning: Neural Architecture Search Is Not the Endcited by 13
- 2021Rethinking Co-design of Neural Architectures and Hardware Acceleratorscited by 12
- 2021Real-time Monocular Depth Estimation with Sparse Supervision on Mobilecited by 12
- 2022Soft Masking for Cost-Constrained Channel Pruningcited by 12
- 2021LANA: Latency Aware Network Accelerationcited by 11
- 2021Learning Versatile Neural Architectures by Propagating Network Codescited by 9
- 2021Searching for Efficient Multi-Stage Vision Transformerscited by 9
- 2021Resource-Efficient Deep Learning: A Survey on Model-, Arithmetic-, and Implementation-Level Techniquescited by 9
- 2023How Sparse Can We Prune A Deep Network: A Fundamental Limit Perspectivecited by 9
- 2023Hardware-Aware DNN Compression via Diverse Pruning and Mixed-Precision Quantizationcited by 9
- 2024Growing Tiny Networks: Spotting Expressivity Bottlenecks and Fixing Them Optimallycited by 9
- 2021Neural Architecture Search as Program Transformation Explorationcited by 8
50 most cited of 146 All 146 (JSON)
- 2026EdgeCraft: Automated Model Crafting for Edge IoT28 Sep 2026
- 2026Beyond Model Size: Redesigning LiSenNet for embedded speech enhancement24 Sep 2026
- 2026Unified Response Geometry for Structured Pruning16 Sep 2026
- 2026Network-Aware Forecasting on Wireless Access Points2 Sep 2026
- 2026Node-wise Feature Encoding for Neural Performance Prediction28 Aug 2026
- 2026Breaking the Compression Barrier: Cross-Architecture Compression Boundary Learning via Reverse Regrowth17 Aug 2026
- 2026MAPLE: MoE Adaptive Plug-and-play Layer-wise Expert allocation15 Aug 2026
- 2026Mitigating Compiler Fusion-Induced Power Bursts in Mobile NPU Inference as the Battery Depletes17 Jul 2026
- 2026EvoLP: Self-Evolving Latency Predictor for Model Compression in Real-Time Edge Systems10 Jul 2026
- 2026Collate: Collaborative Neural Network Learning for Latency-Critical Edge Systems9 Jul 2026
- 2026Latency-Constrained DNN Architecture Learning for Edge Systems using Zerorized Batch Normalization8 Jul 2026
- 2026Adaptive Signal Resuscitation: Channel-wise Post-Pruning Repair for Sparse Vision Networks20 May 2026
38 more
- 2026UA-Net: Uncertainty-Aware Network for TRISO Image Semantic Segmentation16 Apr 2026
- 2026Neural Network Pruning via QUBO Optimization7 Apr 2026
- 2026Routing the Lottery: Adaptive Subnetworks for Heterogeneous Data29 Jan 2026
- 2026Spectral Complex Autoencoder Pruning: A Fidelity-Guided Criterion for Extreme Structured Channel Compression14 Jan 2026
- 2025PlatformX: An End-to-End Transferable Platform for Energy-Efficient Neural Architecture Search10 Oct 2025
- 2025Resource-Aware Neural Network Pruning Using Graph-based Reinforcement Learning4 Sep 2025
- 2025Mobile-Friendly Deep Learning for Plant Disease Detection: A Lightweight CNN Benchmark Across 101 Classes of 33 Crops14 Aug 2025
- 2025ESM: A Framework for Building Effective Surrogate Models for Hardware-Aware Neural Architecture Search2 Aug 2025
- 2025UnIT: Scalable Unstructured Inference-Time Pruning for MAC-efficient Neural Inference on MCUs10 Jul 2025
- 2025Dual Atrous Separable Convolution for Improving Agricultural Semantic Segmentation27 Jun 2025
- 2025Title block detection and information extraction for enhanced building drawings search11 Apr 2025
- 2025MDP: Multidimensional Vision Model Pruning with Latency Constraint2 Apr 2025
- 2025Advancing Weight and Channel Sparsification with Enhanced Saliency5 Feb 2025
- 2025Hardware-Aware DNN Compression for Homogeneous Edge Devices25 Jan 2025
- 2024A framework for measuring the training efficiency of a neural architecture12 Sep 2024
- 2024Revisiting DNN Training for Intermittently-Powered Energy-Harvesting Micro-Computers25 Aug 2024
- 2024(PASS) Visual Prompt Locates Good Structure Sparsity through a Recurrent HyperNetwork24 Jul 2024
- 2024Efficient Expert Pruning for Sparse Mixture-of-Experts Language Models: Enhancing Performance and Reducing Inference Costs1 Jul 2024
- 2024Multi-Dimensional Pruning: Joint Channel, Layer and Block Pruning with Latency Constraint17 Jun 2024
- 2024Growing Tiny Networks: Spotting Expressivity Bottlenecks and Fixing Them Optimally30 May 2024
- 2024MobileNetV4 -- Universal Models for the Mobile Ecosystem16 Apr 2024
- 2024Lightweight Deep Learning for Resource-Constrained Environments: A Survey8 Apr 2024
- 2024Dynamic DNNs and Runtime Management for Efficient Inference on Mobile/Embedded Devices17 Jan 2024
- 2024Fluid Dynamic DNNs for Reliable and Adaptive Distributed Inference on Edge Devices17 Jan 2024
- 2023Hardware-Aware DNN Compression via Diverse Pruning and Mixed-Precision Quantization23 Dec 2023
- 2023SUBP: Soft Uniform Block Pruning for 1xN Sparse CNNs Multithreading Acceleration10 Oct 2023
- 2023Generative Model for Models: Rapid DNN Customization for Diverse Tasks and Resource Constraints29 Aug 2023
- 2023Resource Constrained Model Compression via Minimax Optimization for Spiking Neural Networks9 Aug 2023
- 2023Adaptive Sharpness-Aware Pruning for Robust Sparse Networks25 Jun 2023
- 2023How Sparse Can We Prune A Deep Network: A Fundamental Limit Perspective9 Jun 2023
- 2023End-to-End Neural Network Compression via fracℓ1ℓ2 Regularized Latency Surrogates9 Jun 2023
- 2023Lightweight Monocular Depth Estimation via Token-Sharing Transformer9 Jun 2023
- 2023Detection of Non-uniformity in Parameters for Magnetic Domain Pattern Generation by Machine Learning24 May 2023
- 2023Layer-adaptive Structured Pruning Guided by Latency23 May 2023
- 2023TIPS: Topologically Important Path Sampling for Anytime Neural Networks13 May 2023
- 2023Divide-and-Conquer the NAS puzzle in Resource Constrained Federated Learning Systems11 May 2023
- 2023Learning Accurate Performance Predictors for Ultrafast Automated Model Compression13 Apr 2023
- 2023A Tensor-based Convolutional Neural Network for Small Dataset Classification29 Mar 2023
50 newest of 146 All 146 (JSON)
- 2021A Survey of Quantization Methods for Efficient Neural Network Inferencecited by 798
- 2022EfficientFormer: Vision Transformers at MobileNet Speedcited by 240
- 2023DepGraph: Towards Any Structural Pruningcited by 202
- 2024MobileNetV4 -- Universal Models for the Mobile Ecosystemcited by 98
- 2021A Survey of Modern Deep Learning based Object Detection Modelscited by 97
- 2021Dynamic Slimmable Networkcited by 83
- 2023Full Stack Optimization of Transformer Inference: a Surveycited by 79
- 2022Vision Transformer Slimming: Multi-Dimension Searching in Continuous Optimization Spacecited by 66
- 2021A Comprehensive Survey on Hardware-Aware Neural Architecture Searchcited by 60
- 2021FedGEMS: Federated Learning of Larger Server Models via Selective Knowledge Fusioncited by 49
- 2022Online Continual Learning for Embedded Devicescited by 48
- 2021Hessian-Aware Pruning and Optimal Neural Implantcited by 43
12 most cited of 142 All 142 (JSON)
- 2026EdgeCraft: Automated Model Crafting for Edge IoT28 Sep 2026
- 2026Beyond Model Size: Redesigning LiSenNet for embedded speech enhancement24 Sep 2026
- 2026Unified Response Geometry for Structured Pruning16 Sep 2026
- 2026Network-Aware Forecasting on Wireless Access Points2 Sep 2026
- 2026Node-wise Feature Encoding for Neural Performance Prediction28 Aug 2026
- 2026Breaking the Compression Barrier: Cross-Architecture Compression Boundary Learning via Reverse Regrowth17 Aug 2026
- 2026Mitigating Compiler Fusion-Induced Power Bursts in Mobile NPU Inference as the Battery Depletes17 Jul 2026
- 2026EvoLP: Self-Evolving Latency Predictor for Model Compression in Real-Time Edge Systems10 Jul 2026
- 2026Collate: Collaborative Neural Network Learning for Latency-Critical Edge Systems9 Jul 2026
- 2026Latency-Constrained DNN Architecture Learning for Edge Systems using Zerorized Batch Normalization8 Jul 2026
- 2026Adaptive Signal Resuscitation: Channel-wise Post-Pruning Repair for Sparse Vision Networks20 May 2026
- 2026UA-Net: Uncertainty-Aware Network for TRISO Image Semantic Segmentation16 Apr 2026
12 newest of 142 All 142 (JSON)