AI Benchmark: All About Deep Learning on Smartphones in 2019
Not on the map. Why?
Abstract (arXiv)
The performance of mobile AI accelerators has been evolving rapidly in the past two years, nearly doubling with each new generation of SoCs. The current 4th generation of mobile NPUs is already approaching the results of CUDA-compatible Nvidia graphics cards presented not long ago, which together with the increased capabilities of mobile deep learning frameworks makes it possible to run complex and deep AI models on mobile devices. In this paper, we evaluate the performance and compare the results of all chipsets from Qualcomm, HiSilicon, Samsung, MediaTek and Unisoc that are providing hardware acceleration for AI inference. We also discuss the recent changes in the Android ML pipeline and provide an overview of the deployment of deep learning models on mobile devices. All numerical results provided in this paper can be found and are regularly updated on the official project website: http://ai-benchmark.com.
Key facts. Cited by 77 papers in the map (data through 14 Oct 2026). First posted on arXiv 15 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 29; 2022: 20; 2023: 11; 2024: 8; 2025: 6; 2026: 3.
77 papers.
Sort:
By area:
- 2021Pruning and Quantization for Deep Neural Network Acceleration: A Surveycited by 263
- 2021FjORD: Fair and Accurate Federated Learning under heterogeneous targets with Ordered Dropoutcited by 192
- 2021FedScale: Benchmarking Model and System Performance of Federated Learning at Scalecited by 136
- 2021Adaptive Inference through Early-Exit Networks: Design, Challenges and Directionscited by 75
- 2022Client Selection in Federated Learning: Principles, Challenges, and Opportunitiescited by 62
- 2021Shallow Bayesian Meta Learning for Real-World Few-Shot Recognitioncited by 48
- 2021Learned Smartphone ISP on Mobile NPUs with Deep Learning, Mobile AI 2021 Challenge: Reportcited by 34
- 2021Real-Time Quantized Image Super-Resolution on Mobile NPUs, Mobile AI 2021 Challenge: Reportcited by 34
- 2025Sustainable LLM Inference for Edge AI: Evaluating Quantized LLMs for Energy Efficiency, Output Accuracy, and Inference Latencycited by 34
- 2021Extremely Lightweight Quantization Robust Real-Time Single-Image Super Resolution for Mobile Devicescited by 30
- 2023TimelyFL: Heterogeneity-aware Asynchronous Federated Learning with Adaptive Partial Trainingcited by 27
- 2021Smart at what cost? Characterising Mobile Deep Neural Networks in the wildcited by 25
38 more
- 2021Anchor-based Plain Net for Mobile Image Super-Resolutioncited by 24
- 2021Fast and Accurate Single-Image Depth Estimation on Mobile Devices, Mobile AI 2021 Challenge: Reportcited by 19
- 2021Real-Time Video Super-Resolution on Smartphones with Deep Learning, Mobile AI 2021 Challenge: Reportcited by 19
- 2021It's always personal: Using Early Exits for Efficient On-Device CNN Personalisationcited by 18
- 2021DynO: Dynamic Onloading of Deep Neural Networks from Cloud to Devicecited by 18
- 2021Multi-Exit Semantic Segmentation Networkscited by 18
- 2023Unveiling Energy Efficiency in Deep Learning: Measurement, Prediction, and Scoring across Edge Devicescited by 17
- 2022Efficient and Accurate Quantized Image Super-Resolution on Mobile NPUs, Mobile AI & AIM 2022 challenge: Reportcited by 16
- 2021Fast Camera Image Denoising on Mobile GPUs with Deep Learning, Mobile AI 2021 Challenge: Reportcited by 15
- 2021Layer Pruning on Demand with Intermediate CTCcited by 13
- 2022Learned Smartphone ISP on Mobile GPUs with Deep Learning, Mobile AI & AIM 2022 Challenge: Reportcited by 13
- 2022MicroISP: Processing 32MP Photos on Mobile Devices with Deep Learningcited by 13
- 2024LF-ViT: Reducing Spatial Redundancy in Vision Transformer for Efficient Image Recognitioncited by 13
- 2022Benchmarking of DL Libraries and Models on Mobile Devicescited by 12
- 2022FastML Science Benchmarks: Accelerating Real-Time Scientific Edge Machine Learningcited by 12
- 2021Fast and Accurate Quantized Camera Scene Detection on Smartphones, Mobile AI 2021 Challenge: Reportcited by 10
- 2023Energy-Latency Attacks to On-Device Neural Networks via Sponge Poisoningcited by 10
- 2024Understanding Large Language Models in Your Pockets: Performance Study on COTS Mobile Devicescited by 10
- 2021Personalized Semi-Supervised Federated Learning for Human Activity Recognitioncited by 9
- 2021Deep Neural Network-based Enhancement for Image and Video Streaming Systems: A Survey and Future Directionscited by 9
- 2022Learning Symbolic Model-Agnostic Loss Functions via Meta-Learningcited by 9
- 2021One Proxy Device Is Enough for Hardware-Aware Neural Architecture Searchcited by 8
- 2022Partial Model Averaging in Federated Learning: Performance Guarantees and Benefitscited by 8
- 2021OODIn: An Optimised On-Device Inference Framework for Heterogeneous Mobile Devicescited by 7
- 2022TT-NF: Tensor Train Neural Fieldscited by 7
- 2022PyNet-V2 Mobile: Efficient On-Device Photo Processing With Neural Networkscited by 7
- 2022Fast Nearest Convolution for Real-Time Efficient Image Super-Resolutioncited by 6
- 2023Sparse-DySta: Sparsity-Aware Dynamic and Static Scheduling for Sparse Multi-DNN Workloadscited by 6
- 2023SYENet: A Simple Yet Effective Network for Multiple Low-Level Vision Tasks with Real-time Performance on Mobile Devicecited by 5
- 2022FedorAS: Federated Architecture Search under system heterogeneitycited by 4
- 2022Efficient Single-Image Depth Estimation on Mobile Devices, Mobile AI & AIM 2022 Challenge: Reportcited by 4
- 2023EPAM: A Predictive Energy Model for Mobile AIcited by 4
- 2022Sliding Window Recurrent Network for Efficient Video Super-Resolutioncited by 3
- 2022Bokeh-Loss GAN: Multi-Stage Adversarial Training for Realistic Edge-Aware Bokehcited by 3
- 2022Power Efficient Video Super-Resolution on Mobile NPUs with Deep Learning, Mobile AI & AIM 2022 challenge: Reportcited by 3
- 2021How to Reach Real-Time AI on Consumer Devices? Solutions for Programmable and Custom Architecturescited by 2
- 2022Adaptive Edge Offloading for Image Classification Under Rate Limitcited by 2
- 2022Realistic Bokeh Effect Rendering on Mobile GPUs, Mobile AI & AIM 2022 challenge: Reportcited by 2
50 most cited of 77 All 77 (JSON)
- 2026Is INT8 Portable? A Cross-Platform Measurement Study of Quantized Inference on Embedded and Automotive Accelerators14 Sep 2026
- 2026Meta-Reinforcement Learning via Evolution for Multi-Objective Combinatorial Supply Chain Optimisation20 Jun 2026
- 2026Bridging the Training-Deployment Gap: Gated Encoding and Multi-Scale Refinement for Efficient Quantization-Aware Image Enhancement23 Apr 2026
- 2025SMoFi: Step-wise Momentum Fusion for Split Federated Learning on Heterogeneous Data13 Nov 2025
- 2025FLAMMABLE: A Multi-Model Federated Learning Framework with Multi-Model Engagement and Adaptive Batch Sizes12 Oct 2025
- 2025RepNet-VSR: Reparameterizable Architecture for High-Fidelity Video Super-Resolution22 Apr 2025
- 2025Sustainable LLM Inference for Edge AI: Evaluating Quantized LLMs for Energy Efficiency, Output Accuracy, and Inference Latency4 Apr 2025
- 2025Accelerating MoE Model Inference with Expert Sharding11 Mar 2025
- 2025SAC-ViT: Semantic-Aware Clustering Vision Transformer with Early Exit27 Feb 2025
- 2024Convex Distillation: Efficient Compression of Deep Networks via Convex Optimization9 Oct 2024
- 2024Understanding Large Language Models in Your Pockets: Performance Study on COTS Mobile Devices4 Oct 2024
- 2024CARIn: Constraint-Aware and Responsive Inference on Heterogeneous Devices for Single- and Multi-DNN Workloads2 Sep 2024
38 more
- 2024Harnessing Increased Client Participation with Cohort-Parallel Federated Learning24 May 2024
- 2024FedTrans: Efficient Federated Learning via Multi-Model Transformation21 Apr 2024
- 2024IoTCO2: Assessing the End-To-End Carbon Footprint of Internet-of-Things-Enabled Deep Learning16 Mar 2024
- 2024Fast and Efficient Local Search for Genetic Programming Based Loss Function Learning1 Mar 2024
- 2024LF-ViT: Reducing Spatial Redundancy in Vision Transformer for Efficient Image Recognition8 Jan 2024
- 2023Venn: Resource Management for Collaborative Learning Jobs13 Dec 2023
- 2023Unveiling Energy Efficiency in Deep Learning: Measurement, Prediction, and Scoring across Edge Devices19 Oct 2023
- 2023Sparse-DySta: Sparsity-Aware Dynamic and Static Scheduling for Sparse Multi-DNN Workloads17 Oct 2023
- 2023Quantization of Neural Network Equalizers in Optical Fiber Transmission Experiments9 Sep 2023
- 2023SYENet: A Simple Yet Effective Network for Multiple Low-Level Vision Tasks with Real-time Performance on Mobile Device16 Aug 2023
- 2023Mitigating Memory Wall Effects in CNN Engines with On-the-Fly Weights Generation25 Jul 2023
- 2023Energy-Latency Attacks to On-Device Neural Networks via Sponge Poisoning6 May 2023
- 2023TimelyFL: Heterogeneity-aware Asynchronous Federated Learning with Adaptive Partial Training14 Apr 2023
- 2023EPAM: A Predictive Energy Model for Mobile AI2 Mar 2023
- 2023Towards Implementing Energy-aware Data-driven Intelligence for Smart Health Applications on Mobile Platforms1 Feb 2023
- 2023MIGPerf: A Comprehensive Benchmark for Deep Learning Training and Inference Workloads on Multi-Instance GPUs1 Jan 2023
- 2022NAWQ-SR: A Hybrid-Precision NPU Engine for Efficient On-Device Super-Resolution15 Dec 2022
- 2022MicroISP: Processing 32MP Photos on Mobile Devices with Deep Learning8 Nov 2022
- 2022PyNet-V2 Mobile: Efficient On-Device Photo Processing With Neural Networks8 Nov 2022
- 2022Realistic Bokeh Effect Rendering on Mobile GPUs, Mobile AI & AIM 2022 challenge: Report7 Nov 2022
- 2022Efficient and Accurate Quantized Image Super-Resolution on Mobile NPUs, Mobile AI & AIM 2022 challenge: Report7 Nov 2022
- 2022Power Efficient Video Super-Resolution on Mobile NPUs with Deep Learning, Mobile AI & AIM 2022 challenge: Report7 Nov 2022
- 2022Efficient Single-Image Depth Estimation on Mobile Devices, Mobile AI & AIM 2022 Challenge: Report7 Nov 2022
- 2022Learned Smartphone ISP on Mobile GPUs with Deep Learning, Mobile AI & AIM 2022 Challenge: Report7 Nov 2022
- 2022Client Selection in Federated Learning: Principles, Challenges, and Opportunities3 Nov 2022
- 2022TT-NF: Tensor Train Neural Fields30 Sep 2022
- 2022Learning Symbolic Model-Agnostic Loss Functions via Meta-Learning19 Sep 2022
- 2022LiteDepth: Digging into Fast and Accurate Depth Estimation on Mobile Devices2 Sep 2022
- 2022Bokeh-Loss GAN: Multi-Stage Adversarial Training for Realistic Edge-Aware Bokeh25 Aug 2022
- 2022Fast Nearest Convolution for Real-Time Efficient Image Super-Resolution24 Aug 2022
- 2022Sliding Window Recurrent Network for Efficient Video Super-Resolution24 Aug 2022
- 2022Adaptive Edge Offloading for Image Classification Under Rate Limit31 Jul 2022
- 2022FastML Science Benchmarks: Accelerating Real-Time Scientific Edge Machine Learning16 Jul 2022
- 2022FedorAS: Federated Architecture Search under system heterogeneity22 Jun 2022
- 2022Benchmarking of DL Libraries and Models on Mobile Devices14 Feb 2022
- 2022Partial Model Averaging in Federated Learning: Performance Guarantees and Benefits11 Jan 2022
- 2021Machines & Influence: An Information Systems Lens26 Nov 2021
- 2021One Proxy Device Is Enough for Hardware-Aware Neural Architecture Search1 Nov 2021
50 newest of 77 All 77 (JSON)
- 2025Accelerating MoE Model Inference with Expert Shardingcited by 0
- 2025Accelerating MoE Model Inference with Expert Sharding11 Mar 2025
- 2021Pruning and Quantization for Deep Neural Network Acceleration: A Surveycited by 263
- 2021FjORD: Fair and Accurate Federated Learning under heterogeneous targets with Ordered Dropoutcited by 192
- 2021FedScale: Benchmarking Model and System Performance of Federated Learning at Scalecited by 136
- 2022Client Selection in Federated Learning: Principles, Challenges, and Opportunitiescited by 62
- 2021Shallow Bayesian Meta Learning for Real-World Few-Shot Recognitioncited by 48
- 2021Learned Smartphone ISP on Mobile NPUs with Deep Learning, Mobile AI 2021 Challenge: Reportcited by 34
- 2021Real-Time Quantized Image Super-Resolution on Mobile NPUs, Mobile AI 2021 Challenge: Reportcited by 34
- 2025Sustainable LLM Inference for Edge AI: Evaluating Quantized LLMs for Energy Efficiency, Output Accuracy, and Inference Latencycited by 34
- 2021Extremely Lightweight Quantization Robust Real-Time Single-Image Super Resolution for Mobile Devicescited by 30
- 2023TimelyFL: Heterogeneity-aware Asynchronous Federated Learning with Adaptive Partial Trainingcited by 27
- 2021Smart at what cost? Characterising Mobile Deep Neural Networks in the wildcited by 25
- 2021Anchor-based Plain Net for Mobile Image Super-Resolutioncited by 24
12 most cited of 74 All 74 (JSON)
- 2026Is INT8 Portable? A Cross-Platform Measurement Study of Quantized Inference on Embedded and Automotive Accelerators14 Sep 2026
- 2026Bridging the Training-Deployment Gap: Gated Encoding and Multi-Scale Refinement for Efficient Quantization-Aware Image Enhancement23 Apr 2026
- 2025SMoFi: Step-wise Momentum Fusion for Split Federated Learning on Heterogeneous Data13 Nov 2025
- 2025FLAMMABLE: A Multi-Model Federated Learning Framework with Multi-Model Engagement and Adaptive Batch Sizes12 Oct 2025
- 2025RepNet-VSR: Reparameterizable Architecture for High-Fidelity Video Super-Resolution22 Apr 2025
- 2025Sustainable LLM Inference for Edge AI: Evaluating Quantized LLMs for Energy Efficiency, Output Accuracy, and Inference Latency4 Apr 2025
- 2025SAC-ViT: Semantic-Aware Clustering Vision Transformer with Early Exit27 Feb 2025
- 2024Convex Distillation: Efficient Compression of Deep Networks via Convex Optimization9 Oct 2024
- 2024Understanding Large Language Models in Your Pockets: Performance Study on COTS Mobile Devices4 Oct 2024
- 2024CARIn: Constraint-Aware and Responsive Inference on Heterogeneous Devices for Single- and Multi-DNN Workloads2 Sep 2024
- 2024Harnessing Increased Client Participation with Cohort-Parallel Federated Learning24 May 2024
- 2024FedTrans: Efficient Federated Learning via Multi-Model Transformation21 Apr 2024
12 newest of 74 All 74 (JSON)