AI Benchmark: Running Deep Neural Networks on Android Smartphones
Not on the map. Why?
Abstract (arXiv)
Over the last years, the computational power of mobile devices such as smartphones and tablets has grown dramatically, reaching the level of desktop computers available not long ago. While standard smartphone apps are no longer a problem for them, there is still a group of tasks that can easily challenge even high-end devices, namely running artificial intelligence algorithms. In this paper, we present a study of the current state of deep learning in the Android ecosystem and describe available frameworks, programming models and the limitations of running AI on smartphones. We give an overview of the hardware acceleration resources available on four main mobile chipset platforms: Qualcomm, HiSilicon, MediaTek and Samsung. Additionally, we present the real-world performance results of different mobile SoCs collected with AI Benchmark that are covering all main existing hardware configurations.
Key facts. Cited by 75 papers in the map (data through 14 Oct 2026). First posted on arXiv 2 Oct 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 26; 2023: 6; 2024: 11; 2025: 7; 2026: 8.
75 papers.
Sort:
By area:
- 2024MELTing point: Mobile Evaluation of Language Transformerscited by 36
- 2022Efficient Split-Mix Federated Learning for On-Demand and In-Situ Customizationcited by 35
- 2021Learned Smartphone ISP on Mobile NPUs with Deep Learning, Mobile AI 2021 Challenge: Reportcited by 34
- 2021Real-Time Quantized Image Super-Resolution on Mobile NPUs, Mobile AI 2021 Challenge: Reportcited by 34
- 2022Enable Deep Learning on Mobile Devices: Methods, Systems, and Applicationscited by 32
- 2023NILUT: Conditional Neural Implicit 3D Lookup Tables for Image Enhancementcited by 31
- 2023DFRD: Data-Free Robustness Distillation for Heterogeneous Federated Learningcited by 24
- 2021EasyFL: A Low-code Federated Learning Platform For Dummiescited by 20
- 2021Fast and Accurate Single-Image Depth Estimation on Mobile Devices, Mobile AI 2021 Challenge: Reportcited by 19
- 2021Real-Time Video Super-Resolution on Smartphones with Deep Learning, Mobile AI 2021 Challenge: Reportcited by 19
- 2021Stacked Deep Multi-Scale Hierarchical Network for Fast Bokeh Effect Rendering from a Single Imagecited by 18
- 2022Perceptual Image Enhancement for Smartphone Real-Time Applicationscited by 18
38 more
- 2023Unveiling Energy Efficiency in Deep Learning: Measurement, Prediction, and Scoring across Edge Devicescited by 17
- 2025PMQ-VE: Progressive Multi-Frame Quantization for Video Enhancementcited by 17
- 2022Efficient and Accurate Quantized Image Super-Resolution on Mobile NPUs, Mobile AI & AIM 2022 challenge: Reportcited by 16
- 2021Fast Camera Image Denoising on Mobile GPUs with Deep Learning, Mobile AI 2021 Challenge: Reportcited by 15
- 2022XRBench: An Extended Reality (XR) Machine Learning Benchmark Suite for the Metaversecited by 14
- 2022Learned Smartphone ISP on Mobile GPUs with Deep Learning, Mobile AI & AIM 2022 Challenge: Reportcited by 13
- 2022MicroISP: Processing 32MP Photos on Mobile Devices with Deep Learningcited by 13
- 2022Benchmarking of DL Libraries and Models on Mobile Devicescited by 12
- 2025MobileIE: An Extremely Lightweight and Effective ConvNet for Real-Time Image Enhancement on Mobile Devicescited by 12
- 2022FIT: A Metric for Model Sensitivitycited by 11
- 2021Fast and Accurate Quantized Camera Scene Detection on Smartphones, Mobile AI 2021 Challenge: Reportcited by 10
- 2021Efficient Softmax Approximation for Deep Neural Networks with Attention Mechanismcited by 9
- 2024Benchmarking Edge AI Platforms for High-Performance ML Inferencecited by 9
- 2022PyNet-V2 Mobile: Efficient On-Device Photo Processing With Neural Networkscited by 7
- 2022Cyclical Pruning for Sparse Neural Networkscited by 6
- 2022Fast Nearest Convolution for Real-Time Efficient Image Super-Resolutioncited by 6
- 2022Fine-Grained Address Segmentation for Attention-Based Variable-Degree Prefetchingcited by 5
- 2022Real-Time Under-Display Cameras Image Restoration and HDR on Mobile Devicescited by 5
- 2023SYENet: A Simple Yet Effective Network for Multiple Low-Level Vision Tasks with Real-time Performance on Mobile Devicecited by 5
- 2021Overparametrization of HyperNetworks at Fixed FLOP-Count Enables Fast Neural Image Enhancementcited by 4
- 2022Efficient Single-Image Depth Estimation on Mobile Devices, Mobile AI & AIM 2022 Challenge: Reportcited by 4
- 2023Towards Optimal Compression: Joint Pruning and Quantizationcited by 4
- 2024Freezing of Gait Detection Using Gramian Angular Fields and Federated Learning from Wearable Sensorscited by 4
- 2024Generative AI on the Edge: Architecture and Performance Evaluationcited by 4
- 2026LLM Inference at the Edge: Mobile, NPU, and GPU Performance Efficiency Trade-offs Under Sustained Loadcited by 4
- 2022Model-based Deep Learning Receiver Design for Rate-Splitting Multiple Accesscited by 3
- 2022Sliding Window Recurrent Network for Efficient Video Super-Resolutioncited by 3
- 2022Power Efficient Video Super-Resolution on Mobile NPUs with Deep Learning, Mobile AI & AIM 2022 challenge: Reportcited by 3
- 2022PriMask: Cascadable and Collusion-Resilient Data Masking for Mobile Cloud Inferencecited by 3
- 2025Sometimes Painful but Certainly Promising: Feasibility and Trade-offs of Language Model Inference at the Edgecited by 3
- 2025Learned Lightweight Smartphone ISP with Unpaired Datacited by 3
- 2021NNStreamer: Efficient and Agile Development of On-Device AI Systemscited by 2
- 2022Realistic Bokeh Effect Rendering on Mobile GPUs, Mobile AI & AIM 2022 challenge: Reportcited by 2
- 2024Learnable Sparse Customization in Heterogeneous Edge Computingcited by 2
- 2024tuGEMM: Area-Power-Efficient Temporal Unary GEMM Architecture for Low-Precision Edge AIcited by 2
- 2021Fast and Accurate Camera Scene Detection on Smartphonescited by 1
- 2021Robustness Analysis of Deep Learning Frameworks on Mobile Platformscited by 1
- 2022CRISPnet: Color Rendition ISP Netcited by 1
50 most cited of 75 All 75 (JSON)
- 2026LightMIS: Ultra-Lightweight Medical Image Segmentation Without a Stage-Wise Decoder23 Sep 2026
- 2026Is INT8 Portable? A Cross-Platform Measurement Study of Quantized Inference on Embedded and Automotive Accelerators14 Sep 2026
- 2026GreenBench: Benchmarking Energy Efficiency and Carbon Footprint of Open-Source LLM Inference on Apple Silicon24 Aug 2026
- 2026FastTPS: An Optimized Method for LLM Token Phase for AI accelerators13 Jul 2026
- 2026Bridging the Training-Deployment Gap: Gated Encoding and Multi-Scale Refinement for Efficient Quantization-Aware Image Enhancement23 Apr 2026
- 2026FastSHADE: Fast Self-augmented Hierarchical Asymmetric Denoising for Efficient inference on mobile devices11 Apr 2026
- 2026Sustainability Is Not Linear: Quantifying Performance, Energy, and Privacy Trade-offs in On-Device Intelligence27 Mar 2026
- 2026LLM Inference at the Edge: Mobile, NPU, and GPU Performance Efficiency Trade-offs Under Sustained Load24 Mar 2026
- 2025On Harnessing Idle Compute at the Edge for Foundation Model Training13 Dec 2025
- 2025Hot-Swap MarkBoard: An Efficient Black-box Watermarking Approach for Large-scale Model Distribution28 Jul 2025
- 2025MobileIE: An Extremely Lightweight and Effective ConvNet for Real-Time Image Enhancement on Mobile Devices2 Jul 2025
- 2025PMQ-VE: Progressive Multi-Frame Quantization for Video Enhancement18 May 2025
38 more
- 2025Learned Lightweight Smartphone ISP with Unpaired Data15 May 2025
- 2025RepNet-VSR: Reparameterizable Architecture for High-Fidelity Video Super-Resolution22 Apr 2025
- 2025Sometimes Painful but Certainly Promising: Feasibility and Trade-offs of Language Model Inference at the Edge12 Mar 2025
- 2024tuGEMM: Area-Power-Efficient Temporal Unary GEMM Architecture for Low-Precision Edge AI23 Dec 2024
- 2024CompactFlowNet: Efficient Real-time Optical Flow Estimation on Mobile Devices17 Dec 2024
- 2024Learnable Sparse Customization in Heterogeneous Edge Computing10 Dec 2024
- 2024Generative AI on the Edge: Architecture and Performance Evaluation18 Nov 2024
- 2024Freezing of Gait Detection Using Gramian Angular Fields and Federated Learning from Wearable Sensors18 Nov 2024
- 2024Benchmarking Edge AI Platforms for High-Performance ML Inference23 Sep 2024
- 2024COMFORT: A Continual Fine-Tuning Framework for Foundation Models Targeted at Consumer Healthcare14 Sep 2024
- 2024MNeRV: A Multilayer Neural Representation for Videos10 Jul 2024
- 2024Energy-Aware Decentralized Learning with Intermittent Model Training1 Jul 2024
- 2024Privacy-Preserving and Trustworthy Deep Learning for Medical Imaging29 Jun 2024
- 2024MELTing point: Mobile Evaluation of Language Transformers19 Mar 2024
- 2023Unveiling Energy Efficiency in Deep Learning: Measurement, Prediction, and Scoring across Edge Devices19 Oct 2023
- 2023DFRD: Data-Free Robustness Distillation for Heterogeneous Federated Learning24 Sep 2023
- 2023SYENet: A Simple Yet Effective Network for Multiple Low-Level Vision Tasks with Real-time Performance on Mobile Device16 Aug 2023
- 2023NILUT: Conditional Neural Implicit 3D Lookup Tables for Image Enhancement20 Jun 2023
- 2023Privacy-Preserving Cooperative Visible Light Positioning for Nonstationary Environment: A Federated Learning Perspective11 Mar 2023
- 2023Towards Optimal Compression: Joint Pruning and Quantization15 Feb 2023
- 2022Comparative Study of Parameter Selection for Enhanced Edge Inference for a Multi-Output Regression model for Head Pose Estimation28 Dec 2022
- 2022Lightweight and Flexible Deep Equilibrium Learning for CSI Feedback in FDD Massive MIMO28 Nov 2022
- 2022Real-Time Under-Display Cameras Image Restoration and HDR on Mobile Devices25 Nov 2022
- 2022XRBench: An Extended Reality (XR) Machine Learning Benchmark Suite for the Metaverse16 Nov 2022
- 2022PriMask: Cascadable and Collusion-Resilient Data Masking for Mobile Cloud Inference12 Nov 2022
- 2022MicroISP: Processing 32MP Photos on Mobile Devices with Deep Learning8 Nov 2022
- 2022PyNet-V2 Mobile: Efficient On-Device Photo Processing With Neural Networks8 Nov 2022
- 2022Realistic Bokeh Effect Rendering on Mobile GPUs, Mobile AI & AIM 2022 challenge: Report7 Nov 2022
- 2022Efficient and Accurate Quantized Image Super-Resolution on Mobile NPUs, Mobile AI & AIM 2022 challenge: Report7 Nov 2022
- 2022Power Efficient Video Super-Resolution on Mobile NPUs with Deep Learning, Mobile AI & AIM 2022 challenge: Report7 Nov 2022
- 2022Efficient Single-Image Depth Estimation on Mobile Devices, Mobile AI & AIM 2022 Challenge: Report7 Nov 2022
- 2022Learned Smartphone ISP on Mobile GPUs with Deep Learning, Mobile AI & AIM 2022 Challenge: Report7 Nov 2022
- 2022Perceptual Image Enhancement for Smartphone Real-Time Applications24 Oct 2022
- 2022FIT: A Metric for Model Sensitivity16 Oct 2022
- 2022An Overview of the Data-Loader Landscape: Comparative Performance Analysis27 Sep 2022
- 2022LiteDepth: Digging into Fast and Accurate Depth Estimation on Mobile Devices2 Sep 2022
- 2022Fast Nearest Convolution for Real-Time Efficient Image Super-Resolution24 Aug 2022
- 2022Sliding Window Recurrent Network for Efficient Video Super-Resolution24 Aug 2022
50 newest of 75 All 75 (JSON)
- 2024MELTing point: Mobile Evaluation of Language Transformerscited by 36
- 2022Efficient Split-Mix Federated Learning for On-Demand and In-Situ Customizationcited by 35
- 2021Learned Smartphone ISP on Mobile NPUs with Deep Learning, Mobile AI 2021 Challenge: Reportcited by 34
- 2021Real-Time Quantized Image Super-Resolution on Mobile NPUs, Mobile AI 2021 Challenge: Reportcited by 34
- 2022Enable Deep Learning on Mobile Devices: Methods, Systems, and Applicationscited by 32
- 2023NILUT: Conditional Neural Implicit 3D Lookup Tables for Image Enhancementcited by 31
- 2023DFRD: Data-Free Robustness Distillation for Heterogeneous Federated Learningcited by 24
- 2021EasyFL: A Low-code Federated Learning Platform For Dummiescited by 20
- 2021Fast and Accurate Single-Image Depth Estimation on Mobile Devices, Mobile AI 2021 Challenge: Reportcited by 19
- 2021Real-Time Video Super-Resolution on Smartphones with Deep Learning, Mobile AI 2021 Challenge: Reportcited by 19
- 2021Stacked Deep Multi-Scale Hierarchical Network for Fast Bokeh Effect Rendering from a Single Imagecited by 18
- 2022Perceptual Image Enhancement for Smartphone Real-Time Applicationscited by 18
12 most cited of 74 All 74 (JSON)
- 2026LightMIS: Ultra-Lightweight Medical Image Segmentation Without a Stage-Wise Decoder23 Sep 2026
- 2026Is INT8 Portable? A Cross-Platform Measurement Study of Quantized Inference on Embedded and Automotive Accelerators14 Sep 2026
- 2026GreenBench: Benchmarking Energy Efficiency and Carbon Footprint of Open-Source LLM Inference on Apple Silicon24 Aug 2026
- 2026FastTPS: An Optimized Method for LLM Token Phase for AI accelerators13 Jul 2026
- 2026Bridging the Training-Deployment Gap: Gated Encoding and Multi-Scale Refinement for Efficient Quantization-Aware Image Enhancement23 Apr 2026
- 2026FastSHADE: Fast Self-augmented Hierarchical Asymmetric Denoising for Efficient inference on mobile devices11 Apr 2026
- 2026Sustainability Is Not Linear: Quantifying Performance, Energy, and Privacy Trade-offs in On-Device Intelligence27 Mar 2026
- 2026LLM Inference at the Edge: Mobile, NPU, and GPU Performance Efficiency Trade-offs Under Sustained Load24 Mar 2026
- 2025On Harnessing Idle Compute at the Edge for Foundation Model Training13 Dec 2025
- 2025MobileIE: An Extremely Lightweight and Effective ConvNet for Real-Time Image Enhancement on Mobile Devices2 Jul 2025
- 2025PMQ-VE: Progressive Multi-Frame Quantization for Video Enhancement18 May 2025
- 2025Learned Lightweight Smartphone ISP with Unpaired Data15 May 2025
12 newest of 74 All 74 (JSON)