mlsanityData to 7 Oct 2026

Mobiprox: Supporting Dynamic Approximate Computing on Mobiles

arXiv 2303.11291 ↗First posted 16 Mar 2023cs.LG cs.SY eess.SYcited by 0

Not on the map. Why?

Abstract (arXiv)

Runtime-tunable context-dependent network compression would make mobile deep learning (DL) adaptable to often varying resource availability, input "difficulty", or user needs. The existing compression techniques significantly reduce the memory, processing, and energy tax of DL, yet, the resulting models tend to be permanently impaired, sacrificing the inference power for reduced resource usage. The existing tunable compression approaches, on the other hand, require expensive re-training, do not support arbitrary strategies for adapting the compression and do not provide mobile-ready implementations. In this paper we present Mobiprox, a framework enabling mobile DL with flexible precision. Mobiprox implements tunable approximations of tensor operations and enables runtime-adaptable approximation of individual network layers. A profiler and a tuner included with Mobiprox identify the most promising neural network approximation configurations leading to the desired inference quality with the minimal use of resources. Furthermore, we develop control strategies that depending on contextual factors, such as the input data difficulty, dynamically adjust the approximation levels across a mobile DL model's layers. We implement Mobiprox in Android OS and through experiments in diverse mobile domains, including human activity recognition and spoken keyword detection, demonstrate that it can save up to 15% system-wide energy with a minimal impact on the inference accuracy.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 68 references that are in the map. First posted on arXiv 16 Mar 2023.

Builds on

28 of 68 references.

References · 28

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  2. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  3. 2017On Calibration of Modern Neural Networkscited by 4,860
  4. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
  5. 2017ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devicescited by 1,194
  6. 2018Speech Commands: A Dataset for Limited-Vocabulary Speech Recognitioncited by 741
  7. 2017BranchyNet: Fast Inference via Early Exiting from Deep Neural Networkscited by 591
  8. 2018AMC: AutoML for Model Compression and Acceleration on Mobile Devicescited by 375
  9. 2018Slimmable Neural Networkscited by 301
  10. 2017A Survey of Model Compression and Acceleration for Deep Neural Networkscited by 298
  11. 2015Quantized Convolutional Neural Networks for Mobile Devicescited by 212
  12. 2018Dynamic Channel Pruning: Feature Boosting and Suppressioncited by 129
16 more
  1. 2020SPINN: Synergistic Progressive Inference of Neural Networks over Device and Cloudcited by 109
  2. 2020PatDNN: Achieving Real-Time DNN Execution on Mobile Devices with Pattern-based Weight Pruningcited by 75
  3. 2016T-CNN: Tubelets with Convolutional Neural Networks for Object Detection from Videoscited by 67
  4. 2017Adaptive Quantization for Deep Neural Networkcited by 67
  5. 2019AdaBits: Neural Network Quantization with Adaptive Bit-Widthscited by 63
  6. 2018A First Look at Deep Learning Apps on Smartphonescited by 47
  7. 2019Any-Precision Deep Neural Networkscited by 39
  8. 2017DeepIoT: Compressing Deep Neural Network Structures for Sensing Systems with a Compressor-Critic Frameworkcited by 22
  9. 2019EmBench: Quantifying Performance Variations of Deep Neural Networks across Modern Commodity Devicescited by 21
  10. 2015PerforatedCNNs: Acceleration through Elimination of Redundant Convolutionscited by 17
  11. 2023Automatic Attention Pruning: Improving and Automating Model Pruning using Attentionscited by 11
  12. 2021Resource-Efficient Deep Learning: A Survey on Model-, Arithmetic-, and Implementation-Level Techniquescited by 9
  13. 2017CLBlast: A Tuned OpenCL BLAS Librarycited by 8
  14. 2017Honk: A PyTorch Reimplementation of Convolutional Neural Networks for Keyword Spottingcited by 6
  15. 2017DeepRebirth: Accelerating Deep Neural Network Execution on Mobile Devicescited by 4
  16. 2021Robustness in Compressed Neural Networks for Object Detectioncited by 4

Built on by

Not cited yet.