# NeuralPower: Predict and Deploy Energy-Efficient Convolutional Neural Networks

arXiv: https://arxiv.org/abs/1710.05420 · HTML: https://mlsanity.com/paper/1710.05420/

## Key facts

- Cited by 30 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 15 Oct 2017.

## Built on by (most cited first, 30 of 30)

- [Trustworthy AI: A Computational Perspective](https://mlsanity.com/paper/2107.06641/) (2021)
- [A Systematic Review of Green AI](https://mlsanity.com/paper/2301.11047/) (2023)
- [Compute and Energy Consumption Trends in Deep Learning Inference](https://mlsanity.com/paper/2109.05472/) (2021)
- [Evaluation Gaps in Machine Learning Practice](https://mlsanity.com/paper/2205.05256/) (2022)
- [AutoFL: Enabling Heterogeneity-Aware Energy Efficient Federated Learning](https://mlsanity.com/paper/2107.08147/) (2021)
- [Multi-Agent Geospatial Copilots for Remote Sensing Workflows](https://mlsanity.com/paper/2501.16254/) (2025)
- [Measuring the Energy Consumption and Efficiency of Deep Neural Networks: An Empirical Analysis and Design Recommendations](https://mlsanity.com/paper/2403.08151/) (2024)
- [Accuracy is not the only Metric that matters: Estimating the Energy Consumption of Deep Learning Models](https://mlsanity.com/paper/2304.00897/) (2023)
- [One Proxy Device Is Enough for Hardware-Aware Neural Architecture Search](https://mlsanity.com/paper/2111.01203/) (2021)
- [Enhancing Energy-Awareness in Deep Learning through Fine-Grained Energy Measurement](https://mlsanity.com/paper/2308.12264/) (2023)
- [perf4sight: A toolflow to model CNN training performance on Edge GPUs](https://mlsanity.com/paper/2108.05580/) (2021)
- [Enabling All In-Edge Deep Learning: A Literature Review](https://mlsanity.com/paper/2204.03326/) (2022)
- [QAPPA: Quantization-Aware Power, Performance, and Area Modeling of DNN Accelerators](https://mlsanity.com/paper/2205.08648/) (2022)
- [FCOS: A Two-Stage Recoverable Model Pruning Framework for Automatic Modulation Recognition](https://mlsanity.com/paper/2505.21571/) (2025)
- [QADAM: Quantization-Aware DNN Accelerator Modeling for Pareto-Optimality](https://mlsanity.com/paper/2205.13045/) (2022)
- [PruMUX: Augmenting Data Multiplexing with Model Compression](https://mlsanity.com/paper/2305.14706/) (2023)
- [Evaluating the Energy Consumption of Machine Learning: Systematic Literature Review and Experiments](https://mlsanity.com/paper/2408.15128/) (2024)
- [A Transistor Operations Model for Deep Learning Energy Consumption Scaling Law](https://mlsanity.com/paper/2205.15062/) (2022)
- [QUIDAM: A Framework for Quantization-Aware DNN Accelerator and Model Co-Exploration](https://mlsanity.com/paper/2206.15463/) (2022)
- [ANNETTE: Accurate Neural Network Execution Time Estimation with Stacked Models](https://mlsanity.com/paper/2105.03176/) (2021)
- [Tensor-Aware Energy Accounting](https://mlsanity.com/paper/2311.11424/) (2023)
- [AdaScale: Dynamic Context-aware DNN Scaling via Automated Adaptation Loop on Mobile Devices](https://mlsanity.com/paper/2412.00724/) (2024)
- [Kernel-Level Energy-Efficient Neural Architecture Search for Tabular Dataset](https://mlsanity.com/paper/2504.08359/) (2025)
- [Automated Customization of On-Thing Inference for Quality-of-Experience Enhancement](https://mlsanity.com/paper/2112.06918/) (2021)
- [Puzzle: Scheduling Multiple Deep Learning Models on Mobile Device with Heterogeneous Processors](https://mlsanity.com/paper/2508.17764/) (2025)
- [XiYOLO: Energy-Aware Object Detection via Iterative Architecture Search and Scaling](https://mlsanity.com/paper/2605.06927/) (2026)
- [WattLayer: Get Layers Right to Estimate Inference Energy of Neural Networks](https://mlsanity.com/paper/2606.27841/) (2026)
- [CARB: A Characterization-Guided Framework for CNN Inference Cost Prediction and Deployment Screening](https://mlsanity.com/paper/2608.10506/) (2026)
- [LLM-Powered Predictive Decision-Making for Sustainable Data Center Operations](https://mlsanity.com/paper/2608.18503/) (2026)
- [Node-wise Feature Encoding for Neural Performance Prediction](https://mlsanity.com/paper/2608.27794/) (2026)

## Abstract (arXiv)

"How much energy is consumed for an inference made by a convolutional neural network (CNN)?" With the increased popularity of CNNs deployed on the wide-spectrum of platforms (from mobile devices to workstations), the answer to this question has drawn significant attention. From lengthening battery life of mobile devices to reducing the energy bill of a datacenter, it is important to understand the energy efficiency of CNNs during serving for making an inference, before actually training the model. In this work, we propose NeuralPower: a layer-wise predictive framework based on sparse polynomial regression, for predicting the serving energy consumption of a CNN deployed on any GPU platform. Given the architecture of a CNN, NeuralPower provides an accurate prediction and breakdown for power and runtime across all layers in the whole network, helping machine learners quickly identify the power, runtime, or energy bottlenecks. We also propose the "energy-precision ratio" (EPR) metric to guide machine learners in selecting an energy-efficient CNN architecture that better trades off the energy consumption and prediction accuracy. The experimental results show that the prediction accuracy of the proposed NeuralPower outperforms the best published model to date, yielding an improvement in accuracy of up to 68.5%. We also assess the accuracy of predictions at the network level, by predicting the runtime, power, and energy of state-of-the-art CNN architectures, achieving an average accuracy of 88.24% in runtime, 88.34% in power, and 97.21% in energy. We comprehensively corroborate the effectiveness of NeuralPower as a powerful framework for machine learners by testing it on different GPU platforms and Deep Learning software tools.