Full-Cycle Energy Consumption Benchmark for Low-Carbon Computer Vision
Not on the map. Why?
Abstract (arXiv)
The energy consumption of deep learning models is increasing at a breathtaking rate, which raises concerns due to potential negative effects on carbon neutrality in the context of global warming and climate change. With the progress of efficient deep learning techniques, e.g., model compression, researchers can obtain efficient models with fewer parameters and smaller latency. However, most of the existing efficient deep learning methods do not explicitly consider energy consumption as a key performance indicator. Furthermore, existing methods mostly focus on the inference costs of the resulting efficient models, but neglect the notable energy consumption throughout the entire life cycle of the algorithm. In this paper, we present the first large-scale energy consumption benchmark for efficient computer vision models, where a new metric is proposed to explicitly evaluate the full-cycle energy consumption under different model usage intensity. The benchmark can provide insights for low carbon emission when selecting efficient deep learning algorithms in different model usage scenarios.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 36 of its 56 references that are in the map. First posted on arXiv 30 Aug 2021.
Builds on
36 of 56 references.
References · 36
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2018Deep contextualized word representationscited by 2,285
- 2016Identity Mappings in Deep Residual Networkscited by 1,960
- 2018DARTS: Differentiable Architecture Searchcited by 1,782
- 2014FitNets: Hints for Thin Deep Netscited by 1,619
- 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
- 2016Pruning Filters for Efficient ConvNetscited by 1,129
- 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,059
- 2019Relational Knowledge Distillationcited by 873
24 more
- 2018Efficient Neural Architecture Search via Parameter Sharingcited by 831
- 2019Once-for-All: Train One Network and Specialize it for Efficient Deploymentcited by 778
- 2019Contrastive Representation Distillationcited by 734
- 2018ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardwarecited by 666
- 2019Green AIcited by 620
- 2021Carbon Emissions and Large Neural Network Trainingcited by 561
- 2019Importance Estimation for Neural Network Pruningcited by 531
- 2019Similarity-Preserving Knowledge Distillationcited by 507
- 2017Progressive Neural Architecture Searchcited by 483
- 2018Filter Pruning via Geometric Median for Deep Convolutional Neural Networks Accelerationcited by 365
- 2017Large-Scale Evolution of Image Classifierscited by 348
- 2019Variational Information Distillation for Knowledge Transfercited by 321
- 2019Correlation Congruence for Knowledge Distillationcited by 280
- 2020ZeroQ: A Novel Zero Shot Quantization Frameworkcited by 265
- 2019Tackling Climate Change with Machine Learningcited by 264
- 2018Paraphrasing Complex Network: Network Compression via Factor Transfercited by 255
- 2018Knowledge Transfer via Distillation of Activation Boundaries Formed by Hidden Neuronscited by 235
- 2016Network Trimming: A Data-Driven Neuron Pruning Approach towards Efficient Deep Architecturescited by 220
- 2020pymoo: Multi-objective Optimization in Pythoncited by 196
- 2019Low-bit Quantization of Neural Networks for Efficient Inferencecited by 185
- 2021Efficient Deep Learning: A Survey on Making Deep Learning Models Smaller, Faster, and Bettercited by 153
- 2020Training with Quantization Noise for Extreme Model Compressioncited by 145
- 2020Post-Training Piecewise Linear Quantization for Deep Neural Networkscited by 77
- 2017Towards Effective Low-bitwidth Convolutional Neural Networkscited by 76
Built on by
Citing papers per year: 2021: 1; 2022: 0; 2023: 1.
2 papers.