mlsanityData to 14 Oct 2026

Curb Your Carbon Emissions: Benchmarking Carbon Emissions in Machine Translation

arXiv 2109.12584 ↗First posted 26 Sep 2021cs.CL cs.AI cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

In recent times, there has been definitive progress in the field of NLP, with its applications growing as the utility of our language models increases with advances in their performance. However, these models require a large amount of computational power and data to train, consequently leading to large carbon footprints. Therefore, it is imperative that we study the carbon efficiency and look for alternatives to reduce the overall environmental impact of training models, in particular large language models. In our work, we assess the performance of models for machine translation, across multiple language pairs to assess the difference in computational power required to train these models for each of these language pairs and examine the various components of these models to analyze aspects of our pipeline that can be optimized to reduce these carbon emissions.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 16 of its 21 references that are in the map. First posted on arXiv 26 Sep 2021.

Builds on

16 of 21 references.

References · 16

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  4. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
  5. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,254
  6. 2016Language Modeling with Gated Convolutional Networkscited by 702
  7. 2021Carbon Emissions and Large Neural Network Trainingcited by 567
  8. 2017Convolutional Sequence to Sequence Learningcited by 552
  9. 2019Quantifying the Carbon Emissions of Machine Learningcited by 521
  10. 2018BOHB: Robust and Efficient Hyperparameter Optimization at Scalecited by 470
  11. 2021XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languagescited by 347
  12. 2014Exploiting Linear Structure Within Convolutional Networks for Efficient Evaluationcited by 306
4 more
  1. 2016Multi30K: Multilingual English-German Image Descriptionscited by 250
  2. 2016Designing Energy-Efficient Convolutional Neural Networks using Energy-Aware Pruningcited by 134
  3. 2020A Systematic Analysis of Morphological Content in BERT Models for Multiple Languagescited by 20
  4. 2020Prune Responsiblycited by 20

Built on by

Cited by year

Citing papers per year: 2023: 1.

1 paper.