mlsanityData to 7 Oct 2026

Small Talk, Big Impact: The Energy Cost of Thanking AI

arXiv 2601.22357 ↗First posted 29 Jan 2026cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Being polite is free - or is it? In this paper, we quantify the energy cost of seemingly innocuous messages such as ``thank you'' when interacting with large language models, often used by users to convey politeness. Using real-world conversation traces and fine-grained energy measurements, we quantify how input length, output length and model size affect energy use. While politeness is our motivating example, it also serves as a controlled and reproducible proxy for measuring the energy footprint of a typical LLM interaction. Our findings provide actionable insights for building more sustainable and efficient LLM applications, especially in increasingly widespread real-world contexts like chat. As user adoption grows and billions of prompts are processed daily, understanding and mitigating this cost becomes crucial - not just for efficiency, but for sustainable AI deployment.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 19 of its 28 references that are in the map. First posted on arXiv 29 Jan 2026.

Builds on

19 of 28 references.

References · 19

  1. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  2. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
  3. 2022Fast Inference from Transformers via Speculative Decodingcited by 1,615
  4. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
  5. 2023Enhancing Chat Language Models by Scaling High-quality Instructional Conversationscited by 825
  6. 2021Carbon Emissions and Large Neural Network Trainingcited by 561
  7. 2023Splitwise: Efficient generative LLM inference using phase splittingcited by 536
  8. 2022Estimating the Carbon Footprint of BLOOM, a 176B Parameter Language Modelcited by 264
  9. 2020Towards the Systematic Reporting of the Energy and Carbon Footprints of Machine Learningcited by 246
  10. 2021Sustainable AI: Environmental Implications, Challenges and Opportunitiescited by 242
  11. 2023Power Hungry Processing: Watts Driving the Cost of AI Deployment?cited by 186
  12. 2021The Efficiency Misnomercited by 98
7 more
  1. 2024Inducing High Energy-Latency of Large Vision-Language Models with Verbose Imagescited by 69
  2. 2025Energy Considerations of Large Language Model Inference and Efficiency Optimizationscited by 54
  3. 2024Should We Respect LLMs? A Cross-Lingual Study on the Influence of Prompt Politeness on LLM Performancecited by 41
  4. 2024Offline Energy-Optimal LLM Serving: Workload-Based Energy Models for LLM Inference on Heterogeneous Systemscited by 27
  5. 2025The Energy Cost of Reasoning: Analyzing Energy Usage in LLMs with Test-time Computecited by 14
  6. 2025Brevity is the soul of sustainability: Characterizing LLM response lengthscited by 9
  7. 2025Green Prompting: Characterizing Prompt-driven Energy Costs of LLM Inferencecited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.