Small Talk, Big Impact: The Energy Cost of Thanking AI
Not on the map. Why?
Abstract (arXiv)
Being polite is free - or is it? In this paper, we quantify the energy cost of seemingly innocuous messages such as ``thank you'' when interacting with large language models, often used by users to convey politeness. Using real-world conversation traces and fine-grained energy measurements, we quantify how input length, output length and model size affect energy use. While politeness is our motivating example, it also serves as a controlled and reproducible proxy for measuring the energy footprint of a typical LLM interaction. Our findings provide actionable insights for building more sustainable and efficient LLM applications, especially in increasingly widespread real-world contexts like chat. As user adoption grows and billions of prompts are processed daily, understanding and mitigating this cost becomes crucial - not just for efficiency, but for sustainable AI deployment.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 19 of its 28 references that are in the map. First posted on arXiv 29 Jan 2026.
Builds on
19 of 28 references.
References · 19
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2022Fast Inference from Transformers via Speculative Decodingcited by 1,615
- 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
- 2023Enhancing Chat Language Models by Scaling High-quality Instructional Conversationscited by 825
- 2021Carbon Emissions and Large Neural Network Trainingcited by 561
- 2023Splitwise: Efficient generative LLM inference using phase splittingcited by 536
- 2022Estimating the Carbon Footprint of BLOOM, a 176B Parameter Language Modelcited by 264
- 2020Towards the Systematic Reporting of the Energy and Carbon Footprints of Machine Learningcited by 246
- 2021Sustainable AI: Environmental Implications, Challenges and Opportunitiescited by 242
- 2023Power Hungry Processing: Watts Driving the Cost of AI Deployment?cited by 186
- 2021The Efficiency Misnomercited by 98
7 more
- 2024Inducing High Energy-Latency of Large Vision-Language Models with Verbose Imagescited by 69
- 2025Energy Considerations of Large Language Model Inference and Efficiency Optimizationscited by 54
- 2024Should We Respect LLMs? A Cross-Lingual Study on the Influence of Prompt Politeness on LLM Performancecited by 41
- 2024Offline Energy-Optimal LLM Serving: Workload-Based Energy Models for LLM Inference on Heterogeneous Systemscited by 27
- 2025The Energy Cost of Reasoning: Analyzing Energy Usage in LLMs with Test-time Computecited by 14
- 2025Brevity is the soul of sustainability: Characterizing LLM response lengthscited by 9
- 2025Green Prompting: Characterizing Prompt-driven Energy Costs of LLM Inferencecited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.