mlsanityData to 7 Oct 2026

How Do Prompt Variations Affect Energy Consumption in On-Device LLMs?

arXiv 2609.01798 ↗First posted 1 Sep 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) are increasingly deployed on mobile devices, making energy efficiency a key deployment constraint, yet the energy impact of prompt design remains underexplored. This paper aims to understand how two prompt properties, cognitive load and phrasing pattern, shape the energy behavior of on-device LLM inference. We conduct a broad empirical study covering prompt properties, datasets, models, and devices, with phase-level profiling that separates prefill and decode energy. We find that cognitive load primarily affects the energy cost per token, while phrasing pattern affects energy largely through token usage. Our energy-quality analysis further shows that prompt design reshapes the attainable frontier differently across models, highlighting the need for model-aware prompt design in energy-efficient on-device LLM inference. Code, datasets, and scripts are available at https://amai-gsu.github.io/PromptProperty/.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 47 references that are in the map. First posted on arXiv 1 Sep 2026.

Builds on

33 of 47 references.

References · 33

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  3. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
  4. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  5. 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,250
  6. 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,140
  7. 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,413
  8. 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,371
  9. 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
  10. 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,122
  11. 2019How Can We Know What Language Models Know?cited by 953
  12. 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 934
21 more
  1. 2021Are NLP Models really able to Solve Simple Math Word Problems?cited by 861
  2. 2022Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Taskscited by 858
  3. 2023The Flan Collection: Designing Data and Methods for Effective Instruction Tuningcited by 734
  4. 2021Cross-Task Generalization via Natural Language Crowdsourcing Instructionscited by 696
  5. 2019Green AIcited by 620
  6. 2021Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigmcited by 599
  7. 2022Complexity-Based Prompting for Multi-Step Reasoningcited by 387
  8. 2023State of What Art? A Call for Multi-Prompt LLM Evaluationcited by 299
  9. 2022PromptSource: An Integrated Development Environment and Repository for Natural Language Promptscited by 288
  10. 2019Edge Intelligence: Paving the Last Mile of Artificial Intelligence with Edge Computingcited by 225
  11. 2023PromptRobust: Towards Evaluating the Robustness of Large Language Models on Adversarial Promptscited by 218
  12. 2024MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Casescited by 216
  13. 2024PowerInfer-2: Fast Large Language Model Inference on a Smartphonecited by 101
  14. 2024A Survey of Prompt Engineering Methods in Large Language Models for Different NLP Taskscited by 46
  15. 2024The Price of Prompting: Profiling Energy Use in Large Language Models Inferencecited by 22
  16. 2024MobileAIBench: Benchmarking LLMs and LMMs for On-Device Use Casescited by 13
  17. 2025Promptception: How Sensitive Are Large Multimodal Models to Prompts?cited by 13
  18. 2025From Prompts to Power: Measuring the Energy Footprint of LLM Inferencecited by 12
  19. 2025What Makes a Good Natural Language Prompt?cited by 6
  20. 2025lm-Meter: Unveiling Runtime Inference Latency for On-Device Language Modelscited by 4
  21. 2025PromptPrism: A Linguistically-Inspired Taxonomy for Promptscited by 2

Built on by

Not cited yet.