mlsanityData to 7 Oct 2026

Asking Forever: Universal Activations Behind Turn Amplification in Conversational LLMs

arXiv 2602.17778 ↗First posted 19 Feb 2026cs.LG cs.CRcited by 0

Not on the map. Why?

Abstract (arXiv)

Multi-turn interaction length is a dominant factor in the operational costs of conversational LLMs. In this work, we present a new failure mode in conversational LLMs: turn amplification, in which a model consistently prolongs multi-turn interactions without completing the underlying task. We show that an adversary can systematically exploit clarification-seeking behavior-commonly encouraged in multi-turn conversation settings-to scalably prolong interactions. Moving beyond prompt-level behaviors, we take a mechanistic perspective and identify a query-independent, universal activation subspace associated with clarification-seeking responses. Unlike prior cost-amplification attacks that rely on per-turn prompt optimization, our attack arises from conversational dynamics and persists across prompts and tasks. We show that this mechanism provides a scalable pathway to induce turn amplification: both supply-chain attacks via fine-tuning and runtime attacks through low-level parameter corruptions consistently shift models toward abstract, clarification-seeking behavior across prompts. Across multiple instruction-tuned LLMs and benchmarks, our attack substantially increases turn count while remaining compliant. We also show that existing defenses offer limited protection against this emerging class of failures.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 60 references that are in the map. First posted on arXiv 19 Feb 2026.

Builds on

38 of 60 references.

References · 38

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  3. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  4. 2022Emergent Abilities of Large Language Modelscited by 2,483
  5. 2024A Survey on LLM-as-a-Judgecited by 1,384
  6. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
  7. 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,052
  8. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
  9. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 960
  10. 2023Steering Language Models With Activation Engineeringcited by 824
  11. 2020A Primer in BERTology: What we know about how BERT workscited by 807
  12. 2024Measuring short-form factuality in large language modelscited by 345
26 more
  1. 2023The Impact of AI on Developer Productivity: Evidence from GitHub Copilotcited by 264
  2. 2024On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Surveycited by 240
  3. 2023Large Language Models in Law: A Surveycited by 128
  4. 2020Sponge Examples: Energy-Latency Attacks on Neural Networkscited by 108
  5. 2019Bit-Flip Attack: Crushing Neural Network with Progressive Bit Searchcited by 106
  6. 2025The Geometry of Refusal in Large Language Models: Concept Cones and Representational Independencecited by 104
  7. 2024Coercing LLMs to do and reveal (almost) anythingcited by 88
  8. 2024Efficient LLM Scheduling by Learning to Rankcited by 83
  9. 2023S3: Increasing GPU Utilization during Generative Inference for Higher Throughputcited by 81
  10. 2024InferAligner: Inference-Time Alignment for Harmlessness through Cross-Model Guidancecited by 78
  11. 2024A Complete Survey on LLM-based AI Chatbotscited by 71
  12. 2020A Panda? No, It's a Sloth: Slowdown Attacks on Adaptive Multi-Exit Neural Network Inferencecited by 61
  13. 2025Synthetic Data Generation Using Large Language Models: Advances in Text and Codecited by 61
  14. 2020DeepHammer: Depleting the Intelligence of Deep Neural Networks through Targeted Chain of Bit Flipscited by 53
  15. 2024SCANS: Mitigating the Exaggerated Safety for LLMs via Safety-Conscious Activation Steeringcited by 45
  16. 2024Denial-of-Service Poisoning Attacks against Large Language Modelscited by 34
  17. 2024Activation Scaling for Steering and Interpreting Language Modelscited by 33
  18. 2024Crabs: Consuming Resource via Auto-generation for LLM-DoS Attack under Black-box Settingscited by 33
  19. 2024An Engorgio Prompt Makes Large Language Model Babble oncited by 30
  20. 2025ThinkTrap: Denial-of-Service Attacks against Black-box LLM Services via Infinite Thinkingcited by 22
  21. 2025GPUHammer: Rowhammer Attacks on GPU Memories are Practicalcited by 11
  22. 2025LLM-Friendly Knowledge Representation for Customer Supportcited by 11
  23. 2025ExtendAttack: Attacking Servers of LRMs via Extending Reasoningcited by 10
  24. 2025LoopLLM: Transferable Energy-Latency Attacks in LLMs via Repetitive Generationcited by 7
  25. 2023BERT Lost Patience Won't Be Robust to Adversarial Slowdowncited by 4
  26. 2024PrisonBreak: Jailbreaking Large Language Models with at Most Twenty-Five Targeted Bit-flipscited by 3

Built on by

Not cited yet.