Asking Forever: Universal Activations Behind Turn Amplification in Conversational LLMs
Not on the map. Why?
Abstract (arXiv)
Multi-turn interaction length is a dominant factor in the operational costs of conversational LLMs. In this work, we present a new failure mode in conversational LLMs: turn amplification, in which a model consistently prolongs multi-turn interactions without completing the underlying task. We show that an adversary can systematically exploit clarification-seeking behavior-commonly encouraged in multi-turn conversation settings-to scalably prolong interactions. Moving beyond prompt-level behaviors, we take a mechanistic perspective and identify a query-independent, universal activation subspace associated with clarification-seeking responses. Unlike prior cost-amplification attacks that rely on per-turn prompt optimization, our attack arises from conversational dynamics and persists across prompts and tasks. We show that this mechanism provides a scalable pathway to induce turn amplification: both supply-chain attacks via fine-tuning and runtime attacks through low-level parameter corruptions consistently shift models toward abstract, clarification-seeking behavior across prompts. Across multiple instruction-tuned LLMs and benchmarks, our attack substantially increases turn count while remaining compliant. We also show that existing defenses offer limited protection against this emerging class of failures.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 60 references that are in the map. First posted on arXiv 19 Feb 2026.
Builds on
38 of 60 references.
References · 38
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
- 2022Emergent Abilities of Large Language Modelscited by 2,483
- 2024A Survey on LLM-as-a-Judgecited by 1,384
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
- 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,052
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
- 2024Refusal in Language Models Is Mediated by a Single Directioncited by 960
- 2023Steering Language Models With Activation Engineeringcited by 824
- 2020A Primer in BERTology: What we know about how BERT workscited by 807
- 2024Measuring short-form factuality in large language modelscited by 345
26 more
- 2023The Impact of AI on Developer Productivity: Evidence from GitHub Copilotcited by 264
- 2024On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Surveycited by 240
- 2023Large Language Models in Law: A Surveycited by 128
- 2020Sponge Examples: Energy-Latency Attacks on Neural Networkscited by 108
- 2019Bit-Flip Attack: Crushing Neural Network with Progressive Bit Searchcited by 106
- 2025The Geometry of Refusal in Large Language Models: Concept Cones and Representational Independencecited by 104
- 2024Coercing LLMs to do and reveal (almost) anythingcited by 88
- 2024Efficient LLM Scheduling by Learning to Rankcited by 83
- 2023S3: Increasing GPU Utilization during Generative Inference for Higher Throughputcited by 81
- 2024InferAligner: Inference-Time Alignment for Harmlessness through Cross-Model Guidancecited by 78
- 2024A Complete Survey on LLM-based AI Chatbotscited by 71
- 2020A Panda? No, It's a Sloth: Slowdown Attacks on Adaptive Multi-Exit Neural Network Inferencecited by 61
- 2025Synthetic Data Generation Using Large Language Models: Advances in Text and Codecited by 61
- 2020DeepHammer: Depleting the Intelligence of Deep Neural Networks through Targeted Chain of Bit Flipscited by 53
- 2024SCANS: Mitigating the Exaggerated Safety for LLMs via Safety-Conscious Activation Steeringcited by 45
- 2024Denial-of-Service Poisoning Attacks against Large Language Modelscited by 34
- 2024Activation Scaling for Steering and Interpreting Language Modelscited by 33
- 2024Crabs: Consuming Resource via Auto-generation for LLM-DoS Attack under Black-box Settingscited by 33
- 2024An Engorgio Prompt Makes Large Language Model Babble oncited by 30
- 2025ThinkTrap: Denial-of-Service Attacks against Black-box LLM Services via Infinite Thinkingcited by 22
- 2025GPUHammer: Rowhammer Attacks on GPU Memories are Practicalcited by 11
- 2025LLM-Friendly Knowledge Representation for Customer Supportcited by 11
- 2025ExtendAttack: Attacking Servers of LRMs via Extending Reasoningcited by 10
- 2025LoopLLM: Transferable Energy-Latency Attacks in LLMs via Repetitive Generationcited by 7
- 2023BERT Lost Patience Won't Be Robust to Adversarial Slowdowncited by 4
- 2024PrisonBreak: Jailbreaking Large Language Models with at Most Twenty-Five Targeted Bit-flipscited by 3
Built on by
Not cited yet.