POT: Inducing Overthinking in LLMs via Black-Box Iterative Optimization
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
Recent advances in Chain-of-Thought (CoT) prompting have substantially enhanced the reasoning capabilities of large language models (LLMs), enabling sophisticated problem-solving through explicit multi-step reasoning traces. However, these enhanced reasoning processes introduce novel attack surfaces, particularly vulnerabilities to computational inefficiency through unnecessarily verbose reasoning chains that consume excessive resources without corresponding performance gains. Prior overthinking attacks typically require restrictive conditions including access to external knowledge sources for data poisoning, reliance on retrievable poisoned content, and structurally obvious templates that limit practical applicability in real-world scenarios. To address these limitations, we propose POT (Prompt-Only OverThinking), a novel black-box attack framework that employs LLM-based iterative optimization to generate covert and semantically natural adversarial prompts, eliminating dependence on external data access and model retrieval. Extensive experiments across diverse model architectures and datasets demonstrate that POT achieves superior performance compared to other methods.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 29 of its 50 references that are in the map. First posted on arXiv 23 Aug 2025.
Builds on
29 of 50 references.
Closest ancestors · 2
Same direction, newest first
- 2025Excessive Reasoning Attack on Reasoning LLMs17 Jun
- 2025Poisoned-MRAG: Knowledge Poisoning Attacks to Multimodal Retrieval Augmented Generation8 Mar
Other references · 27
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,470
- 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,055
- 2023Large Language Models as Optimizerscited by 864
- 2019MathQA: Towards Interpretable Math Word Problem Solving with Operation-Based Formalismscited by 662
- 2023Jailbreaking ChatGPT via Prompt Engineering: An Empirical Studycited by 498
15 more
- 2024Jailbreak Attacks and Defenses Against Large Language Models: A Surveycited by 230
- 2022Maieutic Prompting: Logically Consistent Reasoning with Recursive Explanationscited by 159
- 2024Safeguarding Large Language Models: A Surveycited by 78
- 2024A Comparative Study on Reasoning Patterns of OpenAI's o1 Modelcited by 63
- 2024POSIX: A Prompt Sensitivity Index For Large Language Modelscited by 59
- 2024Are Large Language Models Good Prompt Optimizers?cited by 37
- 2024Capabilities of Large Language Models in Control Engineering: A Benchmark Study on GPT-4, Claude 3 Opus, and Gemini 1.0 Ultracited by 37
- 2025Practical Poisoning Attacks against Retrieval-Augmented Generationcited by 36
- 2025Red Teaming the Mind of the Machine: A Systematic Evaluation of Prompt Injection and Jailbreak Vulnerabilities in LLMscited by 34
- 2025Prompt Injection 2.0: Hybrid AI Threatscited by 13
- 2025The TIP of the Iceberg: Revealing a Hidden Class of Task-in-Prompt Adversarial Attacks on LLMscited by 7
- 2024Deciphering the Chaos: Enhancing Jailbreak Attacks via Adversarial Prompt Translationcited by 6
- 2025POISONCRAFT: Practical Poisoning of Retrieval-Augmented Generation for Large Language Modelscited by 6
- 2025Chain-of-Code Collapse: Reasoning Failures in LLMs via Adversarial Prompting in Code Generationcited by 4
- 2025When LLMs Copy to Think: Uncovering Copy-Guided Attacks in Reasoning LLMscited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 10.
11 papers.
- 2026ReasoningBomb: A Stealthy Denial-of-Service Attack by Inducing Pathologically Long Reasoning in Large Reasoning Modelscited by 5
- 2026RECUR: Resource Exhaustion Attack via Recursive-Entropy Guided Counterfactual Utilization and Reflectioncited by 4
- 2026BenchOverflow: Measuring Overflow in Large Language Models via Plain-Text Promptscited by 3
- 2026OTora: A Unified Red Teaming Framework for Reasoning-Level Denial-of-Service in LLM Agentscited by 3
- 2025Red Teaming Large Reasoning Modelscited by 2
- 2026Rethinking Latency Denial-of-Service: Attacking the LLM Serving Framework, Not the Modelcited by 2
- 2026Localize-Then-Decide Guarantees for LLM Judgmentscited by 1
- 2026ESG-Bench: Benchmarking Long-Context ESG Reports for Hallucination Mitigationcited by 0
- 2026Inducing Overthink: Hierarchical Genetic Algorithm-based DoS Attack on Black-Box Large Language Reasoning Modelscited by 0
- 2026RecurGuard: Runtime Monitoring for Reasoning-Token Consumption Attackscited by 0
- 2026Quantifying Behavioral Tails in Black-Box Language Modelscited by 0
- 2026Quantifying Behavioral Tails in Black-Box Language Models27 Sep 2026
- 2026Localize-Then-Decide Guarantees for LLM Judgments26 Aug 2026
- 2026RecurGuard: Runtime Monitoring for Reasoning-Token Consumption Attacks6 Jun 2026
- 2026Inducing Overthink: Hierarchical Genetic Algorithm-based DoS Attack on Black-Box Large Language Reasoning Models13 May 2026
- 2026OTora: A Unified Red Teaming Framework for Reasoning-Level Denial-of-Service in LLM Agents9 May 2026
- 2026ESG-Bench: Benchmarking Long-Context ESG Reports for Hallucination Mitigation13 Mar 2026
- 2026RECUR: Resource Exhaustion Attack via Recursive-Entropy Guided Counterfactual Utilization and Reflection9 Feb 2026
- 2026Rethinking Latency Denial-of-Service: Attacking the LLM Serving Framework, Not the Model8 Feb 2026
- 2026ReasoningBomb: A Stealthy Denial-of-Service Attack by Inducing Pathologically Long Reasoning in Large Reasoning Models29 Jan 2026
- 2026BenchOverflow: Measuring Overflow in Large Language Models via Plain-Text Prompts13 Jan 2026
- 2025Red Teaming Large Reasoning Models29 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025BadThink: Triggered Overthinking Attacks on Chain-of-Thought Reasoning in Large Language Models
- 2025OverThink: Slowdown Attacks on Reasoning LLMs
- 2025Batch Prompting Suppresses Overthinking Reasoning Under Constraint: How Batch Prompting Suppresses Overthinking in Reasoning Models
- 2026Dive into Ambiguity: A*-Inspired Multi-Agents Commonsense Obfuscation Attack on LLM Prompts
- 2026Reasoning Hijacking: The Fragility of Reasoning Alignment in Large Language Models
- 2026CAP-CoT: Cycle Adversarial Prompt for Improving Chain of Thoughts in LLM Reasoning
- 2024Stepwise Reasoning Error Disruption Attack of LLMs
- 2025Step-by-Step Reasoning Attack: Revealing 'Erased' Knowledge in Large Language Models