mlsanityData to 14 Oct 2026

POT: Inducing Overthinking in LLMs via Black-Box Iterative Optimization

arXiv 2508.19277 ↗First posted 23 Aug 2025cs.LG cs.AI cs.CRcited by 11

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

Recent advances in Chain-of-Thought (CoT) prompting have substantially enhanced the reasoning capabilities of large language models (LLMs), enabling sophisticated problem-solving through explicit multi-step reasoning traces. However, these enhanced reasoning processes introduce novel attack surfaces, particularly vulnerabilities to computational inefficiency through unnecessarily verbose reasoning chains that consume excessive resources without corresponding performance gains. Prior overthinking attacks typically require restrictive conditions including access to external knowledge sources for data poisoning, reliance on retrievable poisoned content, and structurally obvious templates that limit practical applicability in real-world scenarios. To address these limitations, we propose POT (Prompt-Only OverThinking), a novel black-box attack framework that employs LLM-based iterative optimization to generate covert and semantically natural adversarial prompts, eliminating dependence on external data access and model retrieval. Extensive experiments across diverse model architectures and datasets demonstrate that POT achieves superior performance compared to other methods.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 29 of its 50 references that are in the map. First posted on arXiv 23 Aug 2025.

Builds on

29 of 50 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Excessive Reasoning Attack on Reasoning LLMs17 Jun
  2. 2025Poisoned-MRAG: Knowledge Poisoning Attacks to Multimodal Retrieval Augmented Generation8 Mar

Other references · 27

  1. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  4. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  5. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  6. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  7. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
  8. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,470
  9. 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,055
  10. 2023Large Language Models as Optimizerscited by 864
  11. 2019MathQA: Towards Interpretable Math Word Problem Solving with Operation-Based Formalismscited by 662
  12. 2023Jailbreaking ChatGPT via Prompt Engineering: An Empirical Studycited by 498
15 more
  1. 2024Jailbreak Attacks and Defenses Against Large Language Models: A Surveycited by 230
  2. 2022Maieutic Prompting: Logically Consistent Reasoning with Recursive Explanationscited by 159
  3. 2024Safeguarding Large Language Models: A Surveycited by 78
  4. 2024A Comparative Study on Reasoning Patterns of OpenAI's o1 Modelcited by 63
  5. 2024POSIX: A Prompt Sensitivity Index For Large Language Modelscited by 59
  6. 2024Are Large Language Models Good Prompt Optimizers?cited by 37
  7. 2024Capabilities of Large Language Models in Control Engineering: A Benchmark Study on GPT-4, Claude 3 Opus, and Gemini 1.0 Ultracited by 37
  8. 2025Practical Poisoning Attacks against Retrieval-Augmented Generationcited by 36
  9. 2025Red Teaming the Mind of the Machine: A Systematic Evaluation of Prompt Injection and Jailbreak Vulnerabilities in LLMscited by 34
  10. 2025Prompt Injection 2.0: Hybrid AI Threatscited by 13
  11. 2025The TIP of the Iceberg: Revealing a Hidden Class of Task-in-Prompt Adversarial Attacks on LLMscited by 7
  12. 2024Deciphering the Chaos: Enhancing Jailbreak Attacks via Adversarial Prompt Translationcited by 6
  13. 2025POISONCRAFT: Practical Poisoning of Retrieval-Augmented Generation for Large Language Modelscited by 6
  14. 2025Chain-of-Code Collapse: Reasoning Failures in LLMs via Adversarial Prompting in Code Generationcited by 4
  15. 2025When LLMs Copy to Think: Uncovering Copy-Guided Attacks in Reasoning LLMscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 10.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025BadThink: Triggered Overthinking Attacks on Chain-of-Thought Reasoning in Large Language Models
  2. 2025OverThink: Slowdown Attacks on Reasoning LLMs
  3. 2025Batch Prompting Suppresses Overthinking Reasoning Under Constraint: How Batch Prompting Suppresses Overthinking in Reasoning Models
  4. 2026Dive into Ambiguity: A*-Inspired Multi-Agents Commonsense Obfuscation Attack on LLM Prompts
  5. 2026Reasoning Hijacking: The Fragility of Reasoning Alignment in Large Language Models
  6. 2026CAP-CoT: Cycle Adversarial Prompt for Improving Chain of Thoughts in LLM Reasoning
  7. 2024Stepwise Reasoning Error Disruption Attack of LLMs
  8. 2025Step-by-Step Reasoning Attack: Revealing 'Erased' Knowledge in Large Language Models