Dive into Ambiguity: A*-Inspired Multi-Agents Commonsense Obfuscation Attack on LLM Prompts
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
Large language models (LLMs) excel in reasoning and knowledge-intensive tasks but remain vulnerable to prompt-level adversarial attacks that preserve intent while triggering commonsense hallucinations. This vulnerability is urgent, as LLMs are rapidly integrated into safety-critical domains where factual reliability is non-negotiable. Existing attack methods either lack efficiency or fail to capture the adaptive strategies of real-world adversaries. We propose an A*-inspired Factual Error Induction Framework, a framework for generating semantically aligned yet obfuscated prompts. At its core is a Hierarchical Rewrite Strategy guided by a dynamic semantic dispersion coefficient γ that balances conservative edits early with aggressive obfuscations later, following a reverse simulated annealing schedule. To enhance interpretability, we further introduce Agentic Mechanism Labeling, which discovers and refines adversarial mechanisms, offering interpretable reverse optimization. Theoretically, we prove that prompt rewriting follows a contractive recurrence, leading to semantic collapse as γ decreases. Empirically, across diverse LLMs, our method achieves higher attack success rates than exhaustive exploration while requiring fewer attempts, demonstrating both efficiency and effectiveness.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 16 of its 37 references that are in the map. First posted on arXiv 31 May 2026.
Builds on
16 of 37 references.
Closest ancestors · 2
Same direction, newest first
- 2024Improving Multi-Agent Debate with Sparse Communication Topology17 Jun
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate30 May
Other references · 14
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2022Red Teaming Language Models with Language Modelscited by 1,026
- 2019Is BERT Really Robust? A Strong Baseline for Natural Language Attack on Text Classification and Entailmentcited by 671
- 2024Scaling Large Language Model-based Multi-Agent Collaborationcited by 241
- 2024Rainbow Teaming: Open-Ended Generation of Diverse Adversarial Promptscited by 205
- 2023LLM Lies: Hallucinations are not Bugs, but Features as Adversarial Examplescited by 177
- 2023An LLM can Fool Itself: A Prompt-Based Adversarial Attackcited by 116
- 2022CommonsenseQA 2.0: Exposing the Limits of AI through Gamificationcited by 109
- 2024MultiAgent Collaboration Attack: Investigating Adversarial Attacks in Large Language Model Collaborations via Debatecited by 56
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Agentic Adversarial Rewriting Exposes Architectural Vulnerabilities in Black-Box NLP Pipelines
- 2024Imprompter: Tricking LLM Agents into Improper Tool Use
- 2025Chain-of-Code Collapse: Reasoning Failures in LLMs via Adversarial Prompting in Code Generation
- 2025POT: Inducing Overthinking in LLMs via Black-Box Iterative Optimization
- 2026Silent Egress: When Implicit Prompt Injection Makes LLM Agents Leak Without a Trace
- 2025Friend or Foe: How LLMs' Safety Mind Gets Fooled by Intent Shift Attack
- 2026Structured Semantic Cloaking for Jailbreak Attacks on Large Language Models
- 2026Universal Defenses for Tool-Integrated LLM Agents Against Adversarial Attacks