SOM: Structured Opponent Modeling for LLM-based Agents via Structural Causal Model
On the map: LLM agents and tool use → Reinforcement learning for LLM agents
Abstract (arXiv)
Accurately predicting opponents' behavior from interactions is a fundamental capability for large language model (LLM)-based agents in multi-agent and game-theoretic environments. Existing approaches often entangle opponent modeling with prediction, relying on implicit contextual reasoning and limiting adaptability in dynamic interactions. To this end, we propose Structured Opponent Modeling (SOM), a two-stage opponent modeling framework that distinctly separates opponent model construction and opponent prediction. At the construction stage, SOM employs a Structural Causal Model (SCM), a graph-based formalism for representing dependencies among variables, to capture directed links between opponents' observations and actions, yielding an explicit and structured opponent representation. At the prediction stage, the LLM performs structured reasoning along clear pathways derived from the SCM, improving both prediction accuracy and stability. Extensive experiments on diverse multi-agent benchmarks demonstrate that SOM consistently outperforms state-of-the-art LLM-based reasoning baselines, enabling more accurate and adaptable strategic decision-making in complex and dynamic multi-agent interactions.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reinforcement learning for LLM agents, one of 16 directions in LLM agents and tool use. Builds on 14 of its 36 references that are in the map. First posted on arXiv 8 May 2026.
Builds on
14 of 36 references.
Closest ancestors · 5
Same direction, newest first
- 2024Richelieu: Self-Evolving LLM-Based Agents for AI Diplomacy9 Jul
- 2024Enhance Reasoning for Large Language Models in the Game Werewolf4 Feb
- 2023MAgIC: Investigation of Large Language Model Powered Multi-Agent in Cognition, Adaptability, Rationality and Collaboration14 Nov
- 2023Language Agents with Reinforcement Learning for Strategic Play in the Werewolf Game29 Oct
- 2023Suspicion-Agent: Playing Imperfect Information Games with Theory of Mind Aware GPT-429 Sep
Other references · 9
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2023Exploring Large Language Models for Communication Games: An Empirical Study on Werewolfcited by 238
- 2023Head-to-Tail: How Knowledgeable are Large Language Models (LLMs)? A.K.A. Will LLMs Replace Knowledge Graphs?cited by 167
- 2023EconAgent: Large Language Model-Empowered Agents for Simulating Macroeconomic Activitiescited by 154
- 2024How Well Can LLMs Negotiate? NegotiationArena Platform and Analysiscited by 93
- 2020Agent Modelling under Partial Observability for Deep Reinforcement Learningcited by 56
- 2024LLM Harmony: Multi-Agent Communication for Problem Solvingcited by 34
- 2024K-Level Reasoning: Establishing Higher Order Beliefs in Large Language Models for Strategic Reasoningcited by 21
- 2025Logic-of-Thought: Empowering Large Language Models with Logic Programs for Solving Puzzles in Natural Languagecited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Opponent Shaping in LLM Agents
- 2024LLM as a Mastermind: A Survey of Strategic Reasoning with Large Language Models
- 2025Approximating Human Strategic Reasoning with LLM-Enhanced Recursive Reasoners Leveraging Multi-agent Hypergames
- 2024LLMArena: Assessing Capabilities of Large Language Models in Dynamic Multi-Agent Environments
- 2025CausalPlan: Empowering Efficient LLM Multi-Agent Collaboration Through Causality-Driven Planning
- 2025LLM-Stackelberg Games: Conjectural Reasoning Equilibria and Their Applications to Spearphishing
- 2026Beyond Scaling: Assessing Strategic Reasoning and Rapid Decision-Making Capability of LLMs in Zero-sum Environments
- 2024STRIDE: A Tool-Assisted LLM Agent Framework for Strategic and Interactive Decision-Making