mlsanityData to 14 Oct 2026

AIDG: A Formal Decomposition of Information Extraction and Containment Asymmetries in Multi-Turn LLM Dialogue

arXiv 2602.17443 ↗First posted 19 Feb 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Multi-turn LLM evaluation is typically reported as a single win-rate scalar, conflating distinct capabilities. We introduce AIDG (Adversarial Information Deduction Game), formalizing multi-turn adversarial dialogue as a two-player partially observable stochastic game (POSG) and decomposing performance along Seeker (extraction) and Holder (containment) roles. The decomposition isolates three failure modes: cooperative-prior leakage, constraint-reasoning interference, and inefficient hypothesis-space traversal. Across 439 games over six frontier LLMs, defensive performance is tightly clustered (sigma = 1.9 ELO) while offensive performance varies substantially (sigma = 53.3 ELO); confirmation framing increases extraction odds 7.75x over uninformed deduction (p < 0.00001); and constraint violations account for 41.3% of deductive failures, uncorrelated with scale (rho = 0.0). We position the containment-over-extraction gap not as a surprising finding but as a measurable consequence of locally resolvable defensive decisions versus globally coupled offensive planning, and use the decomposition to attribute the gap per model. All design choices, including turn-decay weighting and the Bradley-Terry rating model, are derived from explicit assumptions.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 5 of its 20 references that are in the map. First posted on arXiv 19 Feb 2026.

Builds on

5 of 20 references.

References · 5

  1. 2024JudgeBench: A Benchmark for Evaluating LLM-based Judgescited by 318
  2. 2023Elo Uncovered: Robustness and Best Practices in Language Model Evaluationcited by 61
  3. 2025Bypassing LLM Guardrails: An Empirical Analysis of Evasion Attacks against Prompt Injection and Jailbreak Detection Systemscited by 26
  4. 2024TMGBench: A Systematic Game Benchmark for Evaluating Strategic Reasoning Abilities of LLMscited by 24
  5. 2024Assessing Adversarial Robustness of Large Language Models: An Empirical Studycited by 21

Built on by

Not cited yet.