mlsanityData to 14 Oct 2026

A Theory of LLM Information Susceptibility

arXiv 2603.23626 ↗First posted 24 Mar 2026cs.LG cond-mat.stat-mech cs.AIcited by 0

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Large language models (LLMs) are increasingly deployed as optimization modules in agentic systems, yet the fundamental limits of such LLM-mediated improvement remain poorly understood. Here we propose a theory of LLM information susceptibility, centred on the hypothesis that when computational resources are sufficiently large, the intervention of a fixed LLM does not increase the performance susceptibility of a strategy set with respect to budget. We develop a multi-variable utility-function framework that generalizes this hypothesis to architectures with multiple co-varying budget channels, and discuss the conditions under which co-scaling can exceed the susceptibility bound. We validate the theory empirically across structurally diverse domains and model scales spanning an order of magnitude, and show that nested, co-scaling architectures open response channels unavailable to fixed configurations. These results clarify when LLM intervention helps and when it does not, demonstrating that tools from statistical physics can provide predictive constraints for the design of AI systems. If the susceptibility hypothesis holds generally, the theory suggests that nested architectures may be a necessary structural condition for open-ended agentic self-improvement.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 31 of its 49 references that are in the map. First posted on arXiv 24 Mar 2026.

Builds on

31 of 49 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Detailed balance in large language model-driven agents10 Dec
  2. 2025Towards a Science of Scaling Agent Systems9 Dec
  3. 2023The Rise and Potential of Large Language Model Based Agents: A Survey14 Sep
  4. 2023A Survey on Large Language Model based Autonomous Agents22 Aug

Other references · 27

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  5. 2020Scaling Laws for Neural Language Modelscited by 6,586
  6. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  7. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  8. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  9. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  10. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  11. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  12. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
15 more
  1. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  2. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  3. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
  4. 2022Competition-Level Code Generation with AlphaCodecited by 1,462
  5. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
  6. 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 991
  7. 2022STaR: Bootstrapping Reasoning With Reasoningcited by 940
  8. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 886
  9. 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 560
  10. 2023Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Modelscited by 349
  11. 2024Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Modelcited by 268
  12. 2024V-STaR: Training Verifiers for Self-Taught Reasonerscited by 217
  13. 2024Agent AI: Surveying the Horizons of Multimodal Interactioncited by 170
  14. 2021AlphaEvolve: A Learning Framework to Discover Novel Alphas in Quantitative Investmentcited by 32
  15. 2026How Far Can Unsupervised RLVR Scale LLM Training?cited by 30

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Do Large Language Models Know What They Are Capable Of?
  2. 2026Silent Failure in LLM Agent Systems: The Entropy Principle and the Inevitable Disorder of Autonomous Agents
  3. 2026From Task Solving to Robust Real-World Adaptation in LLM Agents
  4. 2025LLMs are Greedy Agents: Effects of RL Fine-tuning on Decision-Making Abilities
  5. 2025Noise, Adaptation, and Strategy: Assessing LLM Fidelity in Decision-Making
  6. 2026More Capable, Less Cooperative? When LLMs Fail At Zero-Cost Collaboration
  7. 2025An Information Theoretic Perspective on Agentic System Design
  8. 2026From Signals to Structure: How Memory Architecture Drives Language Emergence in LLM Agents