A Theory of LLM Information Susceptibility
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Large language models (LLMs) are increasingly deployed as optimization modules in agentic systems, yet the fundamental limits of such LLM-mediated improvement remain poorly understood. Here we propose a theory of LLM information susceptibility, centred on the hypothesis that when computational resources are sufficiently large, the intervention of a fixed LLM does not increase the performance susceptibility of a strategy set with respect to budget. We develop a multi-variable utility-function framework that generalizes this hypothesis to architectures with multiple co-varying budget channels, and discuss the conditions under which co-scaling can exceed the susceptibility bound. We validate the theory empirically across structurally diverse domains and model scales spanning an order of magnitude, and show that nested, co-scaling architectures open response channels unavailable to fixed configurations. These results clarify when LLM intervention helps and when it does not, demonstrating that tools from statistical physics can provide predictive constraints for the design of AI systems. If the susceptibility hypothesis holds generally, the theory suggests that nested architectures may be a necessary structural condition for open-ended agentic self-improvement.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 31 of its 49 references that are in the map. First posted on arXiv 24 Mar 2026.
Builds on
31 of 49 references.
Closest ancestors · 4
Same direction, newest first
- 2025Detailed balance in large language model-driven agents10 Dec
- 2025Towards a Science of Scaling Agent Systems9 Dec
- 2023The Rise and Potential of Large Language Model Based Agents: A Survey14 Sep
- 2023A Survey on Large Language Model based Autonomous Agents22 Aug
Other references · 27
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
15 more
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
- 2022Competition-Level Code Generation with AlphaCodecited by 1,462
- 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 991
- 2022STaR: Bootstrapping Reasoning With Reasoningcited by 940
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 886
- 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 560
- 2023Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Modelscited by 349
- 2024Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Modelcited by 268
- 2024V-STaR: Training Verifiers for Self-Taught Reasonerscited by 217
- 2024Agent AI: Surveying the Horizons of Multimodal Interactioncited by 170
- 2021AlphaEvolve: A Learning Framework to Discover Novel Alphas in Quantitative Investmentcited by 32
- 2026How Far Can Unsupervised RLVR Scale LLM Training?cited by 30
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Do Large Language Models Know What They Are Capable Of?
- 2026Silent Failure in LLM Agent Systems: The Entropy Principle and the Inevitable Disorder of Autonomous Agents
- 2026From Task Solving to Robust Real-World Adaptation in LLM Agents
- 2025LLMs are Greedy Agents: Effects of RL Fine-tuning on Decision-Making Abilities
- 2025Noise, Adaptation, and Strategy: Assessing LLM Fidelity in Decision-Making
- 2026More Capable, Less Cooperative? When LLMs Fail At Zero-Cost Collaboration
- 2025An Information Theoretic Perspective on Agentic System Design
- 2026From Signals to Structure: How Memory Architecture Drives Language Emergence in LLM Agents