Agentic System as Compressor: Quantifying System Intelligence in Bits
On the map: LLM agents and tool use → Agent memory systems
Abstract (arXiv)
Large language models are turning from isolated predictors into agentic systems: they call tools, retrieve evidence, obey environment constraints, use verifiers, and complete tasks through search and multi-turn interaction. We adopts an analytical viewpoint based on "compression is intelligence": under a fixed task distribution, interface, and compute budget, a stronger agentic system lets a target object be reconstructed with fewer bits. We operationalize the measure with arithmetic coding, seed coding, and a fallback, and evaluate it in five settings: reversed text, chess moves, protein sequences, retrieval-augmented question answering, and semantic story compression; in all of them agentic components reduce codelength. These small, controlled experiments cover component types typical of real agentic systems, show that codelength can analyze how components, observers, and budgets change residual uncertainty, and offer guidance for evaluating real agent systems.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 11 of its 29 references that are in the map. First posted on arXiv 24 Jun 2026.
Builds on
11 of 29 references.
References · 11
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,376
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,221
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,502
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,657
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,156
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,117
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,181
- 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,985
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,676
- 2023Language Modeling Is Compressioncited by 225
- 2024Compression Represents Intelligence Linearlycited by 56
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025An Information Theoretic Perspective on Agentic System Design
- 2025Can Compressed LLMs Truly Act? An Empirical Evaluation of Agentic Capabilities in LLM Compression
- 2026Anatomy of Agentic Memory: Taxonomy and Empirical Analysis of Evaluation and System Limitations
- 2024Agentic AI: The Era of Semantic Decoding
- 2026Agentic Artificial Intelligence (AI): Architectures, Taxonomies, and Evaluation of Large Language Model Agents
- 2026Can Small Agents Collaborate to Beat a Single Large Language Model?
- 2026AgentCompress: Task-Aware Compression for Affordable Large Language Model Agents
- 2026AMA-Bench: Evaluating Long-Horizon Memory for Agentic Applications