mlsanityData to 14 Oct 2026

Cognitive Load-Aware Inference: A Neuro-Symbolic Framework for Optimizing the Token Economy of Large Language Models

arXiv 2507.00653 ↗First posted 1 Jul 2025cs.LG cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

The escalating computational costs of Large Language Model (LLM) inference have become a critical barrier to their widespread and sustainable deployment. While existing optimization strategies are effective, they are predominantly based on statistical heuristics or architectural modifications, lacking a guiding cognitive theory to manage the inference process itself. This paper aims to bridge this gap by introducing a novel paradigm: the Cognitive Load-Aware Inference (CLAI) framework, which operationalizes principles from Cognitive Load Theory (CLT) and neuroscience for LLM inference. We formalize the concepts of Intrinsic Cognitive Load, Extraneous Cognitive Load, and Germane Cognitive Load into quantifiable LLM metrics (ICLLLM, ECLLLM, and GCLLLM), thereby reframing the inference process as a cognitive economics optimization problem: based on the intrinsic complexity of a problem (ICLLLM), minimize wasteful computation (ECLLLM), and strategically allocate the token budget to productive reasoning (GCLLLM). We propose two implementation paths: CLAI-Prompt, a zero-shot method that guides a base LLM through cognitive control steps via a structured meta-prompt, and CLAI-Tune, a fine-tuned model that internalizes these principles for spontaneous cognitive economy. Across a range of benchmarks in complex reasoning, long-context question answering, and code generation, our methods achieve significant reductions in token consumption (up to 45%) without sacrificing accuracy. Furthermore, CLAI-Tune exhibits an emergent ability to autonomously decompose difficult problems, a key characteristic of human expert cognition. This work demonstrates that by emulating the brain's resource management strategies, we can build more efficient, robust, and capable artificial intelligence systems.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 10 of its 31 references that are in the map. First posted on arXiv 1 Jul 2025.

Builds on

10 of 31 references.

References · 10

  1. 2017Attention Is All You Needcited by 60,361
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  4. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,407
  5. 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,075
  6. 2023LLM-Pruner: On the Structural Pruning of Large Language Modelscited by 650
  7. 2023RECOMP: Improving Retrieval-Augmented LMs with Compression and Selective Augmentationcited by 256
  8. 2023Efficient Large Language Models: A Surveycited by 186
  9. 2025A Survey of LLM Inference Systemscited by 9
  10. 2025Tutorial Proposal: Speculative Decoding for Efficient LLM Inferencecited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025CogniLoad: A Synthetic Natural Language Reasoning Benchmark With Tunable Length, Intrinsic Difficulty, and Distractor Density
  2. 2025Harnessing the Reasoning Economy: A Survey of Efficient Reasoning for Large Language Models
  3. 2025A Theory of Inference Compute Scaling: Reasoning through Directed Stochastic Skill Search
  4. 2025The Energy Cost of Reasoning: Analyzing Energy Usage in LLMs with Test-time Compute
  5. 2025TokenPowerBench: Benchmarking the Power Consumption of LLM Inference
  6. 2024Inference Scaling Laws: An Empirical Analysis of Compute-Optimal Inference for Problem-Solving with Language Models
  7. 2024LLM2: Let Large Language Models Harness System 2 Reasoning
  8. 2025United Minds or Isolated Agents? Exploring Coordination of LLMs under Cognitive Load Theory