mlsanityData to 7 Oct 2026

Enhancing Large Language Model Efficiencyvia Symbolic Compression: A Formal Approach Towards Interpretability

arXiv 2501.18657 ↗First posted 30 Jan 2025cs.AI cs.SEcited by 1

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Large language models (LLMs) face significant token efficiency bottlenecks in code generation and logical reasoning tasks, a challenge that directly impacts inference cost and model interpretability. This paper proposes a formal framework based on symbolic compression,integrating combinatory logic, information-theoretic optimal encoding, and context-aware inference techniques to achieve a step-change improvement in token efficiency while preserving semantic integrity. We establish a mathematical framework within a functional programming paradigm, derive the quantitative relationship between symbolic density and model interpretability, and propose a differentiable compression factor metric to evaluate encoding efficiency. Furthermore, we leverage parameter-efficient fine-tuning (PEFT) techniques to achieve a low-cost application of the GAEL language. Experimental results show that this method achieves a 78.3% token compression rate in code generation tasks while improving logical traceability by 62% through structural explicitness. This research provides new theoretical tools for efficient inference in LLMs and opens a symbolic path for modelinterpretability research.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. First posted on arXiv 30 Jan 2025.

Builds on

0 of 0 references.

No references here yet.

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Information Capacity: Evaluating the Efficiency of Large Language Models via Text Compression
  2. 2025Revitalizing Black-Box Interpretability: Actionable Interpretability for LLMs via Proxy Models
  3. 2025R1-Compress: Long Chain-of-Thought Compression via Chunk Compression and Search
  4. 2025OckBench: Measuring the Efficiency of LLM Reasoning
  5. 2025TokenSkip: Controllable Chain-of-Thought Compression in LLMs
  6. 2026Shorthand for Thought: Compressing LLM Reasoning via Entropy-Guided Supertokens
  7. 2024Enhancing and Accelerating Large Language Models via Instruction-Aware Contextual Compression
  8. 2024A Survey on Efficient Inference for Large Language Models