mlsanityData to 7 Oct 2026

SemanticZip: A Pilot Framework for Lossy Text Compression with LLMs as Semantic Decompressors

arXiv 2605.24541 ↗First posted 23 May 2026cs.LG cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Text compression for large language model (LLM) systems is usually framed as token deletion, retrieval, summarization, or exact reconstruction. We study a more aggressive but explicitly lossy setting: compress text into compact codes that an LLM can expand into task-relevant meaning. We call this setting SemanticZip. Unlike lossless compression, SemanticZip does not require byte-identical reconstruction; unlike ordinary summarization, it treats model-based decompression as part of the codec and evaluates whether task-relevant semantic commitments are recovered. This paper is a pilot framework, not a benchmark claim. We formalize LLM-mediated decompression, define a protected/lossy packet architecture, and evaluate six representation regimes over five author-constructed diagnostic cases: structured prose, JSON, CCL-Core, CCL-Min, SemanticZip ASCII, and SemanticZip emoji. An independent decoder LLM reconstructs typed semantic atoms from each compressed representation, and we score Critical Atom Recall, Weighted Atom Recall, precision, and tokenizer gain. In this pilot, structured prose has the highest recoverability, with WAR = 0.956 and 19.1% o200k_base token gain. CCL-Min is the strongest balanced point, with 39.4% token gain and WAR = 0.874. SemanticZip ASCII provides the largest useful compression, with 46.5% token gain and WAR = 0.802, while emoji-heavy SemanticZip performs worse on both compression and recovery. The main contribution is not the claim that these numbers establish a universal frontier. Rather, we introduce a reproducible experimental interface for studying lossy, LLM-decompressible text codes and a design principle: safety-critical and exact commitments should remain protected, while predictable low-risk context may be semantically zipped.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 17 references that are in the map. First posted on arXiv 23 May 2026.

Builds on

11 of 17 references.

References · 11

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  3. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  4. 2020Beyond Accuracy: Behavioral Testing of NLP models with CheckListcited by 979
  5. 2023LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compressioncited by 443
  6. 2023LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Modelscited by 279
  7. 2023Language Modeling Is Compressioncited by 225
  8. 2019Show Your Work: Improved Reporting of Experimental Resultscited by 164
  9. 2023Reproducibility in NLP: What Have We Learned from the Checklist?cited by 18
  10. 2023Semantic Compression With Large Language Modelscited by 17
  11. 2026Compress the Context, Keep the Commitments: A Formal Framework for Verifiable LLM Context Compressioncited by 3

Built on by

Not cited yet.