# Llamazip: Leveraging LLaMA for Lossless Text Compression and Training Dataset Detection

arXiv: https://arxiv.org/abs/2511.17589 · HTML: https://mlsanity.com/paper/2511.17589/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 0 of its 12 references that are in the map.
- First posted on arXiv 16 Nov 2025.

## Built on by (most cited first, 1 of 1)

- [Nacrith: Neural Lossless Compression via Ensemble Context Modeling and High-Precision CDF Coding](https://mlsanity.com/paper/2602.19626/) (2026)

## Abstract (arXiv)

This work introduces Llamazip, a novel lossless text compression algorithm based on the predictive capabilities of the LLaMA3 language model. Llamazip achieves significant data reduction by only storing tokens that the model fails to predict, optimizing storage efficiency without compromising data integrity. Key factors affecting its performance, including quantization and context window size, are analyzed, revealing their impact on compression ratios and computational requirements. Beyond compression, Llamazip demonstrates the potential to identify whether a document was part of the training dataset of a language model. This capability addresses critical concerns about data provenance, intellectual property, and transparency in language model training.