# Prompt and context compression

Area: [Efficient LLM inference and serving](https://mlsanity.com/inference/index.md). HTML: https://mlsanity.com/inference/prompt-and-context-compression/

## Key facts

- Prompt and context compression: 132 papers on arXiv since 2022 (data through 7 Oct 2026).
- 72 of its 132 mapped papers (55%) cite “LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression” (2024, arXiv 2403.12968).
- 67 of its 132 mapped papers (51%) cite “LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression” (2023, arXiv 2310.06839).
- 3 new papers 24 Sep–7 Oct.

## Most cited here

- [LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression](https://mlsanity.com/paper/2403.12968/) (2024), cited by 72 papers here
- [LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression](https://mlsanity.com/paper/2310.06839/) (2023), cited by 67 papers here
- [In-context Autoencoder for Context Compression in a Large Language Model](https://mlsanity.com/paper/2307.06945/) (2023), cited by 30 papers here
- [Prompt Compression and Contrastive Conditioning for Controllability and Toxicity Reduction in Language Models](https://mlsanity.com/paper/2210.03162/) (2022), cited by 27 papers here
- [xRAG: Extreme Context Compression for Retrieval-augmented Generation with One Token](https://mlsanity.com/paper/2405.13792/) (2024), cited by 27 papers here
- [Discrete Prompt Compression with Reinforcement Learning](https://mlsanity.com/paper/2308.08758/) (2023), cited by 22 papers here
- [Prompt Compression with Context-Aware Sentence Encoding for Fast and Improved LLM Inference](https://mlsanity.com/paper/2409.01227/) (2024), cited by 21 papers here
- [500xCompressor: Generalized Prompt Compression for Large Language Models](https://mlsanity.com/paper/2408.03094/) (2024), cited by 16 papers here
- [Long Context Compression with Activation Beacon](https://mlsanity.com/paper/2401.03462/) (2024), cited by 15 papers here
- [Prompt Compression for Large Language Models: A Survey](https://mlsanity.com/paper/2410.12388/) (2024), cited by 14 papers here

## New (24 Sep–7 Oct)

- [Aperture: Merge-Consistent Rotary States for Compressed Tokens](https://mlsanity.com/paper/2609.36781/) (2026-09-29)
- [PC-SubMax: Efficient Prompt Compression via Regularized Submodular Maximization](https://mlsanity.com/paper/2609.32474/) (2026-09-26)
- [HasMem: Hard-Origin Adaptively Softened Memory for Long-Term LLM Agents](https://mlsanity.com/paper/2609.30797/) (2026-09-25)