Right Reset: Chunking by Prefix Removal
Not on the map. Why?
Abstract (arXiv)
Removing the left context from a causal language model reveals a useful kind of boundary: an edge where the model processes the same right-hand tokens with little change. We turn this observation into prefix-removal probing and introduce Right Reset (RR), which measures preservation of the right-hand hidden-state trajectory. A dynamic program converts RR edge scores into variable-length chunks. On flattened text formed by concatenating topically similar records after deleting their separators and layout, RR recovers 47.7% of the original records as clean units, versus 25.9% for a BGE embedding boundary, the strongest tested conventional baseline without task-specific model training. The gain persists after rendering and OCR. Passive scores from the same Qwen3-4B layer and direct prompting of a same-scale instruction model perform substantially worse on flattened records. Across six language models, RR-selected cuts also undergo consistently less local output disruption than unselected candidate edges. An observed-token likelihood-ratio readout is competitive in some architectures, indicating that the central contribution is the intervention: context dependence itself can provide a boundary signal when surface structure is weak.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 16 of its 27 references that are in the map. First posted on arXiv 5 Aug 2026.
Builds on
16 of 27 references.
References · 16
- 2025Qwen3 Technical Reportcited by 8,820
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2023Pythia: A Suite for Analyzing Large Language Models Across Training and Scalingcited by 1,786
- 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,253
- 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,252
- 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,059
- 2019Linguistic Knowledge and Transferability of Contextual Representationscited by 383
- 2018Sharp Nearby, Fuzzy Far Away: How Neural Language Models Use Contextcited by 113
- 2018Text Segmentation as a Supervised Learning Taskcited by 76
- 2024Late Chunking: Contextual Chunk Embeddings Using Long-Context Embedding Modelscited by 73
- 2021What Context Features Can Transformer Language Models Use?cited by 50
- 2021Language Model as an Annotator: Exploring DialoGPT for Dialogue Summarizationcited by 46
4 more
- 2024LumberChunker: Long-Form Narrative Document Segmentationcited by 36
- 2017Sequence Modeling via Segmentationscited by 18
- 2024Meta-Chunking: Learning Text Segmentation and Semantic Completion via Logical Perceptioncited by 17
- 2025BoundRL: Efficient Structured Text Segmentation through Reinforced Boundary Generationcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.