mlsanityData to 14 Oct 2026

Right Reset: Chunking by Prefix Removal

arXiv 2608.04330 ↗First posted 5 Aug 2026cs.CL cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Removing the left context from a causal language model reveals a useful kind of boundary: an edge where the model processes the same right-hand tokens with little change. We turn this observation into prefix-removal probing and introduce Right Reset (RR), which measures preservation of the right-hand hidden-state trajectory. A dynamic program converts RR edge scores into variable-length chunks. On flattened text formed by concatenating topically similar records after deleting their separators and layout, RR recovers 47.7% of the original records as clean units, versus 25.9% for a BGE embedding boundary, the strongest tested conventional baseline without task-specific model training. The gain persists after rendering and OCR. Passive scores from the same Qwen3-4B layer and direct prompting of a same-scale instruction model perform substantially worse on flattened records. Across six language models, RR-selected cuts also undergo consistently less local output disruption than unselected candidate edges. An observed-token likelihood-ratio readout is competitive in some architectures, indicating that the central contribution is the intervention: context dependence itself can provide a boundary signal when surface structure is weak.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 16 of its 27 references that are in the map. First posted on arXiv 5 Aug 2026.

Builds on

16 of 27 references.

References · 16

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2024Qwen2.5 Technical Reportcited by 4,942
  3. 2023Pythia: A Suite for Analyzing Large Language Models Across Training and Scalingcited by 1,786
  4. 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,253
  5. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,252
  6. 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,059
  7. 2019Linguistic Knowledge and Transferability of Contextual Representationscited by 383
  8. 2018Sharp Nearby, Fuzzy Far Away: How Neural Language Models Use Contextcited by 113
  9. 2018Text Segmentation as a Supervised Learning Taskcited by 76
  10. 2024Late Chunking: Contextual Chunk Embeddings Using Long-Context Embedding Modelscited by 73
  11. 2021What Context Features Can Transformer Language Models Use?cited by 50
  12. 2021Language Model as an Annotator: Exploring DialoGPT for Dialogue Summarizationcited by 46
4 more
  1. 2024LumberChunker: Long-Form Narrative Document Segmentationcited by 36
  2. 2017Sequence Modeling via Segmentationscited by 18
  3. 2024Meta-Chunking: Learning Text Segmentation and Semantic Completion via Logical Perceptioncited by 17
  4. 2025BoundRL: Efficient Structured Text Segmentation through Reinforced Boundary Generationcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.