mlsanityData to 14 Oct 2026

ACR: Adaptive Context Refactoring via Context Refactoring Operators for Multi-Turn Dialogue

arXiv 2601.05589 ↗First posted 9 Jan 2026cs.CL cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) have shown remarkable performance in multi-turn dialogue. However, in multi-turn dialogue, models still struggle to stay aligned with what has been established earlier, follow dependencies across many turns, and avoid drifting into incorrect facts as the interaction grows longer. Existing approaches primarily focus on extending the context window, introducing external memory, or applying context compression, yet these methods still face limitations such as contextual inertia and state drift. To address these challenges, we propose the Adaptive Context Refactoring (ACR) Framework, which dynamically monitors and reshapes the interaction history to mitigate contextual inertia and state drift actively. ACR is built on a library of context refactoring operators and a teacher-guided self-evolving training paradigm that learns when to intervene and how to refactor, thereby decoupling context management from the reasoning process. Extensive experiments on multi-turn dialogue demonstrate that our method significantly outperforms existing baselines while reducing token consumption.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 19 of its 35 references that are in the map. First posted on arXiv 9 Jan 2026.

Builds on

19 of 35 references.

References · 19

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
  4. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  5. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  6. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
  7. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
  8. 2023LongBench: A Bilingual, Multitask Benchmark for Long Context Understandingcited by 1,417
  9. 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,282
  10. 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,128
  11. 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,075
  12. 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 923
7 more
  1. 2023Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergycited by 346
  2. 2024The Power of Noise: Redefining Retrieval for RAG Systemscited by 281
  3. 2022On the Origin of Hallucinations in Conversational Models: Is it the Datasets or the Models?cited by 138
  4. 2025StepSearch: Igniting LLMs Search Ability via Step-Wise Proximal Policy Optimizationcited by 88
  5. 2022Keep Me Updated! Memory Management in Long-term Conversationscited by 63
  6. 2024Learning to Compress Prompt in Natural Language Formatscited by 55
  7. 2022Retrieval as Attention: End-to-end Learning of Retrieval and Reading within a Single Transformercited by 45

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Context-Agent: Dynamic Discourse Trees for Non-Linear Dialogue
  2. 2026You Changed Your Mind, The Model Didn't: Demystifying Intent in Multi-Turn Dialogue
  3. 2026Context-Driven Incremental Compression for Multi-Turn Dialogue Generation
  4. 2026Improving Multi-turn Dialogue Consistency with Self-Recall Thinking
  5. 2026Beyond Continuity: Challenges of Context Switching in Multi-Turn Dialogue with LLMs
  6. 2025Beyond Single-Turn: A Survey on Multi-Turn Interactions with Large Language Models
  7. 2025A Survey on Multi-Turn Interaction Capabilities of Large Language Models
  8. 2025Overcoming State Inertia: Minimally Invasive Temporal Alignment for Evolving Contexts