mlsanityData to 14 Oct 2026

DISCO: Distributed Long Context Scaling with Grounding-Reasoning Disaggregation

arXiv 2609.33485 ↗First posted 27 Sep 2026cs.CLcited by 0

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

While Large Language Models (LLMs) advertise million-token context windows, reasoning quality often collapses as inputs grow -- a phenomenon termed context rot. This failure stems from a structural entanglement in monolithic architectures, where the massive search burden of contextual grounding exhausts the representational capacity needed for complex reasoning. To resolve this, we propose Grounding-Reasoning Disaggregation via DIStributed long COntext scaling (DISCO). Inspired by distributed computing frameworks like Apache Spark, DISCO partitions long context across a fleet of Worker LLMs dedicated exclusively to parallel, localized grounding. A central Driver LLM, trained via Reinforcement Learning (GRPO) to optimize planning, orchestrates execution by dynamically mapping queries into atomic extraction tasks and reducing the gathered evidence to synthesize a final answer. By isolating reasoning from raw context noise, DISCO effectively eliminates context rot. On RULER-QA (1M tokens), it maintains 78.4% accuracy where standard baselines collapse. Furthermore, it outperforms full-context models by up to 9.8 points on LongBench v2 and matches frontier models like Gemini-3-Pro-Preview while reducing inference costs by over 80%, establishing a highly efficient paradigm for robust long-context inference.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 25 of its 36 references that are in the map. First posted on arXiv 27 Sep 2026.

Builds on

25 of 36 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Recursive Language Models31 Dec
  2. 2024Titans: Learning to Memorize at Test Time31 Dec

Other references · 23

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  5. 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,346
  6. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 779
  7. 2023Extending Context Window of Large Language Models via Positional Interpolationcited by 740
  8. 2023YaRN: Efficient Context Window Extension of Large Language Modelscited by 601
  9. 2024LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context Multitaskscited by 379
  10. 2023Effective Long-Context Scaling of Foundation Modelscited by 303
  11. 2025Memory in the Age of AI Agentscited by 303
  12. 2025MemAgent: Reshaping Long-Context LLM with Multi-Conv RL-based Memory Agentcited by 246
11 more
  1. 2025MEM1: Learning to Synergize Memory and Reasoning for Efficient Long-Horizon Agentscited by 238
  2. 2025NoLiMa: Long-Context Evaluation Beyond Literal Matchingcited by 126
  3. 2025Winning Gold at IMO 2025 with a Model-Agnostic Verification-and-Refinement Pipelinecited by 82
  4. 2025MemOS: An Operating System for Memory-Augmented Generation (MAG) in Large Language Modelscited by 73
  5. 2025It's All Connected: A Journey Through Test-Time Memorization, Attentional Bias, Retention, and Online Optimizationcited by 64
  6. 2025End-to-End Test-Time Training for Long Contextcited by 62
  7. 2025General Agentic Memory Via Deep Researchcited by 47
  8. 2024LongAgent: Scaling Language Models to 128k Context through Multi-Agent Collaborationcited by 38
  9. 2025Rethinking Memory in LLM based Agents: Representations, Operations, and Emerging Topicscited by 36
  10. 2024Are Long-LLMs A Necessity For Long-Context Tasks?cited by 22
  11. 2024LLM×MapReduce: Simplified Long-Sequence Processing using Large Language Modelscited by 17

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026A Decomposition Perspective to Long-context Reasoning for LLMs
  2. 2025Beyond Context Limits: Subconscious Threads for Long-Horizon Reasoning
  3. 2026Escaping the Context Bottleneck: Active Context Curation for LLM Agents via Reinforcement Learning
  4. 2025InftyThink: Breaking the Length Limits of Long-Context Reasoning in Large Language Models
  5. 2026LongAttnComp: Cross-Family Context Compression for Long-Context Reasoning
  6. 2026Divergent-Convergent Reasoning: Scaling Test-Time Compute through Structured Solution Synthesis
  7. 2026Batched Contextual Reinforcement: A Task-Scaling Law for Efficient Reasoning
  8. 2025ContextPilot: Fast Long-Context Inference via Context Reuse