mlsanityData to 7 Oct 2026

QwenLong-L1.5: Post-Training Recipe for Long-Context Reasoning and Memory Management

arXiv 2512.12967 ↗First posted 15 Dec 2025cs.CLcited by 24

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

We introduce QwenLong-L1.5, a model that achieves superior long-context reasoning capabilities through systematic post-training innovations. The key technical breakthroughs of QwenLong-L1.5 are as follows: (1) Long-Context Data Synthesis Pipeline: We develop a systematic synthesis framework that generates challenging reasoning tasks requiring multi-hop grounding over globally distributed evidence. By deconstructing documents into atomic facts and their underlying relationships, and then programmatically composing verifiable reasoning questions, our approach creates high-quality training data at scale, moving substantially beyond simple retrieval tasks to enable genuine long-range reasoning capabilities. (2) Stabilized Reinforcement Learning for Long-Context Training: To overcome the critical instability in long-context RL, we introduce task-balanced sampling with task-specific advantage estimation to mitigate reward bias, and propose Adaptive Entropy-Controlled Policy Optimization (AEPO) that dynamically regulates exploration-exploitation trade-offs. (3) Memory-Augmented Architecture for Ultra-Long Contexts: Recognizing that even extended context windows cannot accommodate arbitrarily long sequences, we develop a memory management framework with multi-stage fusion RL training that seamlessly integrates single-pass reasoning with iterative memory-based processing for tasks exceeding 4M tokens. Based on Qwen3-30B-A3B-Thinking, QwenLong-L1.5 achieves performance comparable to GPT-5 and Gemini-2.5-Pro on long-context reasoning benchmarks, surpassing its baseline by 9.90 points on average. On ultra-long tasks (1M~4M tokens), QwenLong-L1.5's memory-agent framework yields a 9.48-point gain over the agent baseline. Additionally, the acquired long-context reasoning ability translates to enhanced performance in general domains like scientific reasoning, memory tool using, and extended dialogue.

Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. First posted on arXiv 15 Dec 2025.

Builds on

0 of 0 references.

No references here yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 24.

24 papers.

Sort:

By area:

  1. 2026OPSDL: On-Policy Self-Distillation for Long-Context Language Modelscited by 29
  2. 2026LongR: Unleashing Long-Context Reasoning via Reinforcement Learning with Dense Utility Rewardscited by 9
  3. 2026AgentLongBench: A Controllable Long Benchmark For Long-Contexts Agents via Environment Rolloutscited by 8
  4. 2026MAWARITH: A Dataset and Benchmark for Legal Inheritance Reasoning with LLMscited by 8
  5. 2026Learning to Remember: End-to-End Training of Memory Agents for Long-Context Reasoningcited by 6
  6. 2026Dynamic Long Context Reasoning over Compressed Memory via End-to-End Reinforcement Learningcited by 5
  7. 2026GoLongRL: Capability-Oriented Long Context Reinforcement Learning with Multitask Alignmentcited by 4
  8. 2026Intern-S2-Preview: Scientific Agentic Foundation Modelcited by 3
  9. 2026PETS: A Principled Framework Towards Optimal Trajectory Allocation for Efficient Test-Time Self-Consistencycited by 2
  10. 2026Towards Self-Improving Error Diagnosis in Multi-Agent Systemscited by 2
  11. 2026Group Entropy-Controlled Policy Optimizationcited by 2
  12. 2026Incentivizing In-depth Reasoning over Long Contexts with Process Advantage Shapingcited by 1
12 more
  1. 2026LongVPO: From Anchored Cues to Self-Reasoning for Long-Form Video Preference Optimizationcited by 1
  2. 2026Probing How Scalable Table Data Enhances General Long-Context Reasoningcited by 1
  3. 2026A Decomposition Perspective to Long-context Reasoning for LLMscited by 1
  4. 2026LongTraceRL: Learning Long-Context Reasoning from Search Agent Trajectories with Rubric Rewardscited by 1
  5. 2026InfoMem: Training Long-Context Memory Agents with Answer-Conditioned Information Gaincited by 1
  6. 2026Copy Less, Ground More: Overcoming Repetitive Copying in Long-Context Reasoning via Evidence-Aware Reinforcement Learningcited by 1
  7. 2026Understand and Accelerate Memory Processing Pipeline for Large Language Model Inferencecited by 0
  8. 2026π2: Structure-Originated Reasoning Data Improves Long-Context Reasoning Ability of Large Language Modelscited by 0
  9. 2026Beyond Reward Engineering: A Data Recipe for Long-Context Reinforcement Learningcited by 0
  10. 2026Storyline Trees: Hierarchical Representations for Long-Form Narrativescited by 0
  11. 2026PI-Mem: Pushing Long-Context Reasoning to 3.6M Tokens with Parallel-Iterative Memorycited by 0
  12. 2026Mint-Agent: Introducing Finance-Native Agentic Foundation Modelscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025QwenLong-L1: Towards Long-Context Large Reasoning Models with Reinforcement Learning
  2. 2025LoongRL: Reinforcement Learning for Advanced Reasoning over Long Contexts
  3. 2025PERK: Long-Context Reasoning as Test-Time Learning
  4. 2026Training Large Reasoning Models Efficiently via Progressive Thought Encoding
  5. 2026Long-Context Reasoning Through Proxy-Based Chain-of-Thought Tuning
  6. 2025Scaling Up RL: Unlocking Diverse Reasoning in LLMs via Prolonged Training
  7. 2025Reasoning Under 1 Billion: Memory-Augmented Reinforcement Learning for Large Language Models
  8. 2026LongAct: Harnessing Intrinsic Activation Patterns for Long-Context Reinforcement Learning