QwenLong-L1.5: Post-Training Recipe for Long-Context Reasoning and Memory Management
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
We introduce QwenLong-L1.5, a model that achieves superior long-context reasoning capabilities through systematic post-training innovations. The key technical breakthroughs of QwenLong-L1.5 are as follows: (1) Long-Context Data Synthesis Pipeline: We develop a systematic synthesis framework that generates challenging reasoning tasks requiring multi-hop grounding over globally distributed evidence. By deconstructing documents into atomic facts and their underlying relationships, and then programmatically composing verifiable reasoning questions, our approach creates high-quality training data at scale, moving substantially beyond simple retrieval tasks to enable genuine long-range reasoning capabilities. (2) Stabilized Reinforcement Learning for Long-Context Training: To overcome the critical instability in long-context RL, we introduce task-balanced sampling with task-specific advantage estimation to mitigate reward bias, and propose Adaptive Entropy-Controlled Policy Optimization (AEPO) that dynamically regulates exploration-exploitation trade-offs. (3) Memory-Augmented Architecture for Ultra-Long Contexts: Recognizing that even extended context windows cannot accommodate arbitrarily long sequences, we develop a memory management framework with multi-stage fusion RL training that seamlessly integrates single-pass reasoning with iterative memory-based processing for tasks exceeding 4M tokens. Based on Qwen3-30B-A3B-Thinking, QwenLong-L1.5 achieves performance comparable to GPT-5 and Gemini-2.5-Pro on long-context reasoning benchmarks, surpassing its baseline by 9.90 points on average. On ultra-long tasks (1M~4M tokens), QwenLong-L1.5's memory-agent framework yields a 9.48-point gain over the agent baseline. Additionally, the acquired long-context reasoning ability translates to enhanced performance in general domains like scientific reasoning, memory tool using, and extended dialogue.
Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. First posted on arXiv 15 Dec 2025.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2026: 24.
24 papers.
Sort:
By area:
- 2026OPSDL: On-Policy Self-Distillation for Long-Context Language Modelscited by 29
- 2026LongR: Unleashing Long-Context Reasoning via Reinforcement Learning with Dense Utility Rewardscited by 9
- 2026AgentLongBench: A Controllable Long Benchmark For Long-Contexts Agents via Environment Rolloutscited by 8
- 2026MAWARITH: A Dataset and Benchmark for Legal Inheritance Reasoning with LLMscited by 8
- 2026Learning to Remember: End-to-End Training of Memory Agents for Long-Context Reasoningcited by 6
- 2026Dynamic Long Context Reasoning over Compressed Memory via End-to-End Reinforcement Learningcited by 5
- 2026GoLongRL: Capability-Oriented Long Context Reinforcement Learning with Multitask Alignmentcited by 4
- 2026Intern-S2-Preview: Scientific Agentic Foundation Modelcited by 3
- 2026PETS: A Principled Framework Towards Optimal Trajectory Allocation for Efficient Test-Time Self-Consistencycited by 2
- 2026Towards Self-Improving Error Diagnosis in Multi-Agent Systemscited by 2
- 2026Group Entropy-Controlled Policy Optimizationcited by 2
- 2026Incentivizing In-depth Reasoning over Long Contexts with Process Advantage Shapingcited by 1
12 more
- 2026LongVPO: From Anchored Cues to Self-Reasoning for Long-Form Video Preference Optimizationcited by 1
- 2026Probing How Scalable Table Data Enhances General Long-Context Reasoningcited by 1
- 2026A Decomposition Perspective to Long-context Reasoning for LLMscited by 1
- 2026LongTraceRL: Learning Long-Context Reasoning from Search Agent Trajectories with Rubric Rewardscited by 1
- 2026InfoMem: Training Long-Context Memory Agents with Answer-Conditioned Information Gaincited by 1
- 2026Copy Less, Ground More: Overcoming Repetitive Copying in Long-Context Reasoning via Evidence-Aware Reinforcement Learningcited by 1
- 2026Understand and Accelerate Memory Processing Pipeline for Large Language Model Inferencecited by 0
- 2026π2: Structure-Originated Reasoning Data Improves Long-Context Reasoning Ability of Large Language Modelscited by 0
- 2026Beyond Reward Engineering: A Data Recipe for Long-Context Reinforcement Learningcited by 0
- 2026Storyline Trees: Hierarchical Representations for Long-Form Narrativescited by 0
- 2026PI-Mem: Pushing Long-Context Reasoning to 3.6M Tokens with Parallel-Iterative Memorycited by 0
- 2026Mint-Agent: Introducing Finance-Native Agentic Foundation Modelscited by 0
- 2026Mint-Agent: Introducing Finance-Native Agentic Foundation Models17 Aug 2026
- 2026Intern-S2-Preview: Scientific Agentic Foundation Model13 Aug 2026
- 2026PI-Mem: Pushing Long-Context Reasoning to 3.6M Tokens with Parallel-Iterative Memory4 Aug 2026
- 2026Copy Less, Ground More: Overcoming Repetitive Copying in Long-Context Reasoning via Evidence-Aware Reinforcement Learning21 Jul 2026
- 2026Group Entropy-Controlled Policy Optimization18 Jul 2026
- 2026Storyline Trees: Hierarchical Representations for Long-Form Narratives18 Jun 2026
- 2026Beyond Reward Engineering: A Data Recipe for Long-Context Reinforcement Learning17 Jun 2026
- 2026InfoMem: Training Long-Context Memory Agents with Answer-Conditioned Information Gain2 Jun 2026
- 2026LongTraceRL: Learning Long-Context Reasoning from Search Agent Trajectories with Rubric Rewards29 May 2026
- 2026GoLongRL: Capability-Oriented Long Context Reinforcement Learning with Multitask Alignment19 May 2026
- 2026Towards Self-Improving Error Diagnosis in Multi-Agent Systems19 Apr 2026
- 2026OPSDL: On-Policy Self-Distillation for Long-Context Language Models19 Apr 2026
12 more
- 2026A Decomposition Perspective to Long-context Reasoning for LLMs9 Apr 2026
- 2026π2: Structure-Originated Reasoning Data Improves Long-Context Reasoning Ability of Large Language Models6 Apr 2026
- 2026Understand and Accelerate Memory Processing Pipeline for Large Language Model Inference30 Mar 2026
- 2026Probing How Scalable Table Data Enhances General Long-Context Reasoning23 Mar 2026
- 2026MAWARITH: A Dataset and Benchmark for Legal Inheritance Reasoning with LLMs8 Mar 2026
- 2026PETS: A Principled Framework Towards Optimal Trajectory Allocation for Efficient Test-Time Self-Consistency18 Feb 2026
- 2026Learning to Remember: End-to-End Training of Memory Agents for Long-Context Reasoning13 Feb 2026
- 2026Dynamic Long Context Reasoning over Compressed Memory via End-to-End Reinforcement Learning9 Feb 2026
- 2026LongR: Unleashing Long-Context Reasoning via Reinforcement Learning with Dense Utility Rewards5 Feb 2026
- 2026LongVPO: From Anchored Cues to Self-Reasoning for Long-Form Video Preference Optimization2 Feb 2026
- 2026AgentLongBench: A Controllable Long Benchmark For Long-Contexts Agents via Environment Rollouts28 Jan 2026
- 2026Incentivizing In-depth Reasoning over Long Contexts with Process Advantage Shaping18 Jan 2026
- 2026LongR: Unleashing Long-Context Reasoning via Reinforcement Learning with Dense Utility Rewardscited by 9
- 2026MAWARITH: A Dataset and Benchmark for Legal Inheritance Reasoning with LLMscited by 8
- 2026Learning to Remember: End-to-End Training of Memory Agents for Long-Context Reasoningcited by 6
- 2026Dynamic Long Context Reasoning over Compressed Memory via End-to-End Reinforcement Learningcited by 5
- 2026PETS: A Principled Framework Towards Optimal Trajectory Allocation for Efficient Test-Time Self-Consistencycited by 2
- 2026Incentivizing In-depth Reasoning over Long Contexts with Process Advantage Shapingcited by 1
- 2026LongVPO: From Anchored Cues to Self-Reasoning for Long-Form Video Preference Optimizationcited by 1
- 2026Probing How Scalable Table Data Enhances General Long-Context Reasoningcited by 1
- 2026A Decomposition Perspective to Long-context Reasoning for LLMscited by 1
- 2026LongTraceRL: Learning Long-Context Reasoning from Search Agent Trajectories with Rubric Rewardscited by 1
- 2026Copy Less, Ground More: Overcoming Repetitive Copying in Long-Context Reasoning via Evidence-Aware Reinforcement Learningcited by 1
- 2026π2: Structure-Originated Reasoning Data Improves Long-Context Reasoning Ability of Large Language Modelscited by 0
12 most cited of 13 All 13 (JSON)
- 2026PI-Mem: Pushing Long-Context Reasoning to 3.6M Tokens with Parallel-Iterative Memory4 Aug 2026
- 2026Copy Less, Ground More: Overcoming Repetitive Copying in Long-Context Reasoning via Evidence-Aware Reinforcement Learning21 Jul 2026
- 2026LongTraceRL: Learning Long-Context Reasoning from Search Agent Trajectories with Rubric Rewards29 May 2026
- 2026A Decomposition Perspective to Long-context Reasoning for LLMs9 Apr 2026
- 2026π2: Structure-Originated Reasoning Data Improves Long-Context Reasoning Ability of Large Language Models6 Apr 2026
- 2026Probing How Scalable Table Data Enhances General Long-Context Reasoning23 Mar 2026
- 2026MAWARITH: A Dataset and Benchmark for Legal Inheritance Reasoning with LLMs8 Mar 2026
- 2026PETS: A Principled Framework Towards Optimal Trajectory Allocation for Efficient Test-Time Self-Consistency18 Feb 2026
- 2026Learning to Remember: End-to-End Training of Memory Agents for Long-Context Reasoning13 Feb 2026
- 2026Dynamic Long Context Reasoning over Compressed Memory via End-to-End Reinforcement Learning9 Feb 2026
- 2026LongR: Unleashing Long-Context Reasoning via Reinforcement Learning with Dense Utility Rewards5 Feb 2026
- 2026LongVPO: From Anchored Cues to Self-Reasoning for Long-Form Video Preference Optimization2 Feb 2026
12 newest of 13 All 13 (JSON)
- 2026AgentLongBench: A Controllable Long Benchmark For Long-Contexts Agents via Environment Rolloutscited by 8
- 2026Intern-S2-Preview: Scientific Agentic Foundation Modelcited by 3
- 2026Towards Self-Improving Error Diagnosis in Multi-Agent Systemscited by 2
- 2026InfoMem: Training Long-Context Memory Agents with Answer-Conditioned Information Gaincited by 1
- 2026Mint-Agent: Introducing Finance-Native Agentic Foundation Modelscited by 0
- 2026Mint-Agent: Introducing Finance-Native Agentic Foundation Models17 Aug 2026
- 2026Intern-S2-Preview: Scientific Agentic Foundation Model13 Aug 2026
- 2026InfoMem: Training Long-Context Memory Agents with Answer-Conditioned Information Gain2 Jun 2026
- 2026Towards Self-Improving Error Diagnosis in Multi-Agent Systems19 Apr 2026
- 2026AgentLongBench: A Controllable Long Benchmark For Long-Contexts Agents via Environment Rollouts28 Jan 2026
- 2026OPSDL: On-Policy Self-Distillation for Long-Context Language Modelscited by 29
- 2026GoLongRL: Capability-Oriented Long Context Reinforcement Learning with Multitask Alignmentcited by 4
- 2026Group Entropy-Controlled Policy Optimizationcited by 2
- 2026Beyond Reward Engineering: A Data Recipe for Long-Context Reinforcement Learningcited by 0
- 2026Storyline Trees: Hierarchical Representations for Long-Form Narrativescited by 0
- 2026Group Entropy-Controlled Policy Optimization18 Jul 2026
- 2026Storyline Trees: Hierarchical Representations for Long-Form Narratives18 Jun 2026
- 2026Beyond Reward Engineering: A Data Recipe for Long-Context Reinforcement Learning17 Jun 2026
- 2026GoLongRL: Capability-Oriented Long Context Reinforcement Learning with Multitask Alignment19 May 2026
- 2026OPSDL: On-Policy Self-Distillation for Long-Context Language Models19 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025QwenLong-L1: Towards Long-Context Large Reasoning Models with Reinforcement Learning
- 2025LoongRL: Reinforcement Learning for Advanced Reasoning over Long Contexts
- 2025PERK: Long-Context Reasoning as Test-Time Learning
- 2026Training Large Reasoning Models Efficiently via Progressive Thought Encoding
- 2026Long-Context Reasoning Through Proxy-Based Chain-of-Thought Tuning
- 2025Scaling Up RL: Unlocking Diverse Reasoning in LLMs via Prolonged Training
- 2025Reasoning Under 1 Billion: Memory-Augmented Reinforcement Learning for Large Language Models
- 2026LongAct: Harnessing Intrinsic Activation Patterns for Long-Context Reinforcement Learning