STRETCH the Boundaries: A Unified Self-Taught Framework for Progressive LLM Evolution
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) often suffer from capability stagnation in self-improvement training because fixed difficulty levels fail to adapt to their evolving proficiency. To address this issue, we propose STRETCH (Self-Taught Reasoning Evolution via Targeted CHallenge), a unified framework inspired by cognitive scaffolding theory. STRETCH introduces a dynamic Stretch Zone mechanism that continuously aligns question difficulty with the model's solving capability. Within a single parameter space, the model alternates between a Scaffolder that generates adaptive, boundary-pushing challenges and a Learner that that optimizes its solving trajectories through reinforcement learning. This dual-loop co-evolution effectively stabilizes training, mitigates reward hacking and promote progressive reasoning growth. Experiments on both negotiation and operation research benchmarks demonstrate that STRETCH consistently outperforms strong prompting and domain-specific baselines. Further scaffolder configuration analysis shows that dynamic difficulty alignment is critical for sustained capability improvement and synchronized reasoning evolution.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 47 references that are in the map. First posted on arXiv 16 Sep 2026.
Builds on
27 of 47 references.
References · 27
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Datacited by 323
- 2025R-Zero: Self-Evolving Reasoning LLM from Zero Datacited by 210
- 2018Decoupling Strategy and Generation in Negotiation Dialoguescited by 156
- 2023NL4Opt Competition: Formulating Optimization Problems Based on Their Natural Language Descriptionscited by 133
- 2025Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memorycited by 129
- 2024ORLM: A Customizable Framework in Training Large Models for Automated Optimization Modelingcited by 124
- 2025CollabLLM: From Passive Responders to Active Collaboratorscited by 117
- 2023Prompting and Evaluating Large Language Models for Proactive Dialogues: Clarification, Target-guided, and Non-collaborationcited by 115
- 2025Agentic Reasoning: A Streamlined Framework for Enhancing LLM Reasoning with Agentic Toolscited by 106
15 more
- 2024LLMOPT: Learning to Define and Solve General Optimization Problems from Scratchcited by 102
- 2025Critique-GRPO: Advancing LLM Reasoning with Natural Language and Numerical Feedbackcited by 86
- 2023Prompt-Based Monte-Carlo Tree Search for Goal-Oriented Dialogue Policy Planningcited by 60
- 2025SPC: Evolving Self-Play Critic via Adversarial Games for LLM Reasoningcited by 40
- 2025GenEnv: Difficulty-Aligned Co-Evolution Between LLM Agents and Environment Simulatorscited by 34
- 2024Planning Like Human: A Dual-process Framework for Dialogue Planningcited by 32
- 2025StepORLM: A Self-Evolving Framework With Generative Process Supervision For Operations Research Language Modelscited by 26
- 2026From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanismscited by 19
- 2026Self-Play Only Evolves When Self-Synthetic Pipeline Ensures Learnable Information Gaincited by 16
- 2025Staying in the Sweet Spot: Responsive Reasoning Evolution via Capability-Adaptive Hint Scaffoldingcited by 15
- 2026TTCS: Test-Time Curriculum Synthesis for Self-Evolvingcited by 15
- 2026G-Zero: Self-Play for Open-Ended Generation from Zero Datacited by 15
- 2025Guiding Reasoning in Small Language Models with LLM Assistancecited by 13
- 2025Investigating the Zone of Proximal Development of Language Models for In-Context Learningcited by 6
- 2026Duel-Evolve: Reward-Free Test-Time Scaling via LLM Self-Preferencescited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Learning Like Humans: Advancing LLM Reasoning Capabilities via Adaptive Difficulty Curriculum Learning and Expert-Guided Self-Reformulation
- 2026D2Evo: Dual Difficulty-Aware Self-Evolution for Data-Efficient Reinforcement Learning
- 2025How Difficulty-Aware Staged Reinforcement Learning Enhances LLMs' Reasoning Capabilities: A Preliminary Experimental Study
- 2025The Path of Self-Evolving Large Language Models: Achieving Data-Efficient Learning via Intrinsic Feedback
- 2026DRIFT: Difficulty Routing Self-DIstillation with Rhythm-Gated Exploration and Success BuFfer Training
- 2026DIVE: Unlocking Self-Improvement in Frozen Language Models Through Diversity-Driven Skill Evolution
- 2025From Efficiency to Adaptivity: A Deeper Look at Adaptive Reasoning in Large Language Models
- 2026Policy of Thoughts: Scaling Test-Time Training for LLM Reasoning via Online Policy Evolution