mlsanityData to 7 Oct 2026

Reasoning Depth and Environment Complexity: A Controlled Study of RLVR Data Allocation across Logical Reasoning Tasks

arXiv 2605.26934 ↗First posted 26 May 2026cs.CL cs.AIcited by 0

On the map: LLM reasoning → Reinforcement learning for reasoning

Abstract (arXiv)

Reinforcement learning with verifiable rewards (RLVR) has become central to post-training reasoning models, yet a key limitation of existing studies is their narrow view of the reasoning space: difficulty is treated as reasoning depth alone, and reward is concentrated on forward deductive state tracking. We instead characterize the reasoning space along two dimensions. Difficulty. Beyond reasoning depth, we study environment complexity, where models must identify the correct path amid distractors and interacting structures. Rewarded reasoning form. We consider four abilities core to real-world reasoning: deductive state tracking, abductive recovery of hidden events or facts, inductive rule induction, and analogical transfer. To disentangle these factors, we construct a synthetic knowledge-graph environment with controlled pre- and post-training distributions, where each instance varies along depth, complexity, and task family. Three findings emerge: joint depth-complexity coverage outperforms single-axis recipes; reasoning families respond non-uniformly, with abductive reasoning degrading outside the RL-covered region and task correlations clustering into deductive-abductive and inductive-analogy pairs; and uniform mixing outperforms staged curricula under a fixed budget. We also find that recent off-the-shelf models exhibit the same deductive-over-abductive asymmetry, suggesting that this gap is not merely an artifact of our controlled setup.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reinforcement learning for reasoning, one of 17 directions in LLM reasoning. Builds on 11 of its 63 references that are in the map. First posted on arXiv 26 May 2026.

Builds on

11 of 63 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026Can RL Teach Long-Horizon Reasoning to LLMs? Expressiveness Is Key7 May
  2. 2025Can GRPO Help LLMs Transcend Their Pretraining Origin?14 Oct
  3. 2025VCRL: Variance-based Curriculum Reinforcement Learning for Large Language Models24 Sep
  4. 2025RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning10 Jul
  5. 2025EFRame: Deeper Reasoning via Exploration-Filter-Replay Reinforcement Learning Framework27 Jun

Other references · 6

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2024Qwen2.5 Technical Reportcited by 4,713
  4. 2023TinyStories: How Small Can Language Models Be and Still Speak Coherent English?cited by 425
  5. 2025Phi-4-reasoning Technical Reportcited by 146
  6. 2026MolQuest: A Benchmark for Agentic Evaluation of Abductive Reasoning in Chemical Structure Elucidationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Beyond Pass@k: Breadth-Depth Metrics for Reasoning Boundaries
  2. 2026New Skills or Sharper Primitives? A Probabilistic Perspective on the Emergence of Reasoning in RLVR
  3. 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?
  4. 2026SAGE: Shaping Anchors for Guided Exploration in RLVR of LLMs
  5. 2025The Reasoning Boundary Paradox: How Reinforcement Learning Constrains Language Models
  6. 2025Distributional Biases in Post-Training: A Markovian Analysis of Reasoning Trajectories
  7. 2025RL Squeezes, SFT Expands: A Comparative Study of Reasoning LLMs
  8. 2025Reasoning Pattern Matters: Learning to Reason without Human Rationales