mlsanityData to 7 Oct 2026

Batched Contextual Reinforcement: A Task-Scaling Law for Efficient Reasoning

arXiv 2604.02322 ↗First posted 2 Apr 2026cs.LG cs.AI cs.CLcited by 0

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Large Language Models employing Chain-of-Thought reasoning achieve strong performance but suffer from excessive token consumption that inflates inference costs. Existing efficiency methods such as explicit length penalties, difficulty estimators, or multi-stage curricula either degrade reasoning quality or require complex training pipelines. We introduce Batched Contextual Reinforcement, a minimalist, single-stage training paradigm that unlocks efficient reasoning through a simple structural modification: training the model to solve N problems simultaneously within a shared context window, rewarded purely by per-instance accuracy. This formulation creates an implicit token budget that yields several key findings: (1) We identify a novel task-scaling law: as the number of concurrent problems N increases during inference, per-problem token usage decreases monotonically while accuracy degrades far more gracefully than baselines, establishing N as a controllable throughput dimension. (2) BCR challenges the traditional accuracy-efficiency trade-off by demonstrating a "free lunch" phenomenon at standard single-problem inference. Across both 1.5B and 4B model families, BCR reduces token usage by 15.8% to 62.6% while consistently maintaining or improving accuracy across five major mathematical benchmarks. (3) Qualitative analyses reveal emergent self-regulated efficiency, where models autonomously eliminate redundant metacognitive loops without explicit length supervision. (4) Crucially, we empirically demonstrate that implicit budget constraints successfully circumvent the adversarial gradients and catastrophic optimization collapse inherent to explicit length penalties, offering a highly stable, constraint-based alternative for length control. These results prove BCR practical, showing simple structural incentives unlock latent high-density reasoning in LLMs.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 27 of its 34 references that are in the map. First posted on arXiv 2 Apr 2026.

Builds on

27 of 34 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025Adaptive Dual Reasoner: Large Reasoning Models Can Think Efficiently by Hybrid Reasoning11 Oct
  2. 2025ARM2: Adaptive Reasoning Model with Vision Understanding and Executable Code9 Oct
  3. 2025e3: Learning to Explore Enables Extrapolation of Test-Time Compute for LLMs10 Jun
  4. 2025The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity7 Jun
  5. 2025Just Enough Thinking: Efficient Reasoning with Adaptive Length Penalties Reinforcement Learning5 Jun
  6. 2025Thinker: Learning to Think Fast and Slow27 May
  7. 2025SelfBudgeter: Adaptive Token Allocation for Efficient LLM Reasoning16 May
  8. 2025ShorterBetter: Guiding Reasoning Models to Find Optimal Inference Length for Efficient Reasoning30 Apr
  9. 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning6 Mar
  10. 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs30 Dec

Other references · 17

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  5. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  6. 2024OpenAI o1 System Cardcited by 1,220
  7. 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 988
  8. 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 319
  9. 2025Reinforcement Learning for Reasoning in Large Language Models with One Training Examplecited by 288
  10. 2025MathArena: Evaluating LLMs on Uncontaminated Math Competitionscited by 275
  11. 2025DeepMath-103K: A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoningcited by 261
  12. 2025ProRL: Prolonged Reinforcement Learning Expands Reasoning Boundaries in Large Language Modelscited by 187
5 more
  1. 2025JustRL: Scaling a 1.5B LLM with a Simple RL Recipecited by 57
  2. 2025ARM: Adaptive Reasoning Modelcited by 38
  3. 2025Think or Not? Selective Reasoning via Reinforcement Learning for Vision-Language Modelscited by 30
  4. 2025FastCuRL: Curriculum Reinforcement Learning with Stage-wise Context Scaling for Efficient Training R1-like Reasoning Modelscited by 26
  5. 2025BroRL: Scaling Reinforcement Learning via Broadened Explorationcited by 23

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025The Markovian Thinker: Architecture-Agnostic Linear Scaling of Reasoning
  2. 2026The Art of Efficient Reasoning: Data, Reward, and Optimization
  3. 2026Knowing When Thinking Is Not Enough: Teaching Small Reasoning Models to Reason Beyond Their Parametric Knowledge
  4. 2025Making Small Language Models Efficient Reasoners: Intervention, Supervision, Reinforcement
  5. 2025Training Language Models to Reason Efficiently
  6. 2026Long-Context Reasoning Through Proxy-Based Chain-of-Thought Tuning
  7. 2025Rethinking Inference-Time Scaling: Efficiency Limits and Linguistic Signals
  8. 2025The Price of a Second Thought: On the Evaluation of Reasoning Efficiency in Large Language Models