mlsanityData to 14 Oct 2026

STRIDE: Strategic Trajectory Reasoning via Discriminative Estimation for Verifiable Reinforcement Learning

arXiv 2606.15866 ↗First posted 14 Jun 2026cs.AI cs.LGcited by 10

On the map: LLM reasoning → Reinforcement learning for reasoning

Abstract (arXiv)

Reinforcement Learning with Verifiable Rewards (RLVR) has become an effective post-training paradigm for improving the reasoning abilities of large language models. However, existing RLVR methods typically rely on final-answer correctness to assign trajectory-level rewards, providing sparse supervision and treating all tokens uniformly regardless of their actual contribution to reasoning. Although recent studies introduce intermediate signals such as process rewards, high-entropy tokens, and semantic uncertainty, these signals are often not inherently verifiable and may fail to distinguish beneficial strategic patterns from harmful ones. To address this limitation, we propose STRIDE (Strategic Trajectory Reasoning with Discriminative Estimation), a fine-grained RLVR framework that derives strategic reasoning supervision from verifiable outcomes. STRIDE contrasts successful and failed trajectories within each response group to estimate the outcome-discriminative preference of each n-gram strategic pattern, and further combines this signal with reasoning saliency entropy to identify decision-relevant strategic patterns. These patterns are assigned differentiated advantage values during RL optimization, enabling more precise credit assignment while preserving the verifiability of RLVR. Extensive experiments demonstrate that STRIDE consistently improves reasoning performance across diverse models, tasks, and extended settings, including VLMs and agent-based systems.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in Reinforcement learning for reasoning, one of 17 directions in LLM reasoning. Builds on 22 of its 38 references that are in the map. First posted on arXiv 14 Jun 2026.

Builds on

22 of 38 references.

Closest ancestors · 9

Same direction, newest first

  1. 2026Future-KL Regularized GRPO: Process-Level Credit Assignment from f-Divergence Regularization15 Jan
  2. 2025Discriminative Policy Optimization for Token-Level Reward Models29 May
  3. 2025SEED-GRPO: Semantic Entropy Enhanced GRPO for Uncertainty-Aware Policy Optimization18 May
  4. 2025DeepMath-103K: A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoning15 Apr
  5. 2025Process Reinforcement through Implicit Rewards3 Feb
  6. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning22 Jan
  7. 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Training22 Nov
  8. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Model29 May
  9. 2017Proximal Policy Optimization Algorithms20 Jul

Other references · 13

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
  5. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
  6. 2022LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Modelscited by 462
  7. 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learningcited by 303
  8. 2018BabyAI: A Platform to Study the Sample Efficiency of Grounded Language Learningcited by 244
  9. 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 205
  10. 2024AgentGym: Evolving Large Language Model-based Agents across Diverse Environmentscited by 120
  11. 2026REDSearcher: A Scalable and Cost-Efficient Framework for Long-Horizon Search Agentscited by 49
  12. 2026OVD: On-policy Verbal Distillationcited by 11
1 more
  1. 2026IAPO: Information-Aware Policy Optimization for Token-Efficient Reasoningcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 10.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Semantic-Space Exploration and Exploitation in RLVR for LLM Reasoning
  2. 2026STRIDE: Learnable Stepwise Language Feedback for LLM Reasoning
  3. 2026SCOPE-RL: Optimizing Reasoning Paths Before and After Success
  4. 2026Step Potential Advantage Estimation: Harnessing Intermediate Confidence and Correctness for Efficient Mathematical Reasoning
  5. 2025ConfClip: Confidence-Weighted and Clipped Reward for Reinforcement Learning in LLMs
  6. 2025Reshaping Reasoning in LLMs: A Theoretical Analysis of RL Training Dynamics through Pattern Selection
  7. 2026Verifiable Process Rewards for Agentic Reasoning
  8. 2026DelTA: Discriminative Token Credit Assignment for Reinforcement Learning from Verifiable Rewards