mlsanityData to 14 Oct 2026

Do Math Reasoning LLMs Help Predict the Impact of Public Transit Events?

arXiv 2511.00808 ↗First posted 2 Nov 2025cs.AIcited by 0

On the map: LLM reasoning → Reinforcement learning for reasoning

Abstract (arXiv)

Predicting public transit incident duration from unstructured text alerts is a critical but challenging task. Addressing the domain sparsity of transit operations with standard Supervised Fine-Tuning (SFT) is difficult, as the task involves noisy, continuous labels and lacks reliable expert demonstrations for reasoning. While Reinforcement Learning from Verifiable Rewards (RLVR) excels at tasks with binary correctness, like mathematics, its applicability to noisy, continuous forecasting is an open question. This work, to our knowledge, is the first to bridge the gap between RLVR LLM training with the critical, real-world forecasting challenges in public transit operations. We adapt RLVR to this task by introducing a tolerance-based, shaped reward function that grants partial credit within a continuous error margin, rather than demanding a single correct answer. We systematically evaluate this framework on a curated dataset of NYC MTA service alerts. Our findings show that general-purpose, instruction-tuned LLMs significantly outperform specialized math-reasoning models, which struggle with the ambiguous, real-world text. We empirically demonstrate that the binary reward is unstable and degrades performance, whereas our shaped reward design is critical and allows our model to dominate on the most challenging metrics. While classical regressors are superior at minimizing overall MAE or MSE, our RLVR approach achieved a 35% relative improvement in 5-minute accuracy (Acc@5) over the strongest baseline. This demonstrates that RLVR can be successfully adapted to real-world, noisy forecasting, but requires a verifier design that reflects the continuous nature of the problem.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reinforcement learning for reasoning, one of 17 directions in LLM reasoning. Builds on 22 of its 59 references that are in the map. First posted on arXiv 2 Nov 2025.

Builds on

22 of 59 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025Reinforcement Learning with Verifiable yet Noisy Rewards under Imperfect Verifiers1 Oct
  2. 2025Group-Relative REINFORCE Is Secretly an Off-Policy Algorithm: Demystifying Some Myths About GRPO and Its Friends29 Sep
  3. 2025Reasoning or Memorization? Unreliable Results of Reinforcement Learning Due to Data Contamination14 Jul
  4. 2025Reinforcement Learning with Verifiable Rewards Implicitly Incentivizes Correct Reasoning in Base LLMs17 Jun
  5. 2025Spurious Rewards: Rethinking Training Signals in RLVR12 Jun
  6. 2025The Entropy Mechanism of Reinforcement Learning for Reasoning Language Models28 May
  7. 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?18 Apr
  8. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scale18 Mar
  9. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning22 Jan

Other references · 13

  1. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  4. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  5. 2019Fine-Tuning Language Models from Human Preferencescited by 2,150
  6. 2025s1: Simple test-time scalingcited by 1,341
  7. 2025Group Sequence Policy Optimizationcited by 835
  8. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 700
  9. 2025Steering LLM Thinking with Budget Guidancecited by 33
  10. 2024DelayPTC-LLM: Metro Passenger Travel Choice Prediction under Train Delays with Large Language Modelscited by 6
  11. 2024TraveLLM: Could you plan my new public transit route in face of a network disruption?cited by 5
  12. 2016Trip-Based Public Transit Routing Using Condensed Search Treescited by 3
1 more
  1. 2025Data Mining in Transportation Networks with Graph Neural Networks: A Review and Outlookcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024On Designing Effective RL Reward at Training Time for LLM Reasoning
  2. 2025TinyV: Reducing False Negatives in Verification Improves RL for LLM Reasoning
  3. 2025Outcome-based Reinforcement Learning to Predict the Future
  4. 2025Revisiting Reinforcement Learning for LLM Reasoning from A Cross-Domain Perspective
  5. 2026On the Direction of RLVR Updates for LLM Reasoning: Identification and Exploitation
  6. 2025VAR-MATH: Probing True Mathematical Reasoning in LLMS via Symbolic Multi-Instance Benchmarks
  7. 2025Act Only When It Pays: Efficient Reinforcement Learning for LLM Reasoning via Selective Rollouts
  8. 2025Limits of Generalization in RLVR: Two Case Studies in Mathematical Reasoning