mlsanityData to 14 Oct 2026

Which Reasoning Trajectories Teach Students to Reason Better? A Simple Metric of Informative Alignment

arXiv 2601.14249 ↗First posted 20 Jan 2026cs.CLcited by 13

On the map: LLM reasoning → Prompting and chain-of-thought reasoning

also in 1 more
Abstract (arXiv)

Long chain-of-thought (CoT) trajectories provide rich supervision signals for distilling reasoning from teacher to student LLMs. However, both prior work and our experiments show that trajectories from stronger teachers do not necessarily yield better students, highlighting the importance of data-student suitability in distillation. Existing methods assess suitability primarily through student likelihood, favoring trajectories that align closely with the student model's current behavior but overlooking more informative ones. Addressing this, we propose Rank-Surprisal Ratio (RSR), a simple metric that captures both alignment and informativeness to assess the suitability of a reasoning trajectory. RSR is motivated by the observation that effective trajectories typically balance learning signal strength and behavioral alignment by combining low absolute probability with relatively high-ranked tokens under the student model. Concretely, RSR is defined as the ratio of a trajectory's average token-wise rank to its average negative log-likelihood, and is straightforward to compute and interpret. Across five student models and reasoning trajectories from 11 diverse teachers, RSR strongly correlates with post-training reasoning performance (average Spearman 0.86), consistently outperforming existing metrics. We further demonstrate its practical utility in both trajectory selection and teacher selection.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 48 of its 70 references that are in the map. First posted on arXiv 20 Jan 2026.

Builds on

48 of 70 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025Beyond Scaling Law: A Data-Efficient Distillation Framework for Reasoning13 Aug
  2. 2025MiCoTA: Bridging the Learnability Gap with Intermediate CoT and Teacher Assistants2 Jul
  3. 2025Through the Valley: Path to Effective Long CoT Training for Small Language Models9 Jun
  4. 2025What Makes a Good Reasoning Chain? Uncovering Structural Patterns in Long Chain-of-Thought Reasoning28 May
  5. 2025Select2Reason: Efficient Instruction-Tuning Data Selection for Long-CoT Reasoning22 May
  6. 2025Rethinking the Generation of High-Quality CoT Data from the Perspective of LLM-Adaptive Question Difficulty Grading16 Apr
  7. 2025Unveiling the Key Factors for Distilling Chain-of-Thought Reasoning25 Feb
  8. 2025Small Models Struggle to Learn from Strong Reasoners17 Feb
  9. 2025LLMs Can Easily Learn to Reason from Demonstrations Structure, not content, is what matters!11 Feb
  10. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Models28 Jan

Other references · 38

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  4. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  5. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  6. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
  7. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  8. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
  9. 2025s1: Simple test-time scalingcited by 1,341
  10. 2023LIMA: Less Is More for Alignmentcited by 1,100
  11. 2022STaR: Bootstrapping Reasoning With Reasoningcited by 940
  12. 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 939
26 more
  1. 2023Instruction Tuning with GPT-4cited by 686
  2. 2019Improved Knowledge Distillation via Teacher Assistantcited by 573
  3. 2025LIMO: Less is More for Reasoningcited by 498
  4. 2023Studying Large Language Model Generalization with Influence Functionscited by 326
  5. 2023From Quantity to Quality: Boosting LLM Performance with Self-Guided Data Selection for Instruction Tuningcited by 307
  6. 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 304
  7. 2025Llama-Nemotron: Efficient Reasoning Modelscited by 158
  8. 2025Phi-4-reasoning Technical Reportcited by 151
  9. 2025On the Generalization of SFT: A Reinforcement Learning Perspective with Reward Rectificationcited by 127
  10. 2025Learning What Reinforcement Learning Can't: Interleaved Online Fine-Tuning for Hardest Questionscited by 97
  11. 2025Retaining by Doing: The Role of On-Policy Data in Mitigating Forgettingcited by 94
  12. 2024Speculative Knowledge Distillation: Bridging the Teacher-Student Gap Through Interleaved Samplingcited by 90
  13. 2025BREAD: Branched Rollouts from Expert Anchors Bridge SFT & RL for Reasoningcited by 63
  14. 2024Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuningcited by 57
  15. 2025The Best Instruction-Tuning Data are Those That Fitcited by 52
  16. 2025ReasonFlux-PRM: Trajectory-Aware PRMs for Long Chain-of-Thought Reasoning in LLMscited by 46
  17. 2023Towards the Law of Capacity Gap in Distilling Language Modelscited by 44
  18. 2025ReCode: Reinforcing Code Generation with Reasoning-Process Rewardscited by 25
  19. 2025Measuring Data Diversity for Instruction Tuning: A Systematic Analysis and A Reliable Metriccited by 24
  20. 2025Influence Functions for Efficient Data Selection in Reasoningcited by 10
  21. 2025Information-Guided Identification of Training Data Imprint in (Proprietary) Large Language Modelscited by 8
  22. 2025The Signal is in the Steps: Local Scoring for Reasoning Data Selectioncited by 8
  23. 2025Analyzing the Effects of Supervised Fine-Tuning on Model Knowledge from Token and Parameter Levelscited by 7
  24. 2025In Good GRACEs: Principled Teacher Selection for Knowledge Distillationcited by 5
  25. 2025Warm Up Before You Train: Unlocking General Reasoning in Resource-Constrained Settingscited by 4
  26. 2025AIR: Post-training Data Selection for Reasoning via Attention Head Influencecited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 13.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026Long-Chain Reasoning Distillation via Adaptive Prefix Alignment
  2. 2026Beyond Teacher Likelihood: Group-Calibrated On-Policy Distillation for Long-Context Reasoning
  3. 2026Beyond Imitation: Auditing the Recoverability of Reasoning in Distilled Models
  4. 2026Student-in-the-Loop Chain-of-Thought Distillation via Generation-Time Selection
  5. 2026Expected Reasoning-Step Return Unifies On-Policy Learning from Rewards and Teachers
  6. 2026Validity-Calibrated Reasoning Distillation
  7. 2026Distribution-Aligned Sequence Distillation for Superior Long-CoT Reasoning
  8. 2026TeacherGRPO: Closing the Capacity Gap in Reasoning Distillation via Teacher Alignment