mlsanityData to 14 Oct 2026

EduFlow: Advancing MLLMs' Problem-Solving Proficiency through Multi-Stage, Multi-Perspective Critique

arXiv 2507.09374 ↗First posted 12 Jul 2025cs.AIcited by 2

On the map: LLM reasoning → Prompting and chain-of-thought reasoning

also in 1 more
Abstract (arXiv)

Multimodal large language models (MLLMs) still perform poorly on scientific tasks, particularly those requiring multi-step and interpretable reasoning. Their limitations include insufficient scientific reasoning patterns, lack of global coherence in multi-step inference, and the absence of reflective self-correction, making them unreliable in structured scientific contexts. We introduce EduFlow, the first end-to-end framework that covers the full pipeline of educational scientific reasoning, including data selection, MCTS-based trajectory construction, model training, and output optimization. At its core is EduPRM, a process-aware reward model that critiques reasoning steps with tags and justifications. EduPRM is trained via curriculum learning on three complementary supervision sources: MCTS-guided trajectories, error-injected critiques, and teacher-student dialogues, enabling dynamic adaptation to multi-stage problem solving and iterative refinement during inference. We further propose EduMCTS, a domain-adapted search framework that introduces bootstrapping actions specifically designed for educational reasoning, such as a self-reflection mechanism that promotes reflective error correction. It further leverages EduPRM's fine-grained feedback to guide the search toward higher-quality reasoning trajectories. By applying self-consistency and rejection sampling, we constructed EduMCTS-160K, a large-scale dataset of educational reasoning trajectories. Extensive experiments demonstrate that EduFlow enhances reasoning consistency and coherence. Code, data, and models will be released.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 14 of its 23 references that are in the map. First posted on arXiv 12 Jul 2025.

Builds on

14 of 23 references.

References · 14

  1. 2023Let's Verify Step by Stepcited by 3,789
  2. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  3. 2022Solving math word problems with process- and outcome-based feedbackcited by 901
  4. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 454
  5. 2024ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Searchcited by 344
  6. 2025rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinkingcited by 313
  7. 2025DeepSeek-Prover-V2: Advancing Formal Mathematical Reasoning via Reinforcement Learning for Subgoal Decompositioncited by 287
  8. 2024Accessing GPT-4 level Mathematical Olympiad Solutions via Monte Carlo Tree Self-refine with LLaMa-3 8Bcited by 158
  9. 2025GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoningcited by 97
  10. 2024Interpretable Contrastive Monte Carlo Tree Search Reasoningcited by 64
  11. 2024CMMU: A Benchmark for Chinese Multi-modal Multi-type Question Understanding and Reasoningcited by 31
  12. 2024Progressive Multimodal Reasoning via Active Retrievalcited by 25
2 more
  1. 2024VerMCTS: Synthesizing Multi-Step Programs using a Verifier, a Large Language Model, and Tree Searchcited by 14
  2. 2024Measuring Vision-Language STEM Skills of Neural Modelscited by 14

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026From Atoms to Chains: Divergence-Guided Reasoning Curriculum for Unlabeled LLM Domain Adaptation
  2. 2025Stepwise Think-Critique: Interleaved Reasoning and Self-Critique in a Single LLM
  3. 2025RLKD: Distilling LLMs' Reasoning via Reinforcement Learning
  4. 2025Enhancing Long-Chain Reasoning Distillation through Error-Aware Self-Reflection
  5. 2023SciBench: Evaluating College-Level Scientific Problem-Solving Abilities of Large Language Models
  6. 2026Backtracking When It Strays: Mitigating Dual Exposure Biases in LLM Reasoning Distillation
  7. 2026"The Whole Is Greater Than the Sum of Its Parts": A Compatibility-Aware Multi-Teacher CoT Distillation Framework
  8. 2025The Signal is in the Steps: Local Scoring for Reasoning Data Selection