mlsanityData to 14 Oct 2026

Tailored Teaching with Balanced Difficulty: Elevating Reasoning in Multimodal Chain-of-Thought via Prompt Curriculum

arXiv 2508.18673 ↗First posted 26 Aug 2025cs.CL cs.AI cs.MMcited by 0

On the map: LLM reasoning → Prompting and chain-of-thought reasoning

Abstract (arXiv)

The effectiveness of Multimodal Chain-of-Thought (MCoT) prompting is often limited by the use of randomly or manually selected examples. These examples fail to account for both model-specific knowledge distributions and the intrinsic complexity of the tasks, resulting in suboptimal and unstable model performance. To address this, we propose a novel framework inspired by the pedagogical principle of "tailored teaching with balanced difficulty". We reframe prompt selection as a prompt curriculum design problem: constructing a well ordered set of training examples that align with the model's current capabilities. Our approach integrates two complementary signals: (1) model-perceived difficulty, quantified through prediction disagreement in an active learning setup, capturing what the model itself finds challenging; and (2) intrinsic sample complexity, which measures the inherent difficulty of each question-image pair independently of any model. By jointly analyzing these signals, we develop a difficulty-balanced sampling strategy that ensures the selected prompt examples are diverse across both dimensions. Extensive experiments conducted on five challenging benchmarks and multiple popular Multimodal Large Language Models (MLLMs) demonstrate that our method yields substantial and consistent improvements and greatly reduces performance discrepancies caused by random sampling, providing a principled and robust approach for enhancing multimodal reasoning.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 9 of its 26 references that are in the map. First posted on arXiv 26 Aug 2025.

Builds on

9 of 26 references.

Closest ancestors · 4

Same direction, newest first

  1. 2023Active Prompting with Chain-of-Thought for Large Language Models23 Feb
  2. 2022Automatic Chain of Thought Prompting in Large Language Models7 Oct
  3. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Models21 May
  4. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Models21 Mar

Other references · 5

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  2. 2023Qwen Technical Reportcited by 3,344
  3. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  4. 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 752
  5. 2023What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuningcited by 364

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025The Future of MLLM Prompting is Adaptive: A Comprehensive Experimental Evaluation of Prompt Engineering Methods for Robust Multimodal Performance
  2. 2025QG-CoC: Question-Guided Chain-of-Captions for Large Multimodal Models
  3. 2025Reasoning Steps as Curriculum: Using Depth of Thought as a Difficulty Signal for Tuning LLMs
  4. 2024POEM: Interactive Prompt Optimization for Enhancing Multimodal Reasoning of Large Language Models
  5. 2026Diverge to Induce Prompting: Multi-Rationale Induction for Zero-Shot Reasoning
  6. 2024MiCEval: Unveiling Multimodal Chain of Thought's Quality via Image Description and Reasoning Steps
  7. 2025Chain of Questions: Guiding Multimodal Curiosity in Language Models
  8. 2026Beyond the Prompt in Large Language Models: Comprehension, In-Context Learning, and Chain-of-Thought