mlsanityData to 7 Oct 2026

MindGYM: What Matters in Question Synthesis for Thinking-Centric Fine-Tuning?

arXiv 2503.09499 ↗First posted 12 Mar 2025cs.CV cs.AI cs.CLcited by 6

Not on the map. Why?

Abstract (arXiv)

Large foundation models face challenges in acquiring transferable, structured thinking abilities, especially when supervised with rigid templates or crowd-annotated instruction datasets. Unlike prior approaches, we focus on a thinking-centric data synthesis paradigm that enables models to evolve through self-generated, cognitively guided data. We propose MindGYM, a structured and scalable framework for question synthesis, composed of: (1) Cognitive Thinking Process Injection, which infuses high-level reasoning objectives to shape the model's synthesis behavior; (2) Seed Single-Hop Question Synthesis, generating atomic questions from diverse semantic types to encourage broader thinking; and (3) Challenging Multi-Hop QA Synthesis, composing more complex multi-hop questions based on QA seeds for deeper reasoning. Detailed analysis shows that synthetic data generated by our method achieves 16.7% higher average quality and 67.91% lower quality variance compared to baseline sources, highlighting that both high-quality and self-contained data are essential for effective, thinking-oriented fine-tuning. MindGYM improves performance on six reasoning benchmarks, achieving gains of up to 16% on MathVision using only 400 data samples, and generalizable improvements across different model sizes and architectures. MindGYM underscores the viability of self-challenging mechanisms in refining large model capabilities while minimizing human intervention and resource demands. Code and data are released to promote data-centric research into self-evolving foundation models driven by their internal reasoning capabilities.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 31 of its 45 references that are in the map. First posted on arXiv 12 Mar 2025.

Builds on

31 of 45 references.

References · 31

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  5. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  6. 2025Qwen2.5-VL Technical Reportcited by 5,418
  7. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  8. 2021Program Synthesis with Large Language Modelscited by 3,509
  9. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  10. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
  11. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  12. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,881
19 more
  1. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,582
  2. 2022Solving Quantitative Reasoning Problems with Language Modelscited by 1,359
  3. 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,114
  4. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 893
  5. 2022Towards Reasoning in Large Language Models: A Surveycited by 593
  6. 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 516
  7. 2025LIMO: Less is More for Reasoningcited by 488
  8. 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 443
  9. 2024Training Language Models to Self-Correct via Reinforcement Learningcited by 405
  10. 2021VALSE: A Task-Independent Benchmark for Vision and Language Models Centered on Linguistic Phenomenacited by 134
  11. 2023RL4F: Generating Natural Language Feedback with Reinforcement Learning for Repairing Model Outputscited by 104
  12. 2024MMEvol: Empowering Multimodal Large Language Models with Evol-Instructcited by 42
  13. 2024MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Diversitycited by 38
  14. 2024Img-Diff: Contrastive Data Synthesis for Multimodal Large Language Modelscited by 17
  15. 2024The Synergy between Data and Multi-Modal Large Language Models: A Survey from Co-Development Perspectivecited by 14
  16. 2025Diversity as a Reward: Fine-Tuning LLMs on a Mixture of Domain-Undetermined Datacited by 13
  17. 2024Data-Juicer 2.0: Cloud-Scale Adaptive Data Processing for and with Foundation Modelscited by 11
  18. 2024Data-Juicer Sandbox: A Feedback-Driven Suite for Multimodal Data-Model Co-developmentcited by 10
  19. 2024HumanVBench: Probing Human-Centric Video Understanding in MLLMs with Automatically Synthesized Benchmarkscited by 10

Built on by

Cited by year

Citing papers per year: 2025: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026MindLoom: Composing Thought Modes for Frontier-Level Reasoning Data Synthesis
  2. 2024Unleashing LLM Reasoning Capability via Scalable Question Synthesis from Scratch
  3. 2026Constructing Evaluation Datasets for Procedural Reasoning: Balancing Naturalness, Grounding, and Multi-Hop Coverage
  4. 2025DynamicMind: A Tri-Mode Thinking System for Large Language Models
  5. 2025DESIGNER: Design-Logic-Guided Multidisciplinary Data Synthesis for LLM Reasoning
  6. 2025Benchmarking Critical Questions Generation: A Challenging Reasoning Task for Large Language Models
  7. 2026From Memorization to Creation: Evaluating the Cognitive Depth of LLM-Generated Educational Questions
  8. 2025Climbing the Ladder of Reasoning: What LLMs Can-and Still Can't-Solve after SFT?