MindGYM: What Matters in Question Synthesis for Thinking-Centric Fine-Tuning?
Not on the map. Why?
Abstract (arXiv)
Large foundation models face challenges in acquiring transferable, structured thinking abilities, especially when supervised with rigid templates or crowd-annotated instruction datasets. Unlike prior approaches, we focus on a thinking-centric data synthesis paradigm that enables models to evolve through self-generated, cognitively guided data. We propose MindGYM, a structured and scalable framework for question synthesis, composed of: (1) Cognitive Thinking Process Injection, which infuses high-level reasoning objectives to shape the model's synthesis behavior; (2) Seed Single-Hop Question Synthesis, generating atomic questions from diverse semantic types to encourage broader thinking; and (3) Challenging Multi-Hop QA Synthesis, composing more complex multi-hop questions based on QA seeds for deeper reasoning. Detailed analysis shows that synthetic data generated by our method achieves 16.7% higher average quality and 67.91% lower quality variance compared to baseline sources, highlighting that both high-quality and self-contained data are essential for effective, thinking-oriented fine-tuning. MindGYM improves performance on six reasoning benchmarks, achieving gains of up to 16% on MathVision using only 400 data samples, and generalizable improvements across different model sizes and architectures. MindGYM underscores the viability of self-challenging mechanisms in refining large model capabilities while minimizing human intervention and resource demands. Code and data are released to promote data-centric research into self-evolving foundation models driven by their internal reasoning capabilities.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 31 of its 45 references that are in the map. First posted on arXiv 12 Mar 2025.
Builds on
31 of 45 references.
References · 31
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,881
19 more
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,582
- 2022Solving Quantitative Reasoning Problems with Language Modelscited by 1,359
- 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,114
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 893
- 2022Towards Reasoning in Large Language Models: A Surveycited by 593
- 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 516
- 2025LIMO: Less is More for Reasoningcited by 488
- 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 443
- 2024Training Language Models to Self-Correct via Reinforcement Learningcited by 405
- 2021VALSE: A Task-Independent Benchmark for Vision and Language Models Centered on Linguistic Phenomenacited by 134
- 2023RL4F: Generating Natural Language Feedback with Reinforcement Learning for Repairing Model Outputscited by 104
- 2024MMEvol: Empowering Multimodal Large Language Models with Evol-Instructcited by 42
- 2024MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Diversitycited by 38
- 2024Img-Diff: Contrastive Data Synthesis for Multimodal Large Language Modelscited by 17
- 2024The Synergy between Data and Multi-Modal Large Language Models: A Survey from Co-Development Perspectivecited by 14
- 2025Diversity as a Reward: Fine-Tuning LLMs on a Mixture of Domain-Undetermined Datacited by 13
- 2024Data-Juicer 2.0: Cloud-Scale Adaptive Data Processing for and with Foundation Modelscited by 11
- 2024Data-Juicer Sandbox: A Feedback-Driven Suite for Multimodal Data-Model Co-developmentcited by 10
- 2024HumanVBench: Probing Human-Centric Video Understanding in MLLMs with Automatically Synthesized Benchmarkscited by 10
Built on by
Citing papers per year: 2025: 6.
6 papers.
- 2025A Survey of Context Engineering for Large Language Modelscited by 120
- 2025Trinity-RFT: A General-Purpose and Unified Framework for Reinforcement Fine-Tuning of Large Language Modelscited by 19
- 2025BOTS: A Unified Framework for Bayesian Online Task Selection in LLM Reinforcement Finetuningcited by 12
- 2025SyncLoop: A Multimodal Dual-Loop Framework for Self-Improving Mathematical Reasoningcited by 8
- 2025DetailMaster: Can Your Text-to-Image Model Handle Long Prompts?cited by 5
- 2025Grounded in Reality: Learning and Deploying Proactive LLM from Offline Logscited by 3
- 2025BOTS: A Unified Framework for Bayesian Online Task Selection in LLM Reinforcement Finetuning30 Oct 2025
- 2025Grounded in Reality: Learning and Deploying Proactive LLM from Offline Logs29 Oct 2025
- 2025SyncLoop: A Multimodal Dual-Loop Framework for Self-Improving Mathematical Reasoning22 Jul 2025
- 2025A Survey of Context Engineering for Large Language Models17 Jul 2025
- 2025Trinity-RFT: A General-Purpose and Unified Framework for Reinforcement Fine-Tuning of Large Language Models23 May 2025
- 2025DetailMaster: Can Your Text-to-Image Model Handle Long Prompts?22 May 2025
Similar, not cited
Close in wording, no citation either way
- 2026MindLoom: Composing Thought Modes for Frontier-Level Reasoning Data Synthesis
- 2024Unleashing LLM Reasoning Capability via Scalable Question Synthesis from Scratch
- 2026Constructing Evaluation Datasets for Procedural Reasoning: Balancing Naturalness, Grounding, and Multi-Hop Coverage
- 2025DynamicMind: A Tri-Mode Thinking System for Large Language Models
- 2025DESIGNER: Design-Logic-Guided Multidisciplinary Data Synthesis for LLM Reasoning
- 2025Benchmarking Critical Questions Generation: A Challenging Reasoning Task for Large Language Models
- 2026From Memorization to Creation: Evaluating the Cognitive Depth of LLM-Generated Educational Questions
- 2025Climbing the Ladder of Reasoning: What LLMs Can-and Still Can't-Solve after SFT?