mlsanityData to 7 Oct 2026

Long Grounded Thoughts: Synthesizing Visual Problems and Reasoning Chains at Scale

arXiv 2511.05705 ↗First posted 7 Nov 2025cs.CV cs.AI cs.CLcited by 1

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Despite rapid progress, multimodal reasoning still lacks a systematic approach to synthesize large-scale vision-centric datasets beyond visual math. We introduce a framework able to synthesize vision-centric problems spanning diverse levels of complexity, and the resulting dataset with over 1M high-quality problems including: reasoning traces, preference data, and instruction prompts supporting SFT, offline and online RL. Our vision-centric synthesis framework uses a two-stage process focusing on: (1) generating diverse verifiable questions from existing images at scale, and (2) creating complex compositional visual problems by merging simpler questions. Remarkably, finetuning Qwen2.5-VL-7B on our data outperforms existing open-data baselines across evaluated vision-centric benchmarks, and our best configurations match or surpass strong closed-data models such as MiMo-VL-7B-RL on Vstar Bench, CV-Bench and MMStar-V. Notably, despite being entirely vision-centric, our data transfers positively to text-only reasoning (MMLU-Pro, +3.7%) and audio reasoning (MMAU, +1.32%), demonstrating its effectiveness. Similarly, despite containing no embodied visual data, we observe notable gains (NiEH, +8.8%) when evaluating open-ended embodied QA. Lastly, we use our data to comprehensively analyze at scale (1M+) the entire VLM post-training pipeline showing that (i) SFT on high-quality data with cognitive behaviors on reasoning traces is essential to scale online RL, (ii) offline RL could match online RL's performance while disaggregating compute demands, and, (iii) SFT on high quality data also improve out-of-domain, cross-modality transfer.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 29 of its 53 references that are in the map. First posted on arXiv 7 Nov 2025.

Builds on

29 of 53 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025Socratic-MCTS: Test-Time Visual Reasoning by Asking the Right Questions10 Jun
  2. 2025Advancing Multimodal Reasoning: From Optimized Cold Start to Staged Reinforcement Learning4 Jun
  3. 2025LongPerceptualThoughts: Distilling System-2 Reasoning for System-1 Perception21 Apr
  4. 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models10 Apr
  5. 2025Virgo: A Preliminary Exploration on Reproducing o1-like MLLM3 Jan
  6. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov

Other references · 23

  1. 2025Qwen3 Technical Reportcited by 8,195
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  3. 2025Qwen2.5-VL Technical Reportcited by 5,418
  4. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
  5. 2025s1: Simple test-time scalingcited by 1,311
  6. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
  7. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 893
  8. 2025Qwen2.5-Omni Technical Reportcited by 704
  9. 2025Cognitive Behaviors that Enable Self-Improving Reasoners, or, Four Habits of Highly Effective STaRscited by 373
  10. 2024MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmarkcited by 281
  11. 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 206
  12. 2025Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correctioncited by 140
11 more
  1. 2025MiMo: Unlocking the Reasoning Potential of Language Model -- From Pretraining to Posttrainingcited by 117
  2. 2024RL on Incorrect Synthetic Data Scales the Efficiency of LLM Math Reasoning by Eight-Foldcited by 99
  3. 2024MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answeringcited by 93
  4. 2025Omni-R1: Do You Really Need Audio to Fine-Tune Your Audio LLM?cited by 42
  5. 2024MEGA-Bench: Scaling Multimodal Evaluation to over 500 Real-World Taskscited by 41
  6. 2025Prismatic Synthesis: Gradient-based Data Diversification Boosts Generalization in LLM Reasoningcited by 38
  7. 2025DriveLMM-o1: A Step-by-Step Reasoning Dataset and Large Multimodal Model for Driving Scenario Understandingcited by 35
  8. 2024Can Large Vision-Language Models Correct Semantic Grounding Errors By Themselves?cited by 20
  9. 2025SCI-Reason: A Dataset with Chain-of-Thought Rationales for Complex Multimodal Reasoning in Academic Areascited by 5
  10. 2025Beyond Needle(s) in the Embodied Haystack: Environment, Architecture, and Training Considerations for Long Context Reasoningcited by 3
  11. 2024Multi-Scenario Reasoning: Unlocking Cognitive Autonomy in Humanoid Robots for Multimodal Understandingcited by 1

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024From the Least to the Most: Building a Plug-and-Play Visual Reasoner via Data Synthesis
  2. 2025Closing the Gap: Data-Centric Fine-Tuning of Vision Language Models for the Standardized Exam Questions
  3. 2026MMFineReason: Closing the Multimodal Reasoning Gap via Open Data-Centric Methods
  4. 2025On Data Synthesis and Post-training for Visual Abstract Reasoning
  5. 2025VGR: Visual Grounded Reasoning
  6. 2025Weaving Context Across Images: Improving Vision-Language Models through Focus-Centric Visual Chains
  7. 2025Diagnosing Visual Reasoning: Challenges, Insights, and a Path Forward
  8. 2025Understand, Think, and Answer: Advancing Visual Reasoning with Large Multimodal Models