ImageNet-Think-250K: A Large-Scale Synthetic Dataset for Multimodal Reasoning for Vision Language Models
On the map: LLM reasoning → Multimodal reasoning
also in 2 more
Abstract (arXiv)
We develop ImageNet-Think, a multimodal reasoning dataset designed to aid the development of Vision Language Models (VLMs) with explicit reasoning capabilities. Our dataset is built on 250,000 images from ImageNet21k dataset, providing structured thinking tokens and corresponding answers. Our synthetic dataset is generated by two state-of-the-art VLMs: GLM-4.1V-9B-Thinking and Kimi-VL-A3B-Thinking-2506. Each image is accompanied by two pairs of thinking-answer sequences, creating a resource for training and evaluating multimodal reasoning models. We capture the step-by-step reasoning process of VLMs and the final descriptive answers. Our goal with this dataset is to enable the development of more robust VLMs while contributing to the broader understanding of multimodal reasoning mechanisms. The dataset and evaluation benchmarks will be publicly available to aid research in reasoning/thinking multimodal VLMs.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 22 of its 48 references that are in the map. First posted on arXiv 2 Oct 2025.
Builds on
22 of 48 references.
Closest ancestors · 10
Same direction, newest first
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency25 Aug
- 2025VisionThink: Smart and Efficient Vision Language Model via Reinforcement Learning17 Jul
- 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
- 2025Kimi-VL Technical Report10 Apr
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
- 2025Can MLLMs Reason in Multimodality? EMMA: An Enhanced MultiModal ReAsoning Benchmark9 Jan
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoning19 Mar
Other references · 12
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,729
- 2024A Survey on LLM-as-a-Judgecited by 1,423
- 2024OpenAI o1 System Cardcited by 1,244
- 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,239
- 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
- 2021ImageNet-21K Pretraining for the Massescited by 613
- 2024MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?cited by 292
- 2025MAC: A Live Benchmark for Multimodal Large Language Models in Scientific Understandingcited by 12
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025LENS: Multi-level Evaluation of Multimodal Reasoning with Large Language Models
- 2025VGR: Visual Grounded Reasoning
- 2024Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models
- 2025See, Think, Learn: A Self-Taught Multimodal Reasoner
- 2024Reasoning Limitations of Multimodal Large Language Models. A Case Study of Bongard Problems
- 2025All-in-one: Understanding and Generation in Multimodal Reasoning with the MAIA Benchmark
- 2024NPHardEval4V: Dynamic Evaluation of Large Vision-Language Models with Effects of Vision
- 2025Evaluating MLLMs with Multimodal Multi-image Reasoning Benchmark