RadThinking: A Dataset for Longitudinal Clinical Reasoning in Radiology
Not on the map. Why?
Abstract (arXiv)
Cancer screening is a reasoning task. A radiologist observes findings, compares them to prior scans, integrates clinical context, and reaches a diagnostic conclusion confirmed by pathology. We present RadThinking, a Visual Question Answering (VQA) dataset that makes this reasoning explicit and trainable. RadThinking releases VQA pairs at three difficulty tiers. Foundation VQAs are atomic perception questions. Single-step reasoning VQAs apply one clinical rule. Compositional VQAs require multi-step chain-of-thought to reach a guideline category such as LI-RADS-5. For every compositional VQA, we release the chain of foundation VQAs that solves it. The chain follows the rules of the governing clinical reporting standard. The dataset spans 20,362 CT scans from 9,131 patients across 43 cancer groups, plus 2,077 verified healthy controls with >1-year follow-up. To our knowledge, RadThinking is the first cancer-screening VQA corpus that stratifies questions by reasoning depth and grounds compositions in clinical reporting standards. The foundation tier supplies atomic perception supervision. The compositional tier supplies chain-of-thought data and verifiable rewards for reinforcement-learning recipes such as DeepSeek-R1 and OpenAI o1. RadThinking enables systematic training and evaluation of whether AI systems can reason about cancer, not merely detect it.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 73 of its 116 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
73 of 116 references.
References · 73
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,457
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,407
- 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,075
- 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
38 more
- 2023VILA: On Pre-training for Visual Language Modelscited by 692
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
- 2021The Medical Segmentation Decathloncited by 628
- 2023ViperGPT: Visual Inference via Python Execution for Reasoningcited by 603
- 2019MIMIC-CXR-JPG, a large publicly available database of labeled chest radiographscited by 597
- 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 572
- 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 558
- 2022Visual Programming: Compositional visual reasoning without trainingcited by 516
- 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 513
- 2019The Liver Tumor Segmentation Benchmark (LiTS)cited by 509
- 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 475
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 454
- 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 449
- 2015Neural Module Networkscited by 376
- 2023PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answeringcited by 338
- 2023Towards Generalist Biomedical AIcited by 289
- 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoningcited by 280
- 2024HuatuoGPT-o1, Towards Medical Complex Reasoning with LLMscited by 265
- 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RLcited by 248
- 2024Capabilities of Gemini Models in Medicinecited by 237
- 2024PaliGemma 2: A Family of Versatile VLMs for Transfercited by 207
- 2024Generalist Foundation Models from a Multimodal Dataset for 3D Computed Tomographycited by 199
- 2024OmniMedVQA: A New Large-Scale Comprehensive Evaluation Benchmark for Medical LVLMcited by 184
- 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learningcited by 173
- 2019The KiTS19 Challenge Data: 300 Kidney Tumor Cases with Clinical Context, CT Semantic Segmentations, and Surgical Outcomescited by 172
- 2024M3D: Advancing 3D Medical Image Analysis with Multi-Modal Large Language Modelscited by 162
- 2025Med-R1: Reinforcement Learning for Generalizable Medical Reasoning in Vision-Language Modelscited by 144
- 2024NVLM: Open Frontier-Class Multimodal LLMscited by 125
- 2025OpenVLThinker: Complex Vision-Language Reasoning via Iterative SFT-RL Cyclescited by 124
- 2025MedReason: Eliciting Factual Medical Reasoning Steps in LLMs via Knowledge Graphscited by 110
- 2024CT2Rep: Automated Radiology Report Generation for 3D Medical Imagingcited by 96
- 2025Boosting the Generalization and Reasoning of Vision Language Models with Curriculum Reinforcement Learningcited by 71
- 2024Towards Generalizable Tumor Synthesiscited by 65
- 2024AbdomenAtlas: A Large-Scale, Detailed-Annotated, & Multi-Center Dataset for Efficient Transfer Learning and Open Algorithmic Benchmarkingcited by 65
- 2023Continual Learning for Abdominal Multi-Organ and Tumor Segmentationcited by 43
- 2022MONAI Label: A framework for AI-assisted Interactive Labeling of 3D Medical Imagescited by 39
- 2025RadGPT: Constructing 3D Image-Text Tumor Datasetscited by 36
- 2025MedFrameQA: A Multi-Image Medical VQA Benchmark for Clinical Reasoningcited by 34
50 most cited of 73 All 73 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026A Vision-language Framework for Comparative Reasoning in Radiologycited by 1
- 2026AMPLIFAI: A Multiphase CT Dataset for Benchmarking Clinical Reasoning in LI-RADS Assessment of Liver Lesionscited by 0
- 2026Report Supervisioncited by 0
- 2026RT-Super: Learning Tumor Segmentation from Longitudinal Images and Reportscited by 0
- 2026RT-Super: Learning Tumor Segmentation from Longitudinal Images and Reports28 Sep 2026
- 2026Report Supervision27 Aug 2026
- 2026AMPLIFAI: A Multiphase CT Dataset for Benchmarking Clinical Reasoning in LI-RADS Assessment of Liver Lesions14 Aug 2026
- 2026A Vision-language Framework for Comparative Reasoning in Radiology4 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2025RadImageNet-VQA: A Large-Scale CT and MRI Dataset for Radiologic Visual Question Answering
- 2023Rad-ReStruct: A Novel VQA Benchmark and Method for Structured Radiology Reporting
- 2025ReXVQA: A Large-scale Visual Question Answering Benchmark for Generalist Chest X-ray Understanding
- 2026Step-CoT: Stepwise Visual Chain-of-Thought for Medical Visual Question Answering
- 2025Benchmarking GPT-5 for Zero-Shot Multimodal Medical Reasoning in Radiology and Radiation Oncology
- 2025Adapting Lightweight Vision Language Models for Radiological Visual Question Answering
- 2024Tri-VQA: Triangular Reasoning Medical Visual Question Answering for Multi-Attribute Analysis
- 2026Automated Report-Derived Oncology VQA Benchmark for Evaluating Vision-Language Models on 3D Medical Imaging