CineMR: Tool-Integrated Vision-Language Reasoning for Quantitative Cardiac MRI Assessment
On the map: LLM reasoning → Clinical and biomedical applications
Abstract (arXiv)
Cardiovascular magnetic resonance (CMR), including cine imaging, is a reference standard for the noninvasive assessment of cardiac morphology and ventricular function. Cine CMR interpretation integrates qualitative visual assessment with quantitative measurements of ventricular volumes, ejection fraction, myocardial mass, wall thickness, and regional wall motion. Current medical vision-language models (VLMs) cannot reliably derive quantitative measurements from multidimensional cine images without analysis tools. We present CineMR, a tool-augmented VLM that invokes cardiac image-analysis tools and integrates their outputs into interleaved reasoning for quantitative CMR assessment. We also construct a multi-cohort visual question answering benchmark covering quantitative metric extraction, multiclass diagnosis, and differential diagnosis, together with tools for segmentation, phase selection, volumetry, morphometry, and regional wall motion analysis. CineMR is trained with supervised fine-tuning (SFT) on tool-interaction traces followed by Group Relative Policy Optimization (GRPO) with conditional tool-use rewards. On the multi-cohort cine CMR benchmark, CineMR achieves 35.9% pass@1 and 58.9% pass@4, compared with 1.5% pass@1 for the Qwen3-VL-8B backbone and 0.0% and 7.0% pass@1 for LLaVA-Med v1.5 and MedGemma-4B, respectively. Correct tool invocation reaches 99.8% after GRPO, up from 78.9% after SFT. Live tool outputs improve ventricular measurement accuracy by 20.4--23.7% over direct model predictions, and removing all tools reduces pass@1 from 35.9% to 27.9%. These results highlight the importance of reliable tool use for quantitative cine CMR reasoning and support CineMR as a promising approach for assistive cardiac image assessment. Code, benchmark resources, and model weights are available at https://github.com/AI-MIND-Lab/CineMR.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 10 of its 33 references that are in the map. First posted on arXiv 1 Oct 2026.
Builds on
10 of 33 references.
Closest ancestors · 3
Same direction, newest first
- 2025Ophiuchus: Incentivizing Tool-augmented "Think with Images" for Joint Medical Segmentation, Understanding and Reasoning16 Dec
- 2025AURA: A Multi-Modal Medical Agent for Understanding, Reasoning & Annotation22 Jul
- 2025GMAI-VL-R1: Harnessing Reinforcement Learning for Multimodal Medical Reasoning2 Apr
Other references · 7
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
- 2024MMedAgent: Learning to Use Medical Tools with Multi-modal Agentcited by 108
- 2026MedGemma 1.5 Technical Reportcited by 43
- 2025A versatile foundation model for cine cardiac magnetic resonance image analysis taskscited by 12
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Learning Where to Look: Anatomical Grounding and Guided Attention for Cardiac MRI Vision-Language Models
- 2026CardioLens: Revealing the Clinical Reality Gap of MLLMs via Multi-Sequence Cardiac MRI Evaluations
- 2026EchoSonar-R: A Multi-View Reasoning-Enabled Model for Disease Classification and Report Generation in Echocardiography
- 2026MARCUS: An agentic, multimodal vision-language model for cardiac diagnosis and management
- 2025EchoVLM: Measurement-Grounded Multimodal Learning for Echocardiography
- 2025MedVision: Benchmarking Quantitative Medical Image Analysis
- 2026SeVeR: Selective Visual Exposure and Retrieval for 3D Medical Image Question Answering
- 2023LLM-CXR: Instruction-Finetuned LLM for CXR Image Understanding and Generation