Citrus-V: Advancing Medical Foundation Models with Unified Medical Image Grounding for Clinical Reasoning
Not on the map. Why?
Abstract (arXiv)
Medical imaging provides critical evidence for clinical diagnosis, treatment planning, and surgical decisions, yet most existing imaging models are narrowly focused and require multiple specialized networks, limiting their generalization. Although large-scale language and multimodal models exhibit strong reasoning and multi-task capabilities, real-world clinical applications demand precise visual grounding, multimodal integration, and chain-of-thought reasoning. We introduce Citrus-V, a multimodal medical foundation model that combines image analysis with textual reasoning. The model integrates detection, segmentation, and multimodal chain-of-thought reasoning, enabling pixel-level lesion localization, structured report generation, and physician-like diagnostic inference in a single framework. We propose a novel multimodal training approach and release a curated open-source data suite covering reasoning, detection, segmentation, and document understanding tasks. Evaluations demonstrate that Citrus-V outperforms existing open-source medical models and expert-level imaging systems across multiple benchmarks, delivering a unified pipeline from visual grounding to clinical reasoning and supporting precise lesion quantification, automated reporting, and reliable second opinions.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 85 of its 125 references that are in the map. First posted on arXiv 23 Sep 2025.
Builds on
85 of 125 references.
References · 85
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2023Segment Anythingcited by 8,234
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2022Large Language Models Encode Clinical Knowledgecited by 1,830
38 more
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,407
- 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,356
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
- 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,288
- 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,121
- 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
- 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 959
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
- 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 752
- 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 688
- 2019UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentationcited by 586
- 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 543
- 2023VisionLLM: Large Language Model is also an Open-Ended Decoder for Vision-Centric Taskscited by 501
- 2023GLaMM: Pixel Grounding Large Multimodal Modelcited by 455
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 454
- 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 449
- 2023CMMLU: Measuring massive multitask language understanding in Chinesecited by 449
- 2025MedGemma Technical Reportcited by 436
- 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 410
- 2020TextCaps: a Dataset for Image Captioning with Reading Comprehensioncited by 400
- 2025Kimi-VL Technical Reportcited by 388
- 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 355
- 2022Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoningcited by 350
- 2023PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answeringcited by 338
- 2022Large Language Models Are Reasoning Teacherscited by 329
- 2023ChatDoctor: A Medical Chat Model Fine-Tuned on a Large Language Model Meta-AI (LLaMA) Using Medical Domain Knowledgecited by 325
- 2023Towards Generalist Biomedical AIcited by 289
- 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoningcited by 280
- 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoningcited by 230
- 2025MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understandingcited by 224
- 2024CogVLM2: Visual Language Models for Image and Video Understandingcited by 217
- 2017On the Automatic Generation of Medical Imaging Reportscited by 216
- 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thoughtcited by 206
- 2023BiomedGPT: A Generalist Vision-Language Foundation Model for Diverse Biomedical Taskscited by 201
- 2024HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scalecited by 200
- 2023Compositional Chain-of-Thought Prompting for Large Multimodal Modelscited by 164
- 2023MedNeXt: Transformer-driven Scaling of ConvNets for Medical Image Segmentationcited by 162
50 most cited of 85 All 85 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 7.
8 papers.
- 2026IBISAgent: Reinforcing Pixel-Level Visual Reasoning in MLLMs for Universal Biomedical Object Referring and Segmentationcited by 10
- 2026MedSAM-Agent: Empowering Interactive Medical Image Segmentation with Multi-turn Agentic Reinforcement Learningcited by 8
- 2025UMind-VL: A Generalist Ultrasound Vision-Language Model for Unified Grounded Perception and Comprehensive Interpretationcited by 2
- 2026CORTEX: A Structured Reasoning Benchmark for Trustworthy 3D Chest CT MLLMscited by 1
- 2026MEDIC-AD: Towards Medical Vision-Language Model's Clinical Intelligencecited by 0
- 2026MedPixel: A Unified Pixel-Language Model for Medical Reasoning and Segmentationcited by 0
- 2026MedUP: Awakening Unified Understanding and Perception in Medical Vision-Language Modelscited by 0
- 2026SAM Meets VLM: Parameter-Decoupled Full-Parameter Training for Unified Medical Reasoning and Segmentationcited by 0
- 2026SAM Meets VLM: Parameter-Decoupled Full-Parameter Training for Unified Medical Reasoning and Segmentation29 Sep 2026
- 2026MedUP: Awakening Unified Understanding and Perception in Medical Vision-Language Models11 Aug 2026
- 2026MedPixel: A Unified Pixel-Language Model for Medical Reasoning and Segmentation10 Aug 2026
- 2026CORTEX: A Structured Reasoning Benchmark for Trustworthy 3D Chest CT MLLMs25 Jun 2026
- 2026MEDIC-AD: Towards Medical Vision-Language Model's Clinical Intelligence28 Mar 2026
- 2026MedSAM-Agent: Empowering Interactive Medical Image Segmentation with Multi-turn Agentic Reinforcement Learning3 Feb 2026
- 2026IBISAgent: Reinforcing Pixel-Level Visual Reasoning in MLLMs for Universal Biomedical Object Referring and Segmentation6 Jan 2026
- 2025UMind-VL: A Generalist Ultrasound Vision-Language Model for Unified Grounded Perception and Comprehensive Interpretation27 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2026Concept-Grounded Reasoning with Prompt-Driven Localization for Interpretable Structured Report Generation
- 2026LocAnyMed: Vision-Language Grounding for Multimodal Medical Images
- 2025Seeing the Trees for the Forest: Rethinking Weakly-Supervised Medical Visual Grounding
- 2026MedCORE: Criteria-Grounded Clinical Reasoning for Interpretable Medical Image Diagnosis
- 2026How Do Medical MLLMs Fail? A Study on Visual Grounding in Medical Images
- 2026CARE: Towards Clinical Accountability in Multi-Modal Medical Reasoning with an Evidence-Grounded Agentic Framework
- 2026M3CoTBench: Benchmark Chain-of-Thought of MLLMs in Medical Image Understanding
- 2025Test-Time-Scaling for Zero-Shot Diagnosis with Visual-Language Reasoning