mlsanityData to 14 Oct 2026

Citrus-V: Advancing Medical Foundation Models with Unified Medical Image Grounding for Clinical Reasoning

arXiv 2509.19090 ↗First posted 23 Sep 2025cs.CV cs.AI cs.CLcited by 8

Not on the map. Why?

Abstract (arXiv)

Medical imaging provides critical evidence for clinical diagnosis, treatment planning, and surgical decisions, yet most existing imaging models are narrowly focused and require multiple specialized networks, limiting their generalization. Although large-scale language and multimodal models exhibit strong reasoning and multi-task capabilities, real-world clinical applications demand precise visual grounding, multimodal integration, and chain-of-thought reasoning. We introduce Citrus-V, a multimodal medical foundation model that combines image analysis with textual reasoning. The model integrates detection, segmentation, and multimodal chain-of-thought reasoning, enabling pixel-level lesion localization, structured report generation, and physician-like diagnostic inference in a single framework. We propose a novel multimodal training approach and release a curated open-source data suite covering reasoning, detection, segmentation, and document understanding tasks. Evaluations demonstrate that Citrus-V outperforms existing open-source medical models and expert-level imaging systems across multiple benchmarks, delivering a unified pipeline from visual grounding to clinical reasoning and supporting precise lesion quantification, automated reporting, and reliable second opinions.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 85 of its 125 references that are in the map. First posted on arXiv 23 Sep 2025.

Builds on

85 of 125 references.

References · 85

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2023Segment Anythingcited by 8,234
  4. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  5. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  6. 2025Qwen2.5-VL Technical Reportcited by 5,587
  7. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  8. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  9. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  10. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
  11. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  12. 2022Large Language Models Encode Clinical Knowledgecited by 1,830
38 more
  1. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  2. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,407
  3. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,356
  4. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
  5. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,288
  6. 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,121
  7. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
  8. 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 959
  9. 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
  10. 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 752
  11. 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 688
  12. 2019UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentationcited by 586
  13. 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 543
  14. 2023VisionLLM: Large Language Model is also an Open-Ended Decoder for Vision-Centric Taskscited by 501
  15. 2023GLaMM: Pixel Grounding Large Multimodal Modelcited by 455
  16. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 454
  17. 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 449
  18. 2023CMMLU: Measuring massive multitask language understanding in Chinesecited by 449
  19. 2025MedGemma Technical Reportcited by 436
  20. 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 410
  21. 2020TextCaps: a Dataset for Image Captioning with Reading Comprehensioncited by 400
  22. 2025Kimi-VL Technical Reportcited by 388
  23. 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 355
  24. 2022Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoningcited by 350
  25. 2023PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answeringcited by 338
  26. 2022Large Language Models Are Reasoning Teacherscited by 329
  27. 2023ChatDoctor: A Medical Chat Model Fine-Tuned on a Large Language Model Meta-AI (LLaMA) Using Medical Domain Knowledgecited by 325
  28. 2023Towards Generalist Biomedical AIcited by 289
  29. 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoningcited by 280
  30. 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoningcited by 230
  31. 2025MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understandingcited by 224
  32. 2024CogVLM2: Visual Language Models for Image and Video Understandingcited by 217
  33. 2017On the Automatic Generation of Medical Imaging Reportscited by 216
  34. 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thoughtcited by 206
  35. 2023BiomedGPT: A Generalist Vision-Language Foundation Model for Diverse Biomedical Taskscited by 201
  36. 2024HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scalecited by 200
  37. 2023Compositional Chain-of-Thought Prompting for Large Multimodal Modelscited by 164
  38. 2023MedNeXt: Transformer-driven Scaling of ConvNets for Medical Image Segmentationcited by 162

50 most cited of 85 All 85 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 7.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Concept-Grounded Reasoning with Prompt-Driven Localization for Interpretable Structured Report Generation
  2. 2026LocAnyMed: Vision-Language Grounding for Multimodal Medical Images
  3. 2025Seeing the Trees for the Forest: Rethinking Weakly-Supervised Medical Visual Grounding
  4. 2026MedCORE: Criteria-Grounded Clinical Reasoning for Interpretable Medical Image Diagnosis
  5. 2026How Do Medical MLLMs Fail? A Study on Visual Grounding in Medical Images
  6. 2026CARE: Towards Clinical Accountability in Multi-Modal Medical Reasoning with an Evidence-Grounded Agentic Framework
  7. 2026M3CoTBench: Benchmark Chain-of-Thought of MLLMs in Medical Image Understanding
  8. 2025Test-Time-Scaling for Zero-Shot Diagnosis with Visual-Language Reasoning