Synthetic Vasculature and Pathology Enhance Vision-Language Model Reasoning
On the map: LLM reasoning → Clinical and biomedical applications
Abstract (arXiv)
Vision-Language Models (VLMs) offer a promising path toward interpretable medical diagnosis by allowing users to ask about clinical explanations alongside predictions and across different modalities. However, training VLMs for detailed reasoning requires large-scale image-text datasets. In many specialized domains, for example in reading Optical Coherence Tomography Angiography (OCTA) images, such precise text with grounded description of pathologies is scarce or even non-existent. To overcome this bottleneck, we introduce Synthetic Vasculature Reasoning (SVR), a framework that controllably synthesizes images and corresponding text, specifically: realistic retinal vasculature with Diabetic Retinopathy (DR) features: capillary dropout, microaneurysms, neovascularization, and tortuosity, while automatically generating granular reasoning texts. Based on this we curate OCTA-100K-SVR, an OCTA image-reasoning dataset with 100,000 pairs. Our experiments show that a general-purpose VLM (Qwen3-VL-8b) trained on the dataset achieves a zero-shot balanced classification accuracy of 89.67% on real OCTA images, outperforming supervised baselines. Through human expert evaluation we also demonstrate that it significantly enhances explanation quality and pathology localization on clinical data.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 17 of its 26 references that are in the map. First posted on arXiv 11 Dec 2025.
Builds on
17 of 26 references.
Closest ancestors · 2
Same direction, newest first
- 2025Med-R1: Reinforcement Learning for Generalizable Medical Reasoning in Vision-Language Models18 Mar
- 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learning26 Feb
Other references · 15
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2025Qwen3 Technical Reportcited by 8,195
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
- 2025MedGemma Technical Reportcited by 398
- 2023BiomedGPT: A Generalist Vision-Language Foundation Model for Diverse Biomedical Taskscited by 201
- 2020OCTA-500: A Retinal Dataset for Optical Coherence Tomography Angiography Studycited by 52
- 2025Synthetic Data is an Elegant GIFT for Continual Vision-Language Modelscited by 21
- 2023Synthetic optical coherence tomography angiographs for detailed retinal vessel segmentation without human annotationscited by 16
- 2022Physiology-based simulation of the retinal vasculature enables annotation-free segmentation of OCT angiographscited by 12
3 more
- 2024Simulation-Based Segmentation of Blood Vessels in Cerebral 3D OCTA Imagescited by 4
- 2025Interpretable Retinal Disease Prediction Using Biology-Informed Heterogeneous Graph Representationscited by 4
- 2025Fine-tuning Vision Language Models with Graph-based Knowledge for Explainable Medical Image Analysiscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Specialized curricula for training vision-language models in retinal image analysis
- 2023A Foundation Language-Image Model of the Retina (FLAIR): Encoding Expert Knowledge in Text Supervision
- 2026Deep Expert Injection for Anchoring Retinal VLMs with Domain-Specific Knowledge
- 2026Can Multimodal Large Language Models Understand OCT?
- 2025How Far Have Medical Vision-Language Models Come? A Comprehensive Benchmarking Study
- 2025DrVD-Bench: Do Vision-Language Models Reason Like Human Doctors in Medical Image Diagnosis?
- 2026EyeVQA: Benchmarking Ophthalmic Vision-Language Models from Recognition to Spatial Grounding
- 2025RetinalGPT: A Retinal Clinical Preference Conversational Assistant Powered by Large Vision-Language Models