IRIS: An Intelligent Vision-Language System for Ocular Surface Diseases via Topic Tree and Scene-Driven VQA Generation
On the map: Multimodal LLMs / vision-language models → Medical vision-language models
Abstract (arXiv)
While Large Vision-Language Models (VLMs) demonstrate remarkable generic capabilities, their clinical reasoning in specialized domains like ocular surface diseases (OSDs) is severely hindered by a paucity of high-fidelity, multimodal instruction-tuning data. To dismantle this data bottleneck, we introduce IRIS, an Intelligent Recognition and Interaction System tailored for fine-grained OSD understanding via external eye photography. First, we curate IRIS-120K, the largest and most comprehensive OSD visual question-answering (VQA) dataset to date. Crucially, to overcome the semantic shallowness of conventional image-caption pairs, we propose a synergistic data generation paradigm to explicitly inject clinical priors. Our data engine operates via a dual-branch framework: 1) a Topic Finding Tree (TFT) that hierarchically anchors visual features to precise anatomical and pathological concepts, enforcing rigorous medical deduction logic; and 2) a Scene-driven strategy that synthesizes role-adaptive clinical dialogues to ensure pragmatic generalization. By explicitly aligning a compact 4B-parameter VLM on this structurally enriched corpus, IRIS achieves state-of-the-art performance, comprehensively outperforming both generalist and specialized medical VLMs with up to 34B parameters. Our findings underscore that structured knowledge injection profoundly prevails over sheer parameter scaling, unlocking the potential for resource-efficient, expert-level AI deployment on mobile edge devices for scalable OSD screening. Code, datasets, and model weights will be publicly released by this repo.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Medical vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 14 of its 28 references that are in the map. First posted on arXiv 5 Jul 2026.
Builds on
14 of 28 references.
Closest ancestors · 5
Same direction, newest first
- 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoning8 Jun
- 2025EyecareGPT: Boosting Comprehensive Ophthalmology Understanding with Tailored Dataset, Benchmark and Model18 Apr
- 2025BIOMEDICA: An Open Biomedical Image-Caption Archive, Dataset, and Vision-Language Models Derived from Scientific Literature13 Jan
- 2024HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scale27 Jun
- 2023PathAsst: A Generative Foundation AI Assistant Towards Artificial General Intelligence of Pathology24 May
Other references · 9
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2025OpenAI GPT-5 System Cardcited by 989
- 2025MedGemma Technical Reportcited by 436
- 2025Hulu-Med: A Transparent Generalist Model towards Holistic Medical Vision-Language Understandingcited by 102
- 2023VisionFM: a Multi-Modal Multi-Task Vision Foundation Model for Generalist Ophthalmic Artificial Intelligencecited by 25
- 2025Advancing Medical Representation Learning Through High-Quality Datacited by 8
- 2024Insight: A Multi-Modal Diagnostic Pipeline using LLMs for Ocular Surface Disease Diagnosiscited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026EyeVQA: Benchmarking Ophthalmic Vision-Language Models from Recognition to Spatial Grounding
- 2026Towards Clinically Interpretable Ophthalmic VQA via Spatially-Grounded Lesion Evidence
- 2025Benchmarking Next-Generation Reasoning-Focused Large Language Models in Ophthalmology: A Head-to-Head Evaluation on 5,888 Items
- 2026OphIn-500K: Curating Web-Scale Visual Instructions for Scaling Ophthalmic Multimodal Large Language Models
- 2026RoiMAM: Region-of-Interest Medical Attention Model for Efficient Vision-Language Understanding
- 2023A Foundation Language-Image Model of the Retina (FLAIR): Encoding Expert Knowledge in Text Supervision
- 2025RetinalGPT: A Retinal Clinical Preference Conversational Assistant Powered by Large Vision-Language Models
- 2025Benchmarking and Mitigating Sycophancy in Medical Vision Language Models