IOSVLM: A 3D Vision-Language Model for Unified Dental Diagnosis from Intraoral Scans
On the map: Multimodal LLMs / vision-language models → Medical vision-language models
Abstract (arXiv)
3D intraoral scans (IOS) are increasingly adopted in routine dentistry due to abundant geometric evidence, and unified multi-disease diagnosis is desirable for clinical documentation and communication. While recent works introduce dental vision-language models (VLMs) to enable unified diagnosis and report generation on 2D images or multi-view images rendered from IOS, they do not fully leverage native 3D geometry. Such work is necessary and also challenging, due to: (i) heterogeneous scan forms and the complex IOS topology, (ii) multi-disease co-occurrence with class imbalance and fine-grained morphological ambiguity, (iii) limited paired 3D IOS-text data. Thus, we present IOSVLM, an end-to-end 3D VLM that represents scans as point clouds and follows a 3D encoder-projector-LLM design for unified diagnosis and generative visual question-answering (VQA), together with IOSVQA, a large-scale multi-source IOS diagnosis VQA dataset comprising 19,002 cases and 249,055 VQA pairs over 23 oral diseases and heterogeneous scan types. To address the distribution gap between color-free IOS data and color-dependent 3D pre-training, we propose a geometry-to-chromatic proxy that stabilizes fine-grained geometric perception and cross-modal alignment. A two-stage curriculum training strategy further enhances robustness. IOSVLM consistently outperforms strong baselines, achieving gains of at least +9.58% macro accuracy and +1.46% macro F1, indicating the effectiveness of direct 3D geometry modeling for IOS-based diagnosis.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Medical vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 13 of its 25 references that are in the map. First posted on arXiv 17 Mar 2026.
Builds on
13 of 25 references.
Closest ancestors · 4
Same direction, newest first
- 2025DentalGPT: Incentivizing Multimodal Complex Reasoning in Dentistry12 Dec
- 2025OralGPT-Omni: A Versatile Dental Multimodal Large Language Model27 Nov
- 2025ArchMap: Arch-Flattening and Knowledge-Guided Vision Language Model for Tooth Counting and Structured Dental Understanding18 Nov
- 2025DentVLM: A Multimodal Vision-Language Model for Comprehensive Dental Diagnosis and Enhanced Clinical Practice27 Sep
Other references · 9
- 2025Qwen3 Technical Reportcited by 8,820
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2025OpenAI GPT-5 System Cardcited by 989
- 2025MedGemma Technical Reportcited by 436
- 2023PointLLM: Empowering Large Language Models to Understand Point Cloudscited by 333
- 2024ShapeLLM: Universal 3D Object Understanding for Embodied Interactioncited by 137
- 2025Hulu-Med: A Transparent Generalist Model towards Holistic Medical Vision-Language Understandingcited by 102
- 2023TSegFormer: 3D Tooth Segmentation in Intraoral Scans with Geometry Guided Transformercited by 10
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026MetaDent: Labeling Clinical Images for Vision-Language Models in Dentistry
- 2026Pocket-Dentist: On-Device Dental Image Understanding via Efficient Multimodal Large Language Models
- 2025Towards Better Dental AI: A Multimodal Benchmark and Instruction Dataset for Panoramic X-ray Analysis
- 2025A benchmark multimodal oro-dental dataset for large vision-language models
- 2026OMNI-Dent: Towards an Accessible and Explainable AI Framework for Automated Dental Diagnosis
- 2025Med3DVLM: An Efficient Vision-Language Model for 3D Medical Image Analysis
- 2026OralMLLM-Bench: Evaluating Cognitive Capabilities of Multimodal Large Language Models in Dental Practice
- 2026AgenTeeth: A Model-Agnostic Framework for Suppressing Hallucination in Frozen Vision-Language Models on Dental X-Rays via Tool Evidence Injection