mlsanityData to 14 Oct 2026

OralGPT-Omni: A Versatile Dental Multimodal Large Language Model

arXiv 2511.22055 ↗First posted 27 Nov 2025cs.CV cs.MMcited by 11

On the map: Multimodal LLMs / vision-language models → Medical vision-language models

Abstract (arXiv)

Multimodal Large Language Models (MLLMs) have exhibited immense potential across numerous medical specialties; yet, dentistry remains underexplored, in part due to limited domain-specific data, scarce dental expert annotations, insufficient modality-specific modeling, and challenges in reliability. In this paper, we present OralGPT-Omni, the first dental-specialized MLLM designed for comprehensive and trustworthy analysis across diverse dental imaging modalities and clinical tasks. To explicitly capture dentists' diagnostic reasoning, we construct TRACE-CoT, a clinically grounded chain-of-thought dataset that mirrors dental radiologists' decision-making processes. This reasoning supervision, combined with our proposed four-stage training paradigm, substantially strengthens the model's capacity for dental image understanding and analysis. In parallel, we introduce MMOral-Uni, the first unified multimodal benchmark for dental image analysis. It comprises 2,809 open-ended question-answer pairs spanning five modalities and five tasks, offering a comprehensive evaluation suite to date for MLLMs in digital dentistry. OralGPT-Omni achieves an overall score of 51.84 on the MMOral-Uni benchmark and 45.31 on the MMOral-OPG benchmark, dramatically outperforming the scores of GPT-5. Our work promotes intelligent dentistry and paves the way for future advances in dental image analysis. All code, benchmark, and models will be made publicly available.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in Medical vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 45 of its 60 references that are in the map. First posted on arXiv 27 Nov 2025.

Builds on

45 of 60 references.

Closest ancestors · 12

Same direction, newest first

  1. 2025DentVLM: A Multimodal Vision-Language Model for Comprehensive Dental Diagnosis and Enhanced Clinical Practice27 Sep
  2. 2025Towards Better Dental AI: A Multimodal Benchmark and Instruction Dataset for Panoramic X-ray Analysis11 Sep
  3. 2025X-Ray-CoT: Interpretable Chest X-ray Diagnosis with Vision-Language Models via Chain-of-Thought Reasoning17 Aug
  4. 2025Chiron-o1: Igniting Multimodal Large Language Models towards Generalizable Medical Reasoning via Mentor-Intern Collaborative Search20 Jun
  5. 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoning8 Jun
  6. 2025EyecareGPT: Boosting Comprehensive Ophthalmology Understanding with Tailored Dataset, Benchmark and Model18 Apr
  7. 2025Med-R1: Reinforcement Learning for Generalizable Medical Reasoning in Vision-Language Models18 Mar
  8. 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learning26 Feb
  9. 2025HealthGPT: A Medical Large Vision-Language Model for Unifying Comprehension and Generation via Heterogeneous Knowledge Adaptation14 Feb
  10. 2024WSI-LLaVA: A Multimodal Large Language Model for Whole Slide Image3 Dec
  11. 2024GMAI-VL & GMAI-VL-5.5M: A Large Vision-Language Model and A Comprehensive Multimodal Dataset Towards General Medical AI21 Nov
  12. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Day1 Jun

Other references · 33

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2024GPT-4o System Cardcited by 4,588
  5. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  6. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  7. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
  8. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  9. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  10. 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,239
  11. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,121
  12. 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
21 more
  1. 2024Phi-4 Technical Reportcited by 711
  2. 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 455
  3. 2025MedGemma Technical Reportcited by 436
  4. 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 355
  5. 2025MiMo: Unlocking the Reasoning Potential of Language Model -- From Pretraining to Posttrainingcited by 121
  6. 2025Ovis2.5 Technical Reportcited by 108
  7. 2024MM-Vet v2: A Challenging Benchmark to Evaluate Large Multimodal Models for Integrated Capabilitiescited by 57
  8. 2025GMAI-VL-R1: Harnessing Reinforcement Learning for Multimodal Medical Reasoningcited by 41
  9. 2025Med-RLVR: Emerging Medical Reasoning from a 3B base model via reinforcement Learningcited by 40
  10. 2025A Comprehensive Survey on the Trustworthiness of Large Language Models in Healthcarecited by 27
  11. 2025ReasonMed: A 370K Multi-Agent Generated Dataset for Advancing Medical Reasoningcited by 27
  12. 2025R-4B: Incentivizing General-Purpose Auto-Thinking Capability in MLLMs via Bi-Mode Annealing and Reinforce Learningcited by 18
  13. 2024T-Mamba: A unified framework with Long-Range Dependency in dual-domain for 2D & 3D Tooth Segmentationcited by 17
  14. 2024PediatricsGPT: Large Language Models as Chinese Medical Assistants for Pediatric Applicationscited by 16
  15. 2025Vision-G1: Towards General Vision Language Reasoning with Multi-Domain Data Curationcited by 13
  16. 2024FullAnno: A Data Engine for Enhancing Image Comprehension of MLLMscited by 12
  17. 2024Enhancing Descriptive Captions with Visual Attributes for Multimodal Perceptioncited by 10
  18. 2025Fleming-R1: Toward Expert-Level Medical Reasoning via Reinforcement Learningcited by 10
  19. 2025AOR: Anatomical Ontology-Guided Reasoning for Medical Large Multimodal Model in Chest X-Ray Interpretationcited by 8
  20. 2025Building a Human-Verified Clinical Reasoning Dataset via a Human LLM Hybrid Pipeline for Trustworthy Medical AIcited by 6
  21. 2025ChestGPT: Integrating Large Language Models and Vision Transformers for Disease Detection and Localization in Chest X-Rayscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 10.

11 papers.

  1. 2025DentalGPT: Incentivizing Multimodal Complex Reasoning in Dentistrycited by 6
  2. 2026OralGPT-Plus: Learning to Use Visual Tools via Reinforcement Learning for Panoramic X-ray Analysiscited by 6
  3. 2026OPGAgent: An Agent for Auditable Dental Panoramic X-ray Interpretationcited by 4
  4. 2026Unveiling and Bridging the Functional Perception Gap in MLLMs: Atomic Visual Alignment and Hierarchical Evaluation via PET-Benchcited by 3
  5. 2026OralAgent: Integrating Reasoning, Tools, and Knowledge for Interactive Dental Image Analysiscited by 3
  6. 2026Regulating Anatomy-Aware Rewards via Trajectory-Integral Feedback for Volumetric Computed Tomography Analysiscited by 2
  7. 2026IOSVLM: A 3D Vision-Language Model for Unified Dental Diagnosis from Intraoral Scanscited by 1
  8. 2026BreastGPT: A Multimodal Large Language Model for the Full Spectrum of Breast Cancer Clinical Routinecited by 1
  9. 2026GlobalDentBench: A Multinational Benchmark for Evaluating LLM Clinical Reasoning in Dentistry with Expert Calibrationcited by 0
  10. 2026Large AI Models in Dental Healthcare: From General-Purpose Systems to Domain-Specific Foundation Modelscited by 0
  11. 2026DentAgent: Evidence-Centric Multi-Agent Coordination for Multimodal Dental Reasoningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026OralMLLM-Bench: Evaluating Cognitive Capabilities of Multimodal Large Language Models in Dental Practice
  2. 2025A benchmark multimodal oro-dental dataset for large vision-language models
  3. 2026Pocket-Dentist: On-Device Dental Image Understanding via Efficient Multimodal Large Language Models
  4. 2026OMNI-Dent: Towards an Accessible and Explainable AI Framework for Automated Dental Diagnosis
  5. 2026MetaDent: Labeling Clinical Images for Vision-Language Models in Dentistry
  6. 2023ChatGPT for Shaping the Future of Dentistry: The Potential of Multi-Modal Large Language Model
  7. 2025DeepSeek performs better than other Large Language Models in Dental Cases
  8. 2025DentalBench: Benchmarking and Advancing LLMs Capability for Bilingual Dentistry Understanding