mlsanityData to 7 Oct 2026

OralAgent: Integrating Reasoning, Tools, and Knowledge for Interactive Dental Image Analysis

arXiv 2605.27378 ↗First posted 9 Apr 2026cs.CL cs.CV cs.MAcited by 3

Not on the map. Why?

Abstract (arXiv)

Dental image analysis plays a pivotal role in supporting accurate diagnosis and treatment planning in oral healthcare. Although recent advances have produced dental AI models for specific tasks and individual imaging modalities, their isolated designs limit practical use in real-world clinical workflows. In this paper, we present OralAgent, the first dental-specialized AI agent that unifies multimodal reasoning, tool-based decision-making, and knowledge-grounded retrieval within an end-to-end automated framework. It integrates 22 visual analysis tools and 368 widely-used classical dental textbooks, enabling autonomous reasoning, planning, tool use, knowledge retrieval, and multi-step workflow execution. Furthermore, we introduce OralCorpus, a large-scale, high-quality bilingual textual resource containing 134.8M tokens curated for dental retrieval-augmented generation (RAG). To evaluate models' multidisciplinary dental knowledge, we construct OralQA-ZH, a Chinese multiple-choice question benchmark consisting of 798 items across eleven oral subspecialties. Extensive experiments demonstrate that OralAgent achieves state-of-the-art performance on the MMOral-Uni, MMOral-OPG, and OralQA-ZH benchmarks, highlighting its effectiveness, interpretability, and adaptability in real-world clinical settings. The code and models are publicly available at https://github.com/isjinghao/OralAgent.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 48 of its 67 references that are in the map. First posted on arXiv 9 Apr 2026.

Builds on

48 of 67 references.

References · 48

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2025Qwen2.5-VL Technical Reportcited by 5,418
  4. 2024GPT-4o System Cardcited by 4,467
  5. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  6. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
  7. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  8. 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
  9. 2025DINOv3cited by 1,297
  10. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
  11. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
  12. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,096
36 more
  1. 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 718
  2. 2024Phi-4 Technical Reportcited by 675
  3. 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 506
  4. 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
  5. 2025MedGemma Technical Reportcited by 398
  6. 2022Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and Segmentationcited by 341
  7. 2023MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoningcited by 311
  8. 2024MinerU: An Open-Source Solution for Precise Document Content Extractioncited by 255
  9. 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoningcited by 217
  10. 2023HuatuoGPT, towards Taming Language Model to Be a Doctorcited by 211
  11. 2024HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scalecited by 194
  12. 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learningcited by 172
  13. 2024MDAgents: An Adaptive Collaboration of LLMs for Medical Decision-Makingcited by 162
  14. 2025Med-R1: Reinforcement Learning for Generalizable Medical Reasoning in Vision-Language Modelscited by 144
  15. 2025MiMo: Unlocking the Reasoning Potential of Language Model -- From Pretraining to Posttrainingcited by 117
  16. 2025HealthGPT: A Medical Large Vision-Language Model for Unifying Comprehension and Generation via Heterogeneous Knowledge Adaptationcited by 112
  17. 2024MMedAgent: Learning to Use Medical Tools with Multi-modal Agentcited by 108
  18. 2025Ovis2.5 Technical Reportcited by 103
  19. 2025Hulu-Med: A Transparent Generalist Model towards Holistic Medical Vision-Language Understandingcited by 96
  20. 2025MedRAG: Enhancing Retrieval-augmented Generation with Knowledge Graph-Elicited Reasoning for Healthcare Copilotcited by 83
  21. 2025MedAgent-Pro: Towards Evidence-based Multi-modal Medical Diagnosis via Reasoning Agentic Workflowcited by 71
  22. 2025MedRAX: Medical Reasoning Agent for Chest X-raycited by 68
  23. 2023Prompt Engineering for Healthcare: Methodologies and Applicationscited by 52
  24. 2025R-4B: Incentivizing General-Purpose Auto-Thinking Capability in MLLMs via Bi-Mode Annealing and Reinforce Learningcited by 18
  25. 2024T-Mamba: A unified framework with Long-Range Dependency in dual-domain for 2D & 3D Tooth Segmentationcited by 17
  26. 2025Chiron-o1: Igniting Multimodal Large Language Models towards Generalizable Medical Reasoning via Mentor-Intern Collaborative Searchcited by 16
  27. 2025Towards Better Dental AI: A Multimodal Benchmark and Instruction Dataset for Panoramic X-ray Analysiscited by 16
  28. 2025DentVLM: A Multimodal Vision-Language Model for Comprehensive Dental Diagnosis and Enhanced Clinical Practicecited by 13
  29. 2024FullAnno: A Data Engine for Enhancing Image Comprehension of MLLMscited by 12
  30. 2024Cephalometric Landmark Detection across Ages with Prototypical Networkcited by 10
  31. 2025OralGPT-Omni: A Versatile Dental Multimodal Large Language Modelcited by 10
  32. 2024IntentGPT: Few-shot Intent Discovery with Large Language Modelscited by 8
  33. 2025DentalGPT: Incentivizing Multimodal Complex Reasoning in Dentistrycited by 5
  34. 2026OPGAgent: An Agent for Auditable Dental Panoramic X-ray Interpretationcited by 4
  35. 2026OralGPT-Plus: Learning to Use Visual Tools via Reinforcement Learning for Panoramic X-ray Analysiscited by 4
  36. 2025A High Magnifications Histopathology Image Dataset for Oral Squamous Cell Carcinoma Diagnosis and Prognosiscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026OMNI-Dent: Towards an Accessible and Explainable AI Framework for Automated Dental Diagnosis
  2. 2026Pocket-Dentist: On-Device Dental Image Understanding via Efficient Multimodal Large Language Models
  3. 2026GlobalDentBench: A Multinational Benchmark for Evaluating LLM Clinical Reasoning in Dentistry with Expert Calibration
  4. 2025A benchmark multimodal oro-dental dataset for large vision-language models
  5. 2025DentalBench: Benchmarking and Advancing LLMs Capability for Bilingual Dentistry Understanding
  6. 2025Clinical Semantic Intelligence (CSI): Emulating the Cognitive Framework of the Expert Clinician for Comprehensive Oral Disease Diagnosis
  7. 2026OralMLLM-Bench: Evaluating Cognitive Capabilities of Multimodal Large Language Models in Dental Practice
  8. 2026Bridging the Knowledge-Action Gap by Evaluating LLMs in Dynamic Dental Clinical Scenarios