OralGPT-Plus: Learning to Use Visual Tools via Reinforcement Learning for Panoramic X-ray Analysis
On the map: LLM reasoning → Clinical and biomedical applications
Abstract (arXiv)
Panoramic dental radiographs require fine-grained spatial reasoning, bilateral symmetry understanding, and multi-step diagnostic verification, yet existing vision-language models operate under a static single-pass paradigm that limits their clinical reliability. In this paper, we introduce OralGPT-Plus, an agentic vision-language model designed to perform iterative and symmetry-aware diagnostic reasoning for panoramic dental radiograph analysis. To support this paradigm, we construct DentalProbe, a five-thousand-image dataset with expert-curated diagnostic trajectories that provide structured supervision for localized inspection and contralateral comparison. We further develop a Reinspection-driven reinforcement learning framework that encourages clinically meaningful re-examination and stabilizes long-horizon reasoning with rubric-based reward and conditioned diagnostic-driven reward. In parallel, we present MMOral-X, the first benchmark for holistic panoramic diagnosis, containing 300 open-ended questions and region-level annotations across multiple difficulty levels. OralGPT-Plus demonstrates consistent and reliable improvements over strong baselines on MMOral-X and established panoramic benchmarks, indicating the effectiveness of interactive and symmetry-informed reasoning. Our work highlights the value of agentic modeling for dental imaging and provides a foundation for future research in clinically aligned panoramic radiograph analysis.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 32 of its 48 references that are in the map. First posted on arXiv 6 Mar 2026.
Builds on
32 of 48 references.
Closest ancestors · 2
Same direction, newest first
- 2025DentalGPT: Incentivizing Multimodal Complex Reasoning in Dentistry12 Dec
- 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learning26 Feb
Other references · 30
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Visual Instruction Tuningcited by 7,792
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
- 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,221
- 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 439
- 2025Seed1.5-VL Technical Reportcited by 367
18 more
- 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learningcited by 267
- 2024HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scalecited by 194
- 2025Mini-o3: Scaling Up Reasoning Patterns and Interaction Turns for Visual Searchcited by 116
- 2025WebWatcher: Breaking New Frontier of Vision-Language Deep Research Agentcited by 114
- 2025HealthGPT: A Medical Large Vision-Language Model for Unifying Comprehension and Generation via Heterogeneous Knowledge Adaptationcited by 112
- 2024MM-Vet v2: A Challenging Benchmark to Evaluate Large Multimodal Models for Integrated Capabilitiescited by 57
- 2023ChatGPT for Shaping the Future of Dentistry: The Potential of Multi-Modal Large Language Modelcited by 40
- 2025AirCopBench: A Benchmark for Multi-drone Collaborative Embodied Perception and Reasoningcited by 19
- 2024T-Mamba: A unified framework with Long-Range Dependency in dual-domain for 2D & 3D Tooth Segmentationcited by 17
- 2025Towards Better Dental AI: A Multimodal Benchmark and Instruction Dataset for Panoramic X-ray Analysiscited by 16
- 2025DentVLM: A Multimodal Vision-Language Model for Comprehensive Dental Diagnosis and Enhanced Clinical Practicecited by 13
- 2024FullAnno: A Data Engine for Enhancing Image Comprehension of MLLMscited by 12
- 2025OralGPT-Omni: A Versatile Dental Multimodal Large Language Modelcited by 10
- 2025MOSS-ChatV: Reinforcement Learning with Process Reasoning Reward for Video Temporal Reasoningcited by 7
- 2023Language-aware Multiple Datasets Detection Pretraining for DETRscited by 5
- 2023GEM: Boost Simple Network for Glass Surface Segmentation via Vision Foundation Modelscited by 3
- 2025MICCAI STS 2024 Challenge: Semi-Supervised Instance-Level Tooth Segmentation in Panoramic X-ray and CBCT Imagescited by 3
- 2025DentalBench: Benchmarking and Advancing LLMs Capability for Bilingual Dentistry Understandingcited by 2
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026OralAgent: Integrating Reasoning, Tools, and Knowledge for Interactive Dental Image Analysiscited by 3
- 2026PanDent: Toward Comprehensive Tooth-Level Structure-Language Consistency in Dental Radiologycited by 0
- 2026DentAgent: Evidence-Centric Multi-Agent Coordination for Multimodal Dental Reasoningcited by 0
- 2026AgenTeeth: A Model-Agnostic Framework for Suppressing Hallucination in Frozen Vision-Language Models on Dental X-Rays via Tool Evidence Injectioncited by 0
- 2026AgenTeeth: A Model-Agnostic Framework for Suppressing Hallucination in Frozen Vision-Language Models on Dental X-Rays via Tool Evidence Injection15 Sep 2026
- 2026DentAgent: Evidence-Centric Multi-Agent Coordination for Multimodal Dental Reasoning19 Aug 2026
- 2026PanDent: Toward Comprehensive Tooth-Level Structure-Language Consistency in Dental Radiology29 Jul 2026
- 2026OralAgent: Integrating Reasoning, Tools, and Knowledge for Interactive Dental Image Analysis9 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026OPGAgent: An Agent for Auditable Dental Panoramic X-ray Interpretation
- 2025A benchmark multimodal oro-dental dataset for large vision-language models
- 2025Benchmark Success, Clinical Failure: When Reinforcement Learning Optimizes for Benchmarks, Not Patients
- 2026OMNI-Dent: Towards an Accessible and Explainable AI Framework for Automated Dental Diagnosis
- 2026Enhancing Visual Reasoning in Chest X-Ray Report Generation Using Reinforcement Learning
- 2026OralMLLM-Bench: Evaluating Cognitive Capabilities of Multimodal Large Language Models in Dental Practice
- 2025CX-Mind: A Pioneering Multimodal Large Language Model for Interleaved Reasoning in Chest X-ray via Curriculum-Guided Reinforcement Learning
- 2025Reasoning Visual Language Model for Chest X-Ray Analysis