mlsanityData to 7 Oct 2026

Adaptive Diagnostic Reasoning Framework for Pathology with Multimodal Large Language Models

arXiv 2511.12008 ↗First posted 15 Nov 2025cs.AI cs.CV cs.LGcited by 2

On the map: LLM reasoning → Clinical and biomedical applications

also in 1 more
Abstract (arXiv)

AI tools in pathology have improved screening throughput, standardized quantification, and revealed prognostic patterns that inform treatment. However, adoption remains limited because most systems still lack the human-readable reasoning needed to audit decisions and prevent errors. We present RECAP-PATH, an interpretable framework that establishes a self-learning paradigm, shifting off-the-shelf multimodal large language models from passive pattern recognition to evidence-linked diagnostic reasoning. At its core is a two-phase learning process that autonomously derives diagnostic criteria: diversification expands pathology-style explanations, while optimization refines them for accuracy. This self-learning approach requires only small labeled sets and no white-box access or weight updates to generate cancer diagnoses. Evaluated on breast and prostate datasets, RECAP-PATH produced rationales aligned with expert assessment and delivered substantial gains in diagnostic accuracy over baselines. By uniting visual understanding with reasoning, RECAP-PATH provides clinically trustworthy AI and demonstrates a generalizable path toward evidence-linked interpretation.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 42 of its 77 references that are in the map. First posted on arXiv 15 Nov 2025.

Builds on

42 of 77 references.

References · 42

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  4. 2024GPT-4o System Cardcited by 4,467
  5. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  6. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  7. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
  8. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
  9. 2017Understanding Black-box Predictions via Influence Functionscited by 1,714
  10. 2025Gemma 3 Technical Reportcited by 1,686
  11. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
  12. 2019Root Mean Square Layer Normalizationcited by 1,425
30 more
  1. 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
  2. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
  3. 2018Sanity Checks for Saliency Mapscited by 1,149
  4. 2018Attention-based Deep Multiple Instance Learningcited by 1,077
  5. 2018Model Cards for Model Reportingcited by 1,068
  6. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
  7. 2023Large Language Models as Optimizerscited by 830
  8. 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 738
  9. 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 718
  10. 2023Automatic Prompt Optimization with "Gradient Descent" and Beam Searchcited by 628
  11. 2023How is ChatGPT's behavior changing over time?cited by 265
  12. 2024Rotary Position Embedding for Vision Transformercited by 226
  13. 2023BiomedGPT: A Generalist Vision-Language Foundation Model for Diverse Biomedical Taskscited by 201
  14. 2023Quilt-1M: One Million Image-Text Pairs for Histopathologycited by 192
  15. 2018BACH: Grand Challenge on Breast Cancer Histology Imagescited by 131
  16. 2021BRACS: A Dataset for BReAst Carcinoma Subtyping in H&E Histology Imagescited by 130
  17. 2024Exploring scalable medical image encoders beyond text supervisioncited by 129
  18. 2021Transparency of Deep Neural Networks for Medical Image Analysis: A Review of Interpretability Methodscited by 83
  19. 2020Interpretability of machine learning based prediction models in healthcarecited by 75
  20. 2021Going Deeper through the Gleason Scoring Scale: An Automatic end-to-end System for Histology Prostate Grading and Cribriform Pattern Detectioncited by 66
  21. 2024Large Language Models for Disease Diagnosis: A Scoping Reviewcited by 51
  22. 2024In-context learning enables multimodal large language models to classify cancer pathology imagescited by 38
  23. 2022Concept Gradient: Concept-based Interpretation Without Linear Assumptioncited by 20
  24. 2017Her2 Challenge Contest: A Detailed Assessment of Automated Her2 Scoring Algorithms in Whole Slide Images of Breast Cancer Tissuescited by 16
  25. 2024Rethinking Transformer for Long Contextual Histopathology Whole Slide Image Analysiscited by 12
  26. 2025Evaluating Visual Explanations of Attention Maps for Transformer-based Medical Imagingcited by 7
  27. 2024Prompting Medical Large Vision-Language Models to Diagnose Pathologies by Visual Question Answeringcited by 5
  28. 2025Unlabeled Data Improves Fine-Grained Image Zero-shot Classification with Multimodal LLMscited by 5
  29. 2021A Pathology Deep Learning System Capable of Triage of Melanoma Specimens Utilizing Dermatopathologist Consensus as Ground Truthcited by 3
  30. 2024Characterizing the Interpretability of Attention Maps in Digital Pathologycited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025A Versatile Pathology Co-pilot via Reasoning Enhanced Multimodal Large Language Model
  2. 2025Evidence-based diagnostic reasoning with multi-agent copilot for human pathology
  3. 2026PathMem: Toward Cognition-Aligned Memory Transformation for Pathology MLLMs
  4. 2025Patho-R1: A Multimodal Reinforcement Learning-Based Pathology Expert Reasoner
  5. 2026ReinPath: A Multimodal Reinforcement Learning Approach for Pathology
  6. 2023PathAsst: A Generative Foundation AI Assistant Towards Artificial General Intelligence of Pathology
  7. 2026PathReasoner-R1: Instilling Structured Reasoning into Pathology Vision-Language Model via Knowledge-Guided Policy Optimization
  8. 2025Discovering Pathology Rationale and Token Allocation for Efficient Multimodal Pathology Reasoning