mlsanityData to 14 Oct 2026

EyePCR: A Comprehensive Benchmark for Fine-Grained Perception, Knowledge Comprehension and Clinical Reasoning in Ophthalmic Surgery

arXiv 2509.15596 ↗First posted 19 Sep 2025cs.CVcited by 3

On the map: LLM reasoning → Clinical and biomedical applications

also in 1 more
Abstract (arXiv)

MLLMs (Multimodal Large Language Models) have showcased remarkable capabilities, but their performance in high-stakes, domain-specific scenarios like surgical settings, remains largely under-explored. To address this gap, we develop EyePCR, a large-scale benchmark for ophthalmic surgery analysis, grounded in structured clinical knowledge to evaluate cognition across textitPerception, textitComprehension and textitReasoning. EyePCR offers a richly annotated corpus with more than 210k VQAs, which cover 1048 fine-grained attributes for multi-view perception, medical knowledge graph of more than 25k triplets for comprehension, and four clinically grounded reasoning tasks. The rich annotations facilitate in-depth cognitive analysis, simulating how surgeons perceive visual cues and combine them with domain knowledge to make decisions, thus greatly improving models' cognitive ability. In particular, EyePCR-MLLM, a domain-adapted variant of Qwen2.5-VL-7B, achieves the highest accuracy on MCQs for textitPerception among compared models and outperforms open-source models in textitComprehension and textitReasoning, rivalling commercial models like GPT-4.1. EyePCR reveals the limitations of existing MLLMs in surgical cognition and lays the foundation for benchmarking and enhancing clinical reliability of surgical video understanding models.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 31 of its 57 references that are in the map. First posted on arXiv 19 Sep 2025.

Builds on

31 of 57 references.

References · 31

  1. 2023Visual Instruction Tuningcited by 7,869
  2. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
  3. 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 950
  4. 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 538
  5. 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 518
  6. 2016Temporal Convolutional Networks for Action Segmentation and Detectioncited by 508
  7. 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 475
  8. 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 449
  9. 2017Neural Motifs: Scene Graph Parsing with Global Contextcited by 414
  10. 2016EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic Videoscited by 367
  11. 2021RadGraph: Extracting Clinical Entities and Relations from Radiology Reportscited by 319
  12. 2016Graph-Structured Representations for Visual Question Answeringcited by 123
19 more
  1. 2020CholecSeg8k: A Semantic Segmentation Dataset for Laparoscopic Cholecystectomy Based on Cholec80cited by 106
  2. 2023Learning Multi-modal Representations by Watching Hundreds of Surgical Video Lecturescited by 68
  3. 2024Multi-Object Hallucination in Vision-Language Modelscited by 60
  4. 2024MedExpQA: Multilingual Benchmarking of Large Language Models for Medical Question Answeringcited by 43
  5. 2024HecVL: Hierarchical Video-Language Pretraining for Zero-shot Surgical Phase Recognitioncited by 42
  6. 2023Advancing Surgical VQA with Scene Graph Knowledgecited by 41
  7. 2024CODE: Contrasting Self-generated Description to Combat Hallucination in Large Multi-modal Modelscited by 38
  8. 2024LLaVA-Surg: Towards Multimodal Surgical Assistant via Structured Surgical Video Learningcited by 34
  9. 2024OphNet: A Large-Scale Video Benchmark for Ophthalmic Surgical Workflow Understandingcited by 32
  10. 2024Automated Multi-level Preference for MLLMscited by 29
  11. 2024OphCLIP: Hierarchical Retrieval-Augmented Learning for Ophthalmic Surgical Video-Language Pretrainingcited by 29
  12. 2022A Dataset for Medical Instructional Video Classification and Question Answeringcited by 26
  13. 2022VQA-GNN: Reasoning with Multimodal Knowledge via Graph Neural Networks for Visual Question Answeringcited by 22
  14. 2018Fine-grained Activity Recognition in Baseball Videoscited by 20
  15. 2024GP-VLS: A general-purpose vision language model for surgerycited by 17
  16. 2021LensID: A CNN-RNN-Based Framework Towards Lens Irregularity Detection in Cataract Surgery Videoscited by 15
  17. 2024VidLPRO: A underlineVideo-underlineLanguage underlinePre-training Framework for underlineRobotic and Laparoscopic Surgerycited by 12
  18. 2023CoLo-CAM: Class Activation Mapping for Object Co-Localization in Weakly-Labeled Unconstrained Videoscited by 7
  19. 2025TEMSET-24K: Densely Annotated Dataset for Indexing Multipart Endoscopic Videos using Surgical Timeline Segmentationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026EyeVQA: Benchmarking Ophthalmic Vision-Language Models from Recognition to Spatial Grounding
  2. 2025Benchmarking Next-Generation Reasoning-Focused Large Language Models in Ophthalmology: A Head-to-Head Evaluation on 5,888 Items
  3. 2026Scientific Domain Knowledge Improves Vision-Language Fundus Models
  4. 2025EyecareGPT: Boosting Comprehensive Ophthalmology Understanding with Tailored Dataset, Benchmark and Model
  5. 2025SurgVLM: A Large Vision-Language Model and Systematic Evaluation Benchmark for Surgical Intelligence
  6. 2026VOLMO: Versatile and Open Large Models for Ophthalmology
  7. 2025Systematic Evaluation of Large Vision-Language Models for Surgical Artificial Intelligence
  8. 2025CataractSurg-80K: Knowledge-Driven Benchmarking for Structured Reasoning in Ophthalmic Surgery Planning