mlsanityData to 14 Oct 2026

CARES: Collaborative Agentic Reasoning for Error Detection in Surgery

arXiv 2508.08764 ↗First posted 12 Aug 2025cs.MAcited by 3

On the map: LLM agents and tool use → Medical and scientific domain agents

Abstract (arXiv)

Robotic-assisted surgery (RAS) introduces complex challenges that current surgical error detection methods struggle to address effectively due to limited training data and methodological constraints. Therefore, we construct MERP (Multi-class Error in Robotic Prostatectomy), a comprehensive dataset for error detection in robotic prostatectomy with frame-level annotations featuring six clinically aligned error categories. In addition, we propose CARES (Collaborative Agentic Reasoning for Error Detection in Surgery), a novel zero-shot clinically-informed and risk-stratified agentic reasoning architecture for multi-class surgical error detection. CARES implements adaptive generation of medically informed, error-specific Chain-of-Thought (CoT) prompts across multiple expertise levels. The framework employs risk-aware routing to assign error task to expertise-matched reasoning pathways based on complexity and clinical impact. Subsequently, each pathway decomposes surgical error analysis into three specialized agents with temporal, spatial, and procedural analysis. Each agent analyzes using dynamically selected prompts tailored to the assigned expertise level and error type, generating detailed and transparent reasoning traces. By incorporating clinically informed reasoning from established surgical assessment guidelines, CARES enables zero-shot surgical error detection without prior training. Evaluation demonstrates superior performance with 54.3 mF1 on RARP and 52.0 mF1 on MERP datasets, outperforming existing zero-shot approaches by up to 14% while remaining competitive with trained models. Ablation studies demonstrate the effectiveness of our method. The dataset and code will be publicly available.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 20 of its 50 references that are in the map. First posted on arXiv 12 Aug 2025.

Builds on

20 of 50 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025MedAgent-Pro: Towards Evidence-based Multi-modal Medical Diagnosis via Reasoning Agentic Workflow21 Mar
  2. 2025SurgRAW: Multi-Agent Workflow with Chain of Thought Reasoning for Robotic Surgical Video Analysis13 Mar
  3. 2024MMedAgent: Learning to Use Medical Tools with Multi-modal Agent2 Jul

Other references · 17

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2025Qwen2.5-VL Technical Reportcited by 5,587
  3. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  4. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  5. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  6. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  7. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  8. 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,471
  9. 2023Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agentscited by 333
  10. 2023Better Zero-Shot Reasoning with Role-Play Promptingcited by 223
  11. 2023ExpertPrompting: Instructing Large Language Models to be Distinguished Expertscited by 142
  12. 2017Surgical Data Science: Enabling Next-Generation Surgerycited by 126
5 more
  1. 2023SAR-RARP50: Segmentation of surgical instrumentation and Action Recognition on Robot-Assisted Radical Prostatectomy Challengecited by 56
  2. 2025SurgVLM: A Large Vision-Language Model and Systematic Evaluation Benchmark for Surgical Intelligencecited by 31
  3. 2023Exploring Sparse Visual Prompt for Domain Adaptive Dense Predictioncited by 28
  4. 2015Adverse Events in Robotic Surgery: A Retrospective Study of 14 Years of FDA Datacited by 9
  5. 2024Think Step by Step: Chain-of-Gesture Prompting for Error Detection in Robotic Surgical Videoscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026SURGENT: A Surgical Multi-Agent Assistance System Across the Perioperative Workflow
  2. 2026SUREON: A Benchmark and Vision-Language-Model for Surgical Reasoning
  3. 2025Affordance-Based Disambiguation of Surgical Instructions for Collaborative Robot-Assisted Surgery ↗
  4. 2025EndoCogniAgent: Closed-Loop Agentic Reasoning with Self-Consistency Validation for Endoscopic Diagnosis
  5. 2024SEDMamba: Enhancing Selective State Space Modelling with Bottleneck Mechanism and Fine-to-Coarse Temporal Fusion for Efficient Error Detection in Robot-Assisted Surgery
  6. 2025Auditing medical multi-agent AI reveals risks of false consensus
  7. 2025SurgXBench: Explainable Vision-Language Model Benchmark for Surgery
  8. 2025LLM-based ambiguity detection in natural language instructions for collaborative surgical robots