IryoNLP at MEDIQA-CORR 2024: Tackling the Medical Error Detection & Correction Task On the Shoulders of Medical Agents
Not on the map. Why?
Abstract (arXiv)
In natural language processing applied to the clinical domain, utilizing large language models has emerged as a promising avenue for error detection and correction on clinical notes, a knowledge-intensive task for which annotated data is scarce. This paper presents MedReAct'N'MedReFlex, which leverages a suite of four LLM-based medical agents. The MedReAct agent initiates the process by observing, analyzing, and taking action, generating trajectories to guide the search to target a potential error in the clinical notes. Subsequently, the MedEval agent employs five evaluators to assess the targeted error and the proposed correction. In cases where MedReAct's actions prove insufficient, the MedReFlex agent intervenes, engaging in reflective analysis and proposing alternative strategies. Finally, the MedFinalParser agent formats the final output, preserving the original style while ensuring the integrity of the error correction process. One core component of our method is our RAG pipeline based on our ClinicalCorp corpora. Among other well-known sources containing clinical guidelines and information, we preprocess and release the open-source MedWiki dataset for clinical RAG application. Our results demonstrate the central role of our RAG approach with ClinicalCorp leveraged through the MedReAct'N'MedReFlex framework. It achieved the ninth rank on the MEDIQA-CORR 2024 final leaderboard.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 25 of its 43 references that are in the map. First posted on arXiv 23 Apr 2024.
Builds on
25 of 43 references.
References · 25
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
- 2022Large Language Models Encode Clinical Knowledgecited by 1,830
- 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,356
13 more
- 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,128
- 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 861
- 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 832
- 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 801
- 2024Yi: Open Foundation Models by 01.AIcited by 719
- 2024Benchmarking Retrieval-Augmented Generation for Medicinecited by 331
- 2023MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoningcited by 316
- 2024BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domainscited by 301
- 2023BiomedGPT: A Generalist Vision-Language Foundation Model for Diverse Biomedical Taskscited by 201
- 2023MedCPT: Contrastive Pre-trained Transformers with Large-scale PubMed Search Logs for Zero-shot Biomedical Information Retrievalcited by 185
- 2023Fine-Tuning or Retrieval? Comparing Knowledge Injection in LLMscited by 178
- 2024Self-Discover: Large Language Models Self-Compose Reasoning Structurescited by 110
- 2020Look at the First Sentence: Position Bias in Question Answeringcited by 84
Built on by
Citing papers per year: 2025: 3; 2026: 3.
6 papers.
- 2025A Modular Approach for Clinical SLMs Driven by Synthetic Data with Pre-Instruction Tuning, Model Merging, and Clinical-Tasks Alignmentcited by 20
- 2025Towards Omni-RAG: Comprehensive Retrieval-Augmented Generation for Large Language Models in Medical Applicationscited by 13
- 2025Empowering Healthcare Practitioners with Language Models: Structuring Speech Transcripts in Two Real-World Clinical Applicationscited by 7
- 2026MedErrBench: A Fine-Grained Multilingual Benchmark for Medical Error Detection and Correction with Clinical Expert Annotationscited by 2
- 2026MedGuards: Multi-Agent System for Reliable Medical Error Detection and Correctioncited by 0
- 2026Toward Better Assessment of LLMs' Performance in Clinical Error Detectioncited by 0
- 2026Toward Better Assessment of LLMs' Performance in Clinical Error Detection17 Aug 2026
- 2026MedGuards: Multi-Agent System for Reliable Medical Error Detection and Correction24 Jun 2026
- 2026MedErrBench: A Fine-Grained Multilingual Benchmark for Medical Error Detection and Correction with Clinical Expert Annotations5 Feb 2026
- 2025Empowering Healthcare Practitioners with Language Models: Structuring Speech Transcripts in Two Real-World Clinical Applications7 Jul 2025
- 2025A Modular Approach for Clinical SLMs Driven by Synthetic Data with Pre-Instruction Tuning, Model Merging, and Clinical-Tasks Alignment15 May 2025
- 2025Towards Omni-RAG: Comprehensive Retrieval-Augmented Generation for Large Language Models in Medical Applications5 Jan 2025
Similar, not cited
Close in wording, no citation either way
- 2025MedRECT: A Medical Reasoning Benchmark for Error Correction in Clinical Texts
- 2024MEDEC: A Benchmark for Medical Error Detection and Correction in Clinical Notes
- 2024PromptMind Team at MEDIQA-CORR 2024: Improving Clinical Text Correction with Error Categorization and LLM Ensembles
- 2026BLUEmed: Retrieval-Augmented Multi-Agent Debate for Clinical Error Detection
- 2025A Systematic Analysis of Large Language Models with RAG-enabled Dynamic Prompting for Medical Error Detection and Correction
- 2025Retrieval-Augmented Guardrails for AI-Drafted Patient-Portal Messages: Error Taxonomy Construction and Large-Scale Evaluation
- 2025MedHELM: Holistic Evaluation of Large Language Models for Medical Tasks
- 2026AgenticSum: An Agentic Inference-Time Framework for Faithful Clinical Text Summarization