NegBio: a high-performance tool for negation and uncertainty detection in radiology reports
Not on the map. Why?
Abstract (arXiv)
Negative and uncertain medical findings are frequent in radiology reports, but discriminating them from positive findings remains challenging for information extraction. Here, we propose a new algorithm, NegBio, to detect negative and uncertain findings in radiology reports. Unlike previous rule-based methods, NegBio utilizes patterns on universal dependencies to identify the scope of triggers that are indicative of negation or uncertainty. We evaluated NegBio on four datasets, including two public benchmarking corpora of radiology reports, a new radiology corpus that we annotated for this work, and a public corpus of general clinical texts. Evaluation on these datasets demonstrates that NegBio is highly accurate for detecting negative and uncertain findings and compares favorably to a widely-used state-of-the-art system NegEx (an average of 9.5% improvement in precision and 5.1% in F1-score).
Key facts. Cited by 79 papers in the map (data through 14 Oct 2026). First posted on arXiv 16 Dec 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 15; 2023: 14; 2024: 15; 2025: 8; 2026: 11.
79 papers.
Sort:
By area:
- 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 570
- 2021RadGraph: Extracting Clinical Entities and Relations from Radiology Reportscited by 319
- 2023MedKLIP: Medical Knowledge Enhanced Language-Image Pre-Training in Radiologycited by 149
- 2023Knowledge-enhanced Visual-Language Pre-training on Chest Radiology Imagescited by 128
- 2024Vision-Language Models for Medical Report Generation and Visual Question Answering: A Reviewcited by 125
- 2024VILA-M3: Enhancing Vision-Language Models with Medical Expert Knowledgecited by 50
- 2022Long-Tailed Classification of Thorax Diseases on Chest X-Ray: A New Benchmark Studycited by 45
- 2021Progressive Transformer-Based Generation of Radiology Reportscited by 43
- 2023CLIP in Medical Imaging: A Surveycited by 40
- 2021RATCHET: Medical Transformer for Chest X-ray Diagnosis and Reportingcited by 34
- 2021VisualCheXbert: Addressing the Discrepancy Between Radiology Report Labels and Image Labelscited by 27
- 2022Not another Negation Benchmark: The NaN-NLI Test Suite for Sub-clausal Negationcited by 25
38 more
- 2022Anatomy-Guided Weakly-Supervised Abnormality Localization in Chest X-rayscited by 21
- 2021BERTHop: An Effective Vision-and-Language Model for Chest X-ray Disease Diagnosiscited by 20
- 2022Medical Image Captioning via Generative Pretrained Transformerscited by 20
- 2022Improving negation detection with negation-focused pre-trainingcited by 14
- 2023MultiModN- Multimodal, Multi-Task, Interpretable Modular Networkscited by 14
- 2023A Systematic Review of Deep Learning-based Research on Radiology Report Generationcited by 14
- 2022Hierarchical Annotation for Building A Suite of Clinical Natural Language Processing Tasks: Progress Note Understandingcited by 13
- 2023Knowledge Boosting: Rethinking Medical Contrastive Vision-Language Pre-Trainingcited by 13
- 2023UniBrain: Universal Brain MRI Diagnosis with Hierarchical Knowledge-enhanced Pre-trainingcited by 13
- 2023RadGraph2: Modeling Disease Progression in Radiology Reports via Hierarchical Information Extractioncited by 11
- 2023Enhancing Network Initialization for Medical AI Models Using Large-Scale, Unlabeled Natural Imagescited by 11
- 2023Foundation Ark: Accruing and Reusing Knowledge for Superior and Robust Performancecited by 11
- 2021A Scoping Review of Publicly Available Language Tasks in Clinical Natural Language Processingcited by 10
- 2022Collaborative Training of Medical Artificial Intelligence Models with non-uniform Labelscited by 10
- 2024CheX-GPT: Harnessing Large Language Models for Enhanced Chest X-ray Report Labelingcited by 10
- 2024Exploring Low-Resource Medical Image Classification with Weakly Supervised Prompt Learningcited by 10
- 2024X-ray Made Simple: Lay Radiology Report Generation and Robust Evaluationcited by 10
- 2024Enhancing chest X-ray datasets with privacy-preserving large language models and multi-type annotations: a data-driven approach for improved classificationcited by 8
- 2021Self-Supervised Detection of Contextual Synonyms in a Multi-Class Setting: Phenotype Annotation Use Casecited by 7
- 2022Radiomics-Guided Global-Local Transformer for Weakly Supervised Pathology Localization in Chest X-Rayscited by 7
- 2023An empirical study of using radiology reports and images to improve ICU mortality predictioncited by 7
- 2023Several categories of Large Language Models (LLMs): A Short Surveycited by 7
- 2024Uncovering Knowledge Gaps in Radiology Report Generation Models through Knowledge Graphscited by 7
- 2021Knowledge-Augmented Contrastive Learning for Abnormality Classification and Localization in Chest X-rays with Radiomics using a Feedback Loopcited by 6
- 2021Modality and Negation in Event Extractioncited by 6
- 2023Improving Medical Speech-to-Text Accuracy with Vision-Language Pre-training Modelcited by 6
- 2022Radiology Text Analysis System (RadText): Architecture and Evaluationcited by 5
- 2022Learning to diagnose common thorax diseases on chest radiographs from radiology reports in Vietnamesecited by 5
- 2024Topicwise Separable Sentence Retrieval for Medical Report Generationcited by 5
- 2024Enhancing disease detection in radiology reports through fine-tuning lightweight LLM on weak labelscited by 5
- 2022Attend Who is Weak: Pruning-assisted Medical Image Localization under Sophisticated and Implicit Imbalancescited by 4
- 2025MRG-R1: Reinforcement Learning for Clinically Aligned Medical Report Generationcited by 4
- 2026Possible or Definite? A Benchmark for Evaluating Diagnostic Uncertainty Preservation in Clinical Textcited by 4
- 2021Leveraging Deep Representations of Radiology Reports in Survival Analysis for Predicting Heart Failure Patient Mortalitycited by 3
- 2021RapidRead: Global Deployment of State-of-the-art Radiology AI for a Large Veterinary Teleradiology Practicecited by 3
- 2025CoRPA: Adversarial Image Generation for Chest X-rays Using Concept Vector Perturbations and Generative Modelscited by 3
- 2024Can Rule-Based Insights Enhance LLMs for Radiology Report Classification? Introducing the RadPrompt Methodologycited by 2
- 2025Annotating Scientific Uncertainty: A comprehensive model using linguistic patterns and comparison with existing approachescited by 2
50 most cited of 79 All 79 (JSON)
- 2026Negation Beyond the Verbal Channel: Temporal Multimodal Correlates in Dialogue14 Sep 2026
- 2026ChestPheNoT: Deployable, Auditable Label-Status-Evidence Extraction from Radiology Reports9 Sep 2026
- 2026When Repository Labels Are Not Image-Level Truth: A Supervision Auditing Framework for Chest Radiograph AI10 Aug 2026
- 2026CXR-Retrieve: Compositional Text-to-Image Retrieval in Chest Radiography30 Jul 2026
- 2026Learning to Detect Cross-Modal Negation: An Analysis of Latent Representations and an Attention-Based Solution20 Jul 2026
- 2026Reconfigurable Radiology Labels Without Relabeling6 Jul 2026
- 2026MRI2Rep: Autoregressive Structured Report Generation for 3D Liver MRI24 Jun 2026
- 2026Possible or Definite? A Benchmark for Evaluating Diagnostic Uncertainty Preservation in Clinical Text16 Jun 2026
- 2026PromptRad: Knowledge-Enhanced Multi-Label Prompt-Tuning for Low-Resource Radiology Report Labeling19 May 2026
- 2026ClinicalBench: Stress-Testing Assertion-Aware Retrieval for Cross-Admission Clinical QA on MIMIC-IV11 May 2026
- 2026MedProbCLIP: Probabilistic Adaptation of Vision-Language Foundation Model for Reliable Radiograph-Report Retrieval17 Feb 2026
- 2025MRG-R1: Reinforcement Learning for Clinically Aligned Medical Report Generation18 Dec 2025
38 more
- 2025MetaChest: Generalized few-shot learning of pathologies from chest X-rays29 Sep 2025
- 2025Limitations of Public Chest Radiography Datasets for Artificial Intelligence: Label Quality, Domain Shift, Bias and Evaluation Challenges18 Sep 2025
- 2025VLM-KG: Multimodal Radiology Knowledge Graph Generation13 May 2025
- 2025IP-CRR: Information Pursuit for Interpretable Classification of Chest Radiology Reports30 Apr 2025
- 2025A Reality Check of Vision-Language Pre-training in Radiology: Have We Progressed Using Text?7 Apr 2025
- 2025Annotating Scientific Uncertainty: A comprehensive model using linguistic patterns and comparison with existing approaches14 Mar 2025
- 2025CoRPA: Adversarial Image Generation for Chest X-rays Using Concept Vector Perturbations and Generative Models4 Feb 2025
- 2024VILA-M3: Enhancing Vision-Language Models with Medical Expert Knowledge19 Nov 2024
- 2024Automated Spinal MRI Labelling from Reports Using a Large Language Model22 Oct 2024
- 2024Enhancing disease detection in radiology reports through fine-tuning lightweight LLM on weak labels25 Sep 2024
- 2024Uncovering Knowledge Gaps in Radiology Report Generation Models through Knowledge Graphs26 Aug 2024
- 2024Can Rule-Based Insights Enhance LLMs for Radiology Report Classification? Introducing the RadPrompt Methodology7 Aug 2024
- 2024X-ray Made Simple: Lay Radiology Report Generation and Robust Evaluation25 Jun 2024
- 2024Self-supervised vision-langage alignment of deep learning representations for bone X-rays analysis14 May 2024
- 2024Topicwise Separable Sentence Retrieval for Medical Report Generation7 May 2024
- 2024Negation Triplet Extraction with Syntactic Dependency and Semantic Consistency15 Apr 2024
- 2024A Disease Labeler for Chinese Chest X-Ray Report Generation18 Mar 2024
- 2024How Well Do Multi-modal LLMs Interpret CT Scans? An Auto-Evaluation Framework for Analyses8 Mar 2024
- 2024Enhancing chest X-ray datasets with privacy-preserving large language models and multi-type annotations: a data-driven approach for improved classification6 Mar 2024
- 2024Vision-Language Models for Medical Report Generation and Visual Question Answering: A Review4 Mar 2024
- 2024Exploring Low-Resource Medical Image Classification with Weakly Supervised Prompt Learning6 Feb 2024
- 2024CheX-GPT: Harnessing Large Language Models for Enhanced Chest X-ray Report Labeling21 Jan 2024
- 2023CLIP in Medical Imaging: A Survey12 Dec 2023
- 2023A Systematic Review of Deep Learning-based Research on Radiology Report Generation23 Nov 2023
- 2023Foundation Ark: Accruing and Reusing Knowledge for Superior and Robust Performance14 Oct 2023
- 2023Reconstruction of Patient-Specific Confounders in AI-based Radiologic Image Interpretation using Generative Pretraining29 Sep 2023
- 2023MultiModN- Multimodal, Multi-Task, Interpretable Modular Networks25 Sep 2023
- 2023UniBrain: Universal Brain MRI Diagnosis with Hierarchical Knowledge-enhanced Pre-training13 Sep 2023
- 2023Enhancing Network Initialization for Medical AI Models Using Large-Scale, Unlabeled Natural Images15 Aug 2023
- 2023RadGraph2: Modeling Disease Progression in Radiology Reports via Hierarchical Information Extraction9 Aug 2023
- 2023Knowledge Boosting: Rethinking Medical Contrastive Vision-Language Pre-Training14 Jul 2023
- 2023Several categories of Large Language Models (LLMs): A Short Survey5 Jul 2023
- 2023An empirical study of using radiology reports and images to improve ICU mortality prediction20 Jun 2023
- 2023Improving Medical Speech-to-Text Accuracy with Vision-Language Pre-training Model27 Feb 2023
- 2023Knowledge-enhanced Visual-Language Pre-training on Chest Radiology Images27 Feb 2023
- 2023MedKLIP: Medical Knowledge Enhanced Language-Image Pre-Training in Radiology5 Jan 2023
- 2022Attend Who is Weak: Pruning-assisted Medical Image Localization under Sophisticated and Implicit Imbalances6 Dec 2022
- 2022Collaborative Training of Medical Artificial Intelligence Models with non-uniform Labels24 Nov 2022
50 newest of 79 All 79 (JSON)
- 2024Vision-Language Models for Medical Report Generation and Visual Question Answering: A Reviewcited by 125
- 2024VILA-M3: Enhancing Vision-Language Models with Medical Expert Knowledgecited by 50
- 2023Knowledge Boosting: Rethinking Medical Contrastive Vision-Language Pre-Trainingcited by 13
- 2024Exploring Low-Resource Medical Image Classification with Weakly Supervised Prompt Learningcited by 10
- 2023Improving Medical Speech-to-Text Accuracy with Vision-Language Pre-training Modelcited by 6
- 2025A Reality Check of Vision-Language Pre-training in Radiology: Have We Progressed Using Text?cited by 2
- 2025VLM-KG: Multimodal Radiology Knowledge Graph Generationcited by 1
- 2026MedProbCLIP: Probabilistic Adaptation of Vision-Language Foundation Model for Reliable Radiograph-Report Retrievalcited by 1
- 2024Self-supervised vision-langage alignment of deep learning representations for bone X-rays analysiscited by 0
- 2026MedProbCLIP: Probabilistic Adaptation of Vision-Language Foundation Model for Reliable Radiograph-Report Retrieval17 Feb 2026
- 2025VLM-KG: Multimodal Radiology Knowledge Graph Generation13 May 2025
- 2025A Reality Check of Vision-Language Pre-training in Radiology: Have We Progressed Using Text?7 Apr 2025
- 2024VILA-M3: Enhancing Vision-Language Models with Medical Expert Knowledge19 Nov 2024
- 2024Self-supervised vision-langage alignment of deep learning representations for bone X-rays analysis14 May 2024
- 2024Vision-Language Models for Medical Report Generation and Visual Question Answering: A Review4 Mar 2024
- 2024Exploring Low-Resource Medical Image Classification with Weakly Supervised Prompt Learning6 Feb 2024
- 2023Knowledge Boosting: Rethinking Medical Contrastive Vision-Language Pre-Training14 Jul 2023
- 2023Improving Medical Speech-to-Text Accuracy with Vision-Language Pre-training Model27 Feb 2023
- 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 570
- 2021RadGraph: Extracting Clinical Entities and Relations from Radiology Reportscited by 319
- 2023MedKLIP: Medical Knowledge Enhanced Language-Image Pre-Training in Radiologycited by 149
- 2023Knowledge-enhanced Visual-Language Pre-training on Chest Radiology Imagescited by 128
- 2022Long-Tailed Classification of Thorax Diseases on Chest X-Ray: A New Benchmark Studycited by 45
- 2021Progressive Transformer-Based Generation of Radiology Reportscited by 43
- 2023CLIP in Medical Imaging: A Surveycited by 40
- 2021RATCHET: Medical Transformer for Chest X-ray Diagnosis and Reportingcited by 34
- 2021VisualCheXbert: Addressing the Discrepancy Between Radiology Report Labels and Image Labelscited by 27
- 2022Not another Negation Benchmark: The NaN-NLI Test Suite for Sub-clausal Negationcited by 25
- 2022Anatomy-Guided Weakly-Supervised Abnormality Localization in Chest X-rayscited by 21
- 2021BERTHop: An Effective Vision-and-Language Model for Chest X-ray Disease Diagnosiscited by 20
12 most cited of 69 All 69 (JSON)
- 2026Negation Beyond the Verbal Channel: Temporal Multimodal Correlates in Dialogue14 Sep 2026
- 2026ChestPheNoT: Deployable, Auditable Label-Status-Evidence Extraction from Radiology Reports9 Sep 2026
- 2026When Repository Labels Are Not Image-Level Truth: A Supervision Auditing Framework for Chest Radiograph AI10 Aug 2026
- 2026CXR-Retrieve: Compositional Text-to-Image Retrieval in Chest Radiography30 Jul 2026
- 2026Learning to Detect Cross-Modal Negation: An Analysis of Latent Representations and an Attention-Based Solution20 Jul 2026
- 2026Reconfigurable Radiology Labels Without Relabeling6 Jul 2026
- 2026MRI2Rep: Autoregressive Structured Report Generation for 3D Liver MRI24 Jun 2026
- 2026Possible or Definite? A Benchmark for Evaluating Diagnostic Uncertainty Preservation in Clinical Text16 Jun 2026
- 2026PromptRad: Knowledge-Enhanced Multi-Label Prompt-Tuning for Low-Resource Radiology Report Labeling19 May 2026
- 2026ClinicalBench: Stress-Testing Assertion-Aware Retrieval for Cross-Admission Clinical QA on MIMIC-IV11 May 2026
- 2025MRG-R1: Reinforcement Learning for Clinically Aligned Medical Report Generation18 Dec 2025
- 2025MetaChest: Generalized few-shot learning of pathologies from chest X-rays29 Sep 2025
12 newest of 69 All 69 (JSON)