Detecting of a Patient's Condition From Clinical Narratives Using Natural Language Representation
Not on the map. Why?
Abstract (arXiv)
The rapid progress in clinical data management systems and artificial intelligence approaches enable the era of personalized medicine. Intensive care units (ICUs) are the ideal clinical research environment for such development because they collect many clinical data and are highly computerized environments. We designed a retrospective clinical study on a prospective ICU database using clinical natural language to help in the early diagnosis of heart failure in critically ill children. The methodology consisted of empirical experiments of a learning algorithm to learn the hidden interpretation and presentation of the French clinical note data. This study included 1386 patients' clinical notes with 5444 single lines of notes. There were 1941 positive cases (36 % of total) and 3503 negative cases classified by two independent physicians using a standardized approach. The multilayer perceptron neural network outperforms other discriminative and generative classifiers. Consequently, the proposed framework yields an overall classification performance with 89 % accuracy, 88 % recall, and 89 % precision. This study successfully applied learning representation and machine learning algorithms to detect heart failure from clinical natural language in a single French institution. Further work is needed to use the same methodology in other institutions and other languages.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 20 of its 92 references that are in the map. First posted on arXiv 8 Apr 2021.
Builds on
20 of 92 references.
References · 20
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2019DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphscited by 883
- 2019CamemBERT: a Tasty French Language Modelcited by 368
- 2018Scalable and accurate deep learning for electronic health recordscited by 275
- 2017Recent Trends in Deep Learning Based Natural Language Processingcited by 262
- 2019Do NLP Models Know Numbers? Probing Numeracy in Embeddingscited by 157
- 2020Challenges in Deploying Machine Learning: a Survey of Case Studiescited by 151
- 2017Convergence Analysis of Two-layer Neural Networks with ReLU Activationcited by 137
- 2019Natural Language Processing of Clinical Notes on Chronic Diseases: Systematic Reviewcited by 36
- 2017Scattertext: a Browser-Based Tool for Visualizing how Corpora Differcited by 22
8 more
- 2020An Empirical Investigation of Contextualized Number Predictioncited by 21
- 2018Early Prediction of Acute Kidney Injury in Critical Care Setting Using Clinical Notescited by 11
- 2019Bayes Imbalance Impact Index: A Measure of Class Imbalanced Dataset for Classification Problemcited by 10
- 2015How to Generate a Good Word Embedding?cited by 9
- 2016The Effects of Data Size and Frequency Range on Distributional Semantic Modelscited by 6
- 2019Predicting Heart Failure Readmission from Clinical Notes Using Deep Learningcited by 6
- 2017Effective Representations of Clinical Notescited by 1
- 2020Morphological Skip-Gram: Using morphological knowledge to improve word representationcited by 1
Built on by
Citing papers per year: 2022: 1; 2023: 2; 2024: 5.
8 papers.
- 2022Adaptation of Autoencoder for Sparsity Reduction From Clinical Notes Representation Learningcited by 4
- 2024The Impact of LoRA Adapters on LLMs for Clinical Text Classification Under Computational and Data Constraintscited by 4
- 2023Improving Transformer Performance for French Clinical Notes Classification Using Mixture of Experts on a Limited Datasetcited by 3
- 2023Label Propagation Techniques for Artifact Detection in Imbalanced Classes using Photoplethysmogram Signalscited by 2
- 2024A Novel Transformer-Based Self-Supervised Learning Method to Enhance Photoplethysmogram Signal Artifact Detectioncited by 1
- 2024Multi-objective Representation for Numbers in Clinical Narratives: A CamemBERT-Bio-Based Alternative to Large-Scale LLMscited by 1
- 2024Detecci'on Autom'atica de Patolog'ias en Notas Cl'inicas en Espa~nol Combinando Modelos de Lenguaje y Ontolog'ias M'edicoscited by 0
- 2024Automatic detection of diseases in Spanish clinical notes combining medical language models and ontologiescited by 0
- 2024Automatic detection of diseases in Spanish clinical notes combining medical language models and ontologies4 Dec 2024
- 2024Detecci'on Autom'atica de Patolog'ias en Notas Cl'inicas en Espa~nol Combinando Modelos de Lenguaje y Ontolog'ias M'edicos1 Oct 2024
- 2024The Impact of LoRA Adapters on LLMs for Clinical Text Classification Under Computational and Data Constraints27 Jul 2024
- 2024Multi-objective Representation for Numbers in Clinical Narratives: A CamemBERT-Bio-Based Alternative to Large-Scale LLMs28 May 2024
- 2024A Novel Transformer-Based Self-Supervised Learning Method to Enhance Photoplethysmogram Signal Artifact Detection2 Jan 2024
- 2023Label Propagation Techniques for Artifact Detection in Imbalanced Classes using Photoplethysmogram Signals16 Aug 2023
- 2023Improving Transformer Performance for French Clinical Notes Classification Using Mixture of Experts on a Limited Dataset22 Mar 2023
- 2022Adaptation of Autoencoder for Sparsity Reduction From Clinical Notes Representation Learning26 Sep 2022