Design considerations for a hierarchical semantic compositional framework for medical natural language understanding
Not on the map. Why?
Abstract (arXiv)
Medical natural language processing (NLP) systems are a key enabling technology for transforming Big Data from clinical report repositories to information used to support disease models and validate intervention methods. However, current medical NLP systems fall considerably short when faced with the task of logically interpreting clinical text. In this paper, we describe a framework inspired by mechanisms of human cognition in an attempt to jump the NLP performance curve. The design centers about a hierarchical semantic compositional model (HSCM) which provides an internal substrate for guiding the interpretation process. The paper describes insights from four key cognitive aspects including semantic memory, semantic composition, semantic activation, and hierarchical predictive coding. We discuss the design of a generative semantic model and an associated semantic parser used to transform a free-text sentence into a logical representation of its meaning. The paper discusses supportive and antagonistic arguments for the key features of the architecture as a long-term foundational framework.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 165 references that are in the map. First posted on arXiv 5 Apr 2022.
Builds on
17 of 165 references.
References · 17
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
- 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,046
- 2020COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphscited by 254
- 2020Neurosymbolic AI: The 3rd Wavecited by 253
- 2020Experience Grounds Languagecited by 241
- 2020The Next Decade in AI: Four Steps Towards Robust Artificial Intelligencecited by 194
- 2019Neural-Symbolic Computing: An Effective Methodology for Principled Integration of Machine Learning and Reasoningcited by 149
- 2020Emergence of Separable Manifolds in Deep Language Representationscited by 39
5 more
- 2020To Test Machine Comprehension, Start by Defining Comprehensioncited by 31
- 2021On the Inductive Bias of Masked Language Modeling: From Statistical to Syntactic Dependenciescited by 18
- 2021A Scoping Review of Publicly Available Language Tasks in Clinical Natural Language Processingcited by 10
- 2014Natural Language Processing in Biomedicine: A Unified System Architecture Overviewcited by 5
- 2013Complexity of Representation and Inference in Compositional Models with Part Sharingcited by 2
Built on by
Not cited yet.