Ensemble Kalman filter for uncertainty in human language comprehension
Not on the map. Why?
Abstract (arXiv)
Artificial neural networks (ANNs) are widely used in modeling sentence processing but often exhibit deterministic behavior, contrasting with human sentence comprehension, which manages uncertainty during ambiguous or unexpected inputs. This is exemplified by reversal anomalies-sentences with unexpected role reversals that challenge syntax and semantics-highlighting the limitations of traditional ANN models, such as the Sentence Gestalt (SG) Model. To address these limitations, we propose a Bayesian framework for sentence comprehension, applying an extension of the ensemble Kalman filter (EnKF) for Bayesian inference to quantify uncertainty. By framing language comprehension as a Bayesian inverse problem, this approach enhances the SG model's ability to reflect human sentence processing with respect to the representation of uncertainty. Numerical experiments and comparisons with maximum likelihood estimation (MLE) demonstrate that Bayesian methods improve uncertainty representation, enabling the model to better approximate human cognitive processing when dealing with linguistic ambiguities.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 7 of its 17 references that are in the map. First posted on arXiv 5 May 2025.
Builds on
7 of 17 references.
References · 7
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2018Why ReLU networks yield high-confidence predictions far away from the training data and how to mitigate the problemcited by 323
- 2020Being Bayesian, Even Just a Bit, Fixes Overconfidence in ReLU Networkscited by 227
- 2020Bayesian Deep Learning via Subnetwork Inferencecited by 85
- 2018Ensemble Kalman Inversion: A Derivative-Free Technique For Machine Learning Taskscited by 36
- 2018Never look back - A modified EnKF method and its application to the training of neural networks without back propagationcited by 8
Built on by
Not cited yet.