Can Peanuts Fall in Love with Distributional Semantics?
Not on the map. Why?
Abstract (arXiv)
Context changes expectations about upcoming words - following a story involving an anthropomorphic peanut, comprehenders expect the sentence the peanut was in love more than the peanut was salted, as indexed by N400 amplitude (Nieuwland & van Berkum, 2006). This updating of expectations has been explained using Situation Models - mental representations of a described event. However, recent work showing that N400 amplitude is predictable from distributional information alone raises the question whether situation models are necessary for these contextual effects. We model the results of Nieuwland and van Berkum (2006) using six computational language models and three sets of word vectors, none of which have explicit situation models or semantic grounding. We find that a subset of these can fully model the effect found by Nieuwland and van Berkum (2006). Thus, at least some processing effects normally explained through situation models may not in fact require explicit situation models.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 16 of its 102 references that are in the map. First posted on arXiv 20 Jan 2023.
Builds on
16 of 102 references.
References · 16
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
- 2018Learning Word Vectors for 157 Languagescited by 280
- 2019Negated and Misprimed Probes for Pretrained Language Models: Birds Can Talk, But Cannot Flycited by 243
- 2017Advances in Pre-Training Distributed Word Representationscited by 207
- 2019BERTje: A Dutch BERT Modelcited by 109
- 2020RobBERT: a Dutch RoBERTa-based Language Modelcited by 88
- 2020Human Sentence Processing: Recurrence or Attention?cited by 51
- 2020Exploring BERT's Sensitivity to Lexical Cues using Tests from Semantic Primingcited by 41
- 2020How well does surprisal explain N400 amplitude under different experimental conditions?cited by 18
4 more
- 2021So Cloze yet so Far: N400 Amplitude is Better Predicted by Distributional Information than Human Predictability Judgementscited by 15
- 2021Different kinds of cognitive plausibility: why are transformers better than RNNs at predicting N400 amplitude?cited by 14
- 2016Evaluating Unsupervised Dutch Word Embeddings as a Linguistic Resourcecited by 7
- 2022Collateral facilitation in humans and language modelscited by 5
Built on by
Citing papers per year: 2023: 1; 2024: 1; 2025: 1; 2026: 3.
6 papers.
- 2025Language Model Behavioral Phases are Consistent Across Architecture, Training Data, and Scalecited by 13
- 2023Reanalyzing L2 Preposition Learning with Bayesian Mixed Effects and a Pretrained Language Modelcited by 1
- 2026LLM surprisal is necessary but not sufficient to capture English garden-path effects: Evidence from joint latent modeling of reading paradigmscited by 1
- 2026Failures and Successes to Learn a Core Conceptual Distinction from the Statistics of Languagecited by 1
- 2024Animate, or Inanimate, That is the Question for Large Language Modelscited by 0
- 2026What can LLMs tell us about the mechanisms behind polarity illusions in humans? Experiments across model scales and training stepscited by 0
- 2026Failures and Successes to Learn a Core Conceptual Distinction from the Statistics of Language5 Jul 2026
- 2026What can LLMs tell us about the mechanisms behind polarity illusions in humans? Experiments across model scales and training steps29 Mar 2026
- 2026LLM surprisal is necessary but not sufficient to capture English garden-path effects: Evidence from joint latent modeling of reading paradigms4 Feb 2026
- 2025Language Model Behavioral Phases are Consistent Across Architecture, Training Data, and Scale28 Oct 2025
- 2024Animate, or Inanimate, That is the Question for Large Language Models12 Aug 2024
- 2023Reanalyzing L2 Preposition Learning with Bayesian Mixed Effects and a Pretrained Language Model16 Feb 2023