mlsanityData to 14 Oct 2026

Can Peanuts Fall in Love with Distributional Semantics?

arXiv 2301.08731 ↗First posted 20 Jan 2023cs.CLcited by 6

Not on the map. Why?

Abstract (arXiv)

Context changes expectations about upcoming words - following a story involving an anthropomorphic peanut, comprehenders expect the sentence the peanut was in love more than the peanut was salted, as indexed by N400 amplitude (Nieuwland & van Berkum, 2006). This updating of expectations has been explained using Situation Models - mental representations of a described event. However, recent work showing that N400 amplitude is predictable from distributional information alone raises the question whether situation models are necessary for these contextual effects. We model the results of Nieuwland and van Berkum (2006) using six computational language models and three sets of word vectors, none of which have explicit situation models or semantic grounding. We find that a subset of these can fully model the effect found by Nieuwland and van Berkum (2006). Thus, at least some processing effects normally explained through situation models may not in fact require explicit situation models.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 16 of its 102 references that are in the map. First posted on arXiv 20 Jan 2023.

Builds on

16 of 102 references.

References · 16

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  4. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
  5. 2018Learning Word Vectors for 157 Languagescited by 280
  6. 2019Negated and Misprimed Probes for Pretrained Language Models: Birds Can Talk, But Cannot Flycited by 243
  7. 2017Advances in Pre-Training Distributed Word Representationscited by 207
  8. 2019BERTje: A Dutch BERT Modelcited by 109
  9. 2020RobBERT: a Dutch RoBERTa-based Language Modelcited by 88
  10. 2020Human Sentence Processing: Recurrence or Attention?cited by 51
  11. 2020Exploring BERT's Sensitivity to Lexical Cues using Tests from Semantic Primingcited by 41
  12. 2020How well does surprisal explain N400 amplitude under different experimental conditions?cited by 18
4 more
  1. 2021So Cloze yet so Far: N400 Amplitude is Better Predicted by Distributional Information than Human Predictability Judgementscited by 15
  2. 2021Different kinds of cognitive plausibility: why are transformers better than RNNs at predicting N400 amplitude?cited by 14
  3. 2016Evaluating Unsupervised Dutch Word Embeddings as a Linguistic Resourcecited by 7
  4. 2022Collateral facilitation in humans and language modelscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 1; 2025: 1; 2026: 3.

6 papers.