How well does surprisal explain N400 amplitude under different experimental conditions?
Not on the map. Why?
Abstract (arXiv)
We investigate the extent to which word surprisal can be used to predict a neural measure of human language processing difficulty - the N400. To do this, we use recurrent neural networks to calculate the surprisal of stimuli from previously published neurolinguistic studies of the N400. We find that surprisal can predict N400 amplitude in a wide range of cases, and the cases where it cannot do so provide valuable insight into the neurocognitive processes underlying the response.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 5; 2023: 5; 2024: 3; 2025: 1.
18 papers.
Sort:
- 2021Multilingual Language Models Predict Human Reading Behaviorcited by 29
- 2022Neural reality of argument structure constructionscited by 25
- 2021How is BERT surprised? Layerwise detection of linguistic anomaliescited by 24
- 2024Log Probabilities Are a Reliable Estimate of Semantic Plausibility in Base and Instruction-Tuned Language Modelscited by 24
- 2021So Cloze yet so Far: N400 Amplitude is Better Predicted by Distributional Information than Human Predictability Judgementscited by 15
- 2021Different kinds of cognitive plausibility: why are transformers better than RNNs at predicting N400 amplitude?cited by 14
- 2023When Language Models Fall in Love: Animacy Processing in Transformer Language Modelscited by 12
- 2023Can Peanuts Fall in Love with Distributional Semantics?cited by 6
- 2022Collateral facilitation in humans and language modelscited by 5
- 2023Probing Quantifier Comprehension in Large Language Models: Another Example of Inverse Scalingcited by 5
- 2022Rarely a problem? Language models exhibit inverse scaling in their predictions following few-type quantifierscited by 4
- 2024Decomposition of surprisal: Unified computational model of ERP components in language processingcited by 2
6 more
- 2022Do language models make human-like predictions about the coreferents of Italian anaphoric zero pronouns?cited by 1
- 2023Are words equally surprising in audio and audio-visual comprehension?cited by 1
- 2023Plausibility Processing in Transformer Language Models: Focusing on the Role of Attention Heads in GPTcited by 1
- 2025Uniform Information Density and Syntactic Reduction: Revisiting textitthat-Mentioning in English Complement Clausescited by 1
- 2022A unified information-theoretic model of EEG signatures of human language processingcited by 0
- 2024Animate, or Inanimate, That is the Question for Large Language Modelscited by 0
- 2025Uniform Information Density and Syntactic Reduction: Revisiting textitthat-Mentioning in English Complement Clauses5 Sep 2025
- 2024Decomposition of surprisal: Unified computational model of ERP components in language processing10 Sep 2024
- 2024Animate, or Inanimate, That is the Question for Large Language Models12 Aug 2024
- 2024Log Probabilities Are a Reliable Estimate of Semantic Plausibility in Base and Instruction-Tuned Language Models21 Mar 2024
- 2023When Language Models Fall in Love: Animacy Processing in Transformer Language Models23 Oct 2023
- 2023Plausibility Processing in Transformer Language Models: Focusing on the Role of Attention Heads in GPT20 Oct 2023
- 2023Are words equally surprising in audio and audio-visual comprehension?14 Jul 2023
- 2023Probing Quantifier Comprehension in Large Language Models: Another Example of Inverse Scaling12 Jun 2023
- 2023Can Peanuts Fall in Love with Distributional Semantics?20 Jan 2023
- 2022Rarely a problem? Language models exhibit inverse scaling in their predictions following few-type quantifiers16 Dec 2022
- 2022A unified information-theoretic model of EEG signatures of human language processing16 Dec 2022
- 2022Collateral facilitation in humans and language models9 Nov 2022
6 more
- 2022Do language models make human-like predictions about the coreferents of Italian anaphoric zero pronouns?30 Aug 2022
- 2022Neural reality of argument structure constructions24 Feb 2022
- 2021So Cloze yet so Far: N400 Amplitude is Better Predicted by Distributional Information than Human Predictability Judgements2 Sep 2021
- 2021Different kinds of cognitive plausibility: why are transformers better than RNNs at predicting N400 amplitude?20 Jul 2021
- 2021How is BERT surprised? Layerwise detection of linguistic anomalies16 May 2021
- 2021Multilingual Language Models Predict Human Reading Behavior12 Apr 2021
- 2021Multilingual Language Models Predict Human Reading Behaviorcited by 29
- 2022Neural reality of argument structure constructionscited by 25
- 2021How is BERT surprised? Layerwise detection of linguistic anomaliescited by 24
- 2024Log Probabilities Are a Reliable Estimate of Semantic Plausibility in Base and Instruction-Tuned Language Modelscited by 24
- 2021So Cloze yet so Far: N400 Amplitude is Better Predicted by Distributional Information than Human Predictability Judgementscited by 15
- 2021Different kinds of cognitive plausibility: why are transformers better than RNNs at predicting N400 amplitude?cited by 14
- 2023When Language Models Fall in Love: Animacy Processing in Transformer Language Modelscited by 12
- 2023Can Peanuts Fall in Love with Distributional Semantics?cited by 6
- 2022Collateral facilitation in humans and language modelscited by 5
- 2023Probing Quantifier Comprehension in Large Language Models: Another Example of Inverse Scalingcited by 5
- 2022Rarely a problem? Language models exhibit inverse scaling in their predictions following few-type quantifierscited by 4
- 2024Decomposition of surprisal: Unified computational model of ERP components in language processingcited by 2
12 most cited of 18 All 18 (JSON)
- 2025Uniform Information Density and Syntactic Reduction: Revisiting textitthat-Mentioning in English Complement Clauses5 Sep 2025
- 2024Decomposition of surprisal: Unified computational model of ERP components in language processing10 Sep 2024
- 2024Animate, or Inanimate, That is the Question for Large Language Models12 Aug 2024
- 2024Log Probabilities Are a Reliable Estimate of Semantic Plausibility in Base and Instruction-Tuned Language Models21 Mar 2024
- 2023When Language Models Fall in Love: Animacy Processing in Transformer Language Models23 Oct 2023
- 2023Plausibility Processing in Transformer Language Models: Focusing on the Role of Attention Heads in GPT20 Oct 2023
- 2023Are words equally surprising in audio and audio-visual comprehension?14 Jul 2023
- 2023Probing Quantifier Comprehension in Large Language Models: Another Example of Inverse Scaling12 Jun 2023
- 2023Can Peanuts Fall in Love with Distributional Semantics?20 Jan 2023
- 2022Rarely a problem? Language models exhibit inverse scaling in their predictions following few-type quantifiers16 Dec 2022
- 2022A unified information-theoretic model of EEG signatures of human language processing16 Dec 2022
- 2022Collateral facilitation in humans and language models9 Nov 2022
12 newest of 18 All 18 (JSON)