How Furiously Can Colourless Green Ideas Sleep? Sentence Acceptability in Context
Not on the map. Why?
Abstract (arXiv)
We study the influence of context on sentence acceptability. First we compare the acceptability ratings of sentences judged in isolation, with a relevant context, and with an irrelevant context. Our results show that context induces a cognitive load for humans, which compresses the distribution of ratings. Moreover, in relevant contexts we observe a discourse coherence effect which uniformly raises acceptability. Next, we test unidirectional and bidirectional language models in their ability to predict acceptability ratings. The bidirectional models show very promising results, with the best model achieving a new state-of-the-art for unsupervised acceptability prediction. The two sets of experiments provide insights into the cognitive aspects of sentence processing and central issues in the computational modelling of text and discourse.
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 5; 2023: 7; 2024: 3; 2025: 1; 2026: 3.
26 papers.
Sort:
By area:
- 2022mGPT: Few-Shot Learners Go Multilingualcited by 141
- 2023The Next Chapter: A Study of Large Language Models in Storytellingcited by 58
- 2021Artificial Text Detection via Examining the Topology of Attention Mapscited by 49
- 2021Grey-box Adversarial Attack And Defence For Sentiment Classificationcited by 28
- 2023A Family of Pretrained Transformer Language Models for Russiancited by 27
- 2022RuCoLA: Russian Corpus of Linguistic Acceptabilitycited by 26
- 2021Monolingual and Cross-Lingual Acceptability Judgments with the Italian CoLA corpuscited by 18
- 2021DaLAJ - a dataset for linguistic acceptability judgments for Swedish: Format, baseline, sharingcited by 16
- 2021Evaluating the Efficacy of Summarization Evaluation across Languagescited by 14
- 2024How to Make the Most of LLMs' Grammatical Knowledge for Acceptability Judgmentscited by 14
- 2024A Systematic Assessment of Language Models with Linguistic Minimal Pairs in Chinesecited by 13
- 2021Shaking Syntactic Trees on the Sesame Street: Multilingual Probing with Controllable Perturbationscited by 10
14 more
- 2024What Goes Into a LM Acceptability Judgment? Rethinking the Impact of Frequency and Lengthcited by 10
- 2023DeltaScore: Fine-Grained Story Evaluation with Perturbationscited by 9
- 2023Second Language Acquisition of Neural Language Modelscited by 8
- 2022Testing the limits of natural language models for predicting human language judgmentscited by 7
- 2022Template-based Approach to Zero-shot Intent Recognitioncited by 5
- 2023Can BERT eat RuCoLA? Topological Data Analysis to Explaincited by 5
- 2023Multilingual Nonce Dependency Treebanks: Understanding how Language Models represent and process syntactic structurecited by 5
- 2021Language Model Evaluation in Open-ended Text Generationcited by 2
- 2026Predicting Sentence Acceptability Judgments in Multimodal Contextscited by 1
- 2022NaturalAdversaries: Can Naturalistic Adversaries Be as Effective as Artificial Adversaries?cited by 0
- 2023Unsupervised Paraphrasing of Multiword Expressionscited by 0
- 2025Do Large Language Models know who did what to whom?cited by 0
- 2026Finding Sense in Nonsense with Generated Contexts: Perspectives from Humans and Language Modelscited by 0
- 2026LLM and Human Modes of Representationcited by 0
- 2026LLM and Human Modes of Representation19 Jun 2026
- 2026Predicting Sentence Acceptability Judgments in Multimodal Contexts24 Feb 2026
- 2026Finding Sense in Nonsense with Generated Contexts: Perspectives from Humans and Language Models12 Feb 2026
- 2025Do Large Language Models know who did what to whom?23 Apr 2025
- 2024A Systematic Assessment of Language Models with Linguistic Minimal Pairs in Chinese9 Nov 2024
- 2024What Goes Into a LM Acceptability Judgment? Rethinking the Impact of Frequency and Length4 Nov 2024
- 2024How to Make the Most of LLMs' Grammatical Knowledge for Acceptability Judgments19 Aug 2024
- 2023Multilingual Nonce Dependency Treebanks: Understanding how Language Models represent and process syntactic structure13 Nov 2023
- 2023A Family of Pretrained Transformer Language Models for Russian19 Sep 2023
- 2023Second Language Acquisition of Neural Language Models5 Jun 2023
- 2023Unsupervised Paraphrasing of Multiword Expressions2 Jun 2023
- 2023Can BERT eat RuCoLA? Topological Data Analysis to Explain4 Apr 2023
14 more
- 2023DeltaScore: Fine-Grained Story Evaluation with Perturbations15 Mar 2023
- 2023The Next Chapter: A Study of Large Language Models in Storytelling24 Jan 2023
- 2022NaturalAdversaries: Can Naturalistic Adversaries Be as Effective as Artificial Adversaries?8 Nov 2022
- 2022RuCoLA: Russian Corpus of Linguistic Acceptability23 Oct 2022
- 2022Template-based Approach to Zero-shot Intent Recognition22 Jun 2022
- 2022mGPT: Few-Shot Learners Go Multilingual15 Apr 2022
- 2022Testing the limits of natural language models for predicting human language judgments7 Apr 2022
- 2021Shaking Syntactic Trees on the Sesame Street: Multilingual Probing with Controllable Perturbations28 Sep 2021
- 2021Monolingual and Cross-Lingual Acceptability Judgments with the Italian CoLA corpus24 Sep 2021
- 2021Artificial Text Detection via Examining the Topology of Attention Maps10 Sep 2021
- 2021Language Model Evaluation in Open-ended Text Generation8 Aug 2021
- 2021Evaluating the Efficacy of Summarization Evaluation across Languages2 Jun 2021
- 2021DaLAJ - a dataset for linguistic acceptability judgments for Swedish: Format, baseline, sharing14 May 2021
- 2021Grey-box Adversarial Attack And Defence For Sentiment Classification22 Mar 2021
- 2022mGPT: Few-Shot Learners Go Multilingualcited by 141
- 2023The Next Chapter: A Study of Large Language Models in Storytellingcited by 58
- 2021Artificial Text Detection via Examining the Topology of Attention Mapscited by 49
- 2021Grey-box Adversarial Attack And Defence For Sentiment Classificationcited by 28
- 2023A Family of Pretrained Transformer Language Models for Russiancited by 27
- 2022RuCoLA: Russian Corpus of Linguistic Acceptabilitycited by 26
- 2021Monolingual and Cross-Lingual Acceptability Judgments with the Italian CoLA corpuscited by 18
- 2021DaLAJ - a dataset for linguistic acceptability judgments for Swedish: Format, baseline, sharingcited by 16
- 2021Evaluating the Efficacy of Summarization Evaluation across Languagescited by 14
- 2024How to Make the Most of LLMs' Grammatical Knowledge for Acceptability Judgmentscited by 14
- 2024A Systematic Assessment of Language Models with Linguistic Minimal Pairs in Chinesecited by 13
- 2021Shaking Syntactic Trees on the Sesame Street: Multilingual Probing with Controllable Perturbationscited by 10
12 most cited of 25 All 25 (JSON)
- 2026LLM and Human Modes of Representation19 Jun 2026
- 2026Predicting Sentence Acceptability Judgments in Multimodal Contexts24 Feb 2026
- 2026Finding Sense in Nonsense with Generated Contexts: Perspectives from Humans and Language Models12 Feb 2026
- 2025Do Large Language Models know who did what to whom?23 Apr 2025
- 2024A Systematic Assessment of Language Models with Linguistic Minimal Pairs in Chinese9 Nov 2024
- 2024How to Make the Most of LLMs' Grammatical Knowledge for Acceptability Judgments19 Aug 2024
- 2023Multilingual Nonce Dependency Treebanks: Understanding how Language Models represent and process syntactic structure13 Nov 2023
- 2023A Family of Pretrained Transformer Language Models for Russian19 Sep 2023
- 2023Second Language Acquisition of Neural Language Models5 Jun 2023
- 2023Unsupervised Paraphrasing of Multiword Expressions2 Jun 2023
- 2023Can BERT eat RuCoLA? Topological Data Analysis to Explain4 Apr 2023
- 2023DeltaScore: Fine-Grained Story Evaluation with Perturbations15 Mar 2023
12 newest of 25 All 25 (JSON)