A Review of Winograd Schema Challenge Datasets and Approaches
Not on the map. Why?
Abstract (arXiv)
The Winograd Schema Challenge is both a commonsense reasoning and natural language understanding challenge, introduced as an alternative to the Turing test. A Winograd schema is a pair of sentences differing in one or two words with a highly ambiguous pronoun, resolved differently in the two sentences, that appears to require commonsense knowledge to be resolved correctly. The examples were designed to be easily solvable by humans but difficult for machines, in principle requiring a deep understanding of the content of the text and the situation it describes. This paper reviews existing Winograd Schema Challenge benchmark datasets and approaches that have been published since its introduction.
Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 7; 2023: 4; 2024: 4; 2025: 3; 2026: 2.
27 papers.
Sort:
By area:
- 2022Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionalitycited by 523
- 2022Meaning without reference in large language modelscited by 76
- 2021Back to Square One: Artifact Detection, Training and Commonsense Disentanglement in the Winograd Schemacited by 32
- 2022WinoGAViL: Gamified Association Benchmark to Challenge Vision-and-Language Modelscited by 20
- 2023Sabi'a: Portuguese Large Language Modelscited by 19
- 2023BLUEX: A benchmark based on Brazilian Leading Universities Entrance eXamscited by 15
- 2024Efficiency optimization of large-scale language models based on deep learning in natural language processing taskscited by 14
- 2024When Attention Collapses: How Degenerate Layers in LLMs Enable Smaller, Stronger Modelscited by 12
- 2024Achieving Dimension-Free Communication in Federated Learning via Zeroth-Order Optimizationcited by 12
- 2023Baby's CoThought: Leveraging Large Language Models for Enhanced Reasoning in Compact Modelscited by 9
- 2025C3: A Bilingual Benchmark for Spoken Dialogue Models Exploring Challenges in Complex Conversationscited by 9
- 2024Neuron-based Multifractal Analysis of Neuron Interaction Dynamics in Large Modelscited by 7
15 more
- 2021The Case for Claim Difficulty Assessment in Automatic Fact Checkingcited by 5
- 2025Saliency-driven Dynamic Token Pruning for Large Language Modelscited by 5
- 2025Multilingual Test-Time Scaling via Initial Thought Transfercited by 5
- 2021Towards Zero-shot Commonsense Reasoning with Self-supervised Refinement of Language Modelscited by 4
- 2022Towards Better Few-Shot and Finetuning Performance with Forgetful Causal Language Modelscited by 3
- 2022Analyzing Multi-Task Learning for Abstractive Text Summarizationcited by 3
- 2026HOSL: Hybrid-Order Split Learning for Memory-Constrained Edge Trainingcited by 3
- 2021Unsupervised Pronoun Resolution via Masked Noun-Phrase Predictioncited by 2
- 2022On Reality and the Limits of Language Data: Aligning LLMs with Human Normscited by 2
- 2026MI-PRUN: Optimize Large Language Model Pruning via Mutual Informationcited by 2
- 2021Revisiting the Prepositional-Phrase Attachment Problem Using Explicit Commonsense Knowledgecited by 1
- 2021Attention-based Contrastive Learning for Winograd Schemascited by 1
- 2022Evaluate Confidence Instead of Perplexity for Zero-shot Commonsense Reasoningcited by 1
- 2021K"unstliche Intelligenz, quo vadis?cited by 0
- 2023Experience and Prediction: A Metric of Hardness for a Novel Litmus Testcited by 0
- 2026HOSL: Hybrid-Order Split Learning for Memory-Constrained Edge Training16 Jan 2026
- 2026MI-PRUN: Optimize Large Language Model Pruning via Mutual Information12 Jan 2026
- 2025C3: A Bilingual Benchmark for Spoken Dialogue Models Exploring Challenges in Complex Conversations30 Jul 2025
- 2025Multilingual Test-Time Scaling via Initial Thought Transfer21 May 2025
- 2025Saliency-driven Dynamic Token Pruning for Large Language Models6 Apr 2025
- 2024Achieving Dimension-Free Communication in Federated Learning via Zeroth-Order Optimization24 May 2024
- 2024Efficiency optimization of large-scale language models based on deep learning in natural language processing tasks20 May 2024
- 2024When Attention Collapses: How Degenerate Layers in LLMs Enable Smaller, Stronger Models12 Apr 2024
- 2024Neuron-based Multifractal Analysis of Neuron Interaction Dynamics in Large Models14 Feb 2024
- 2023Experience and Prediction: A Metric of Hardness for a Novel Litmus Test5 Sep 2023
- 2023Baby's CoThought: Leveraging Large Language Models for Enhanced Reasoning in Compact Models3 Aug 2023
- 2023BLUEX: A benchmark based on Brazilian Leading Universities Entrance eXams11 Jul 2023
15 more
- 2023Sabi'a: Portuguese Large Language Models16 Apr 2023
- 2022Analyzing Multi-Task Learning for Abstractive Text Summarization26 Oct 2022
- 2022Towards Better Few-Shot and Finetuning Performance with Forgetful Causal Language Models24 Oct 2022
- 2022On Reality and the Limits of Language Data: Aligning LLMs with Human Norms25 Aug 2022
- 2022Evaluate Confidence Instead of Perplexity for Zero-shot Commonsense Reasoning23 Aug 2022
- 2022Meaning without reference in large language models5 Aug 2022
- 2022WinoGAViL: Gamified Association Benchmark to Challenge Vision-and-Language Models25 Jul 2022
- 2022Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality7 Apr 2022
- 2021The Case for Claim Difficulty Assessment in Automatic Fact Checking20 Sep 2021
- 2021Attention-based Contrastive Learning for Winograd Schemas10 Sep 2021
- 2021Towards Zero-shot Commonsense Reasoning with Self-supervised Refinement of Language Models10 Sep 2021
- 2021Unsupervised Pronoun Resolution via Masked Noun-Phrase Prediction26 May 2021
- 2021K"unstliche Intelligenz, quo vadis?21 Apr 2021
- 2021Back to Square One: Artifact Detection, Training and Commonsense Disentanglement in the Winograd Schema16 Apr 2021
- 2021Revisiting the Prepositional-Phrase Attachment Problem Using Explicit Commonsense Knowledge1 Feb 2021
- 2022Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionalitycited by 523
- 2022WinoGAViL: Gamified Association Benchmark to Challenge Vision-and-Language Modelscited by 20
- 2023Baby's CoThought: Leveraging Large Language Models for Enhanced Reasoning in Compact Modelscited by 9
- 2025Multilingual Test-Time Scaling via Initial Thought Transfercited by 5
- 2022Evaluate Confidence Instead of Perplexity for Zero-shot Commonsense Reasoningcited by 1
- 2025Multilingual Test-Time Scaling via Initial Thought Transfer21 May 2025
- 2023Baby's CoThought: Leveraging Large Language Models for Enhanced Reasoning in Compact Models3 Aug 2023
- 2022Evaluate Confidence Instead of Perplexity for Zero-shot Commonsense Reasoning23 Aug 2022
- 2022WinoGAViL: Gamified Association Benchmark to Challenge Vision-and-Language Models25 Jul 2022
- 2022Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality7 Apr 2022
- 2022Meaning without reference in large language modelscited by 76
- 2021Back to Square One: Artifact Detection, Training and Commonsense Disentanglement in the Winograd Schemacited by 32
- 2023Sabi'a: Portuguese Large Language Modelscited by 19
- 2023BLUEX: A benchmark based on Brazilian Leading Universities Entrance eXamscited by 15
- 2024Efficiency optimization of large-scale language models based on deep learning in natural language processing taskscited by 14
- 2024When Attention Collapses: How Degenerate Layers in LLMs Enable Smaller, Stronger Modelscited by 12
- 2024Achieving Dimension-Free Communication in Federated Learning via Zeroth-Order Optimizationcited by 12
- 2025C3: A Bilingual Benchmark for Spoken Dialogue Models Exploring Challenges in Complex Conversationscited by 9
- 2024Neuron-based Multifractal Analysis of Neuron Interaction Dynamics in Large Modelscited by 7
- 2021The Case for Claim Difficulty Assessment in Automatic Fact Checkingcited by 5
- 2021Towards Zero-shot Commonsense Reasoning with Self-supervised Refinement of Language Modelscited by 4
- 2022Towards Better Few-Shot and Finetuning Performance with Forgetful Causal Language Modelscited by 3
12 most cited of 21 All 21 (JSON)
- 2026HOSL: Hybrid-Order Split Learning for Memory-Constrained Edge Training16 Jan 2026
- 2026MI-PRUN: Optimize Large Language Model Pruning via Mutual Information12 Jan 2026
- 2025C3: A Bilingual Benchmark for Spoken Dialogue Models Exploring Challenges in Complex Conversations30 Jul 2025
- 2024Achieving Dimension-Free Communication in Federated Learning via Zeroth-Order Optimization24 May 2024
- 2024Efficiency optimization of large-scale language models based on deep learning in natural language processing tasks20 May 2024
- 2024When Attention Collapses: How Degenerate Layers in LLMs Enable Smaller, Stronger Models12 Apr 2024
- 2024Neuron-based Multifractal Analysis of Neuron Interaction Dynamics in Large Models14 Feb 2024
- 2023Experience and Prediction: A Metric of Hardness for a Novel Litmus Test5 Sep 2023
- 2023BLUEX: A benchmark based on Brazilian Leading Universities Entrance eXams11 Jul 2023
- 2023Sabi'a: Portuguese Large Language Models16 Apr 2023
- 2022Analyzing Multi-Task Learning for Abstractive Text Summarization26 Oct 2022
- 2022Towards Better Few-Shot and Finetuning Performance with Forgetful Causal Language Models24 Oct 2022
12 newest of 21 All 21 (JSON)