Unsupervised Pronoun Resolution via Masked Noun-Phrase Prediction
Not on the map. Why?
Abstract (arXiv)
In this work, we propose Masked Noun-Phrase Prediction (MNPP), a pre-training strategy to tackle pronoun resolution in a fully unsupervised setting. Firstly, We evaluate our pre-trained model on various pronoun resolution datasets without any finetuning. Our method outperforms all previous unsupervised methods on all datasets by large margins. Secondly, we proceed to a few-shot setting where we finetune our pre-trained model on WinoGrande-S and XS separately. Our method outperforms RoBERTa-large baseline with large margins, meanwhile, achieving a higher AUC score after further finetuning on the remaining three official splits of WinoGrande.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 34 of its 58 references that are in the map. First posted on arXiv 26 May 2021.
Builds on
34 of 58 references.
References · 34
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,682
- 2015A large annotated corpus for learning natural language inferencecited by 1,847
- 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,729
- 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,292
- 2017RACE: Large-scale ReAding Comprehension Dataset From Examinationscited by 861
- 2019Compressive Transformers for Long-Range Sequence Modellingcited by 726
- 2018Annotation Artifacts in Natural Language Inference Datacited by 671
- 2018From Recognition to Cognition: Visual Commonsense Reasoningcited by 556
22 more
- 2020UnifiedQA: Crossing Format Boundaries With a Single QA Systemcited by 476
- 2019QASC: A Dataset for Question Answering via Sentence Compositioncited by 252
- 2018A Simple Method for Commonsense Reasoningcited by 223
- 2018Higher-order Coreference Resolution with Coarse-to-fine Inferencecited by 150
- 2019Quoref: A Reading Comprehension Dataset with Questions Requiring Coreferential Reasoningcited by 100
- 2020Coreferential Reasoning Learning for Language Representationcited by 80
- 2019Unsupervised Question Answering by Cloze Translationcited by 59
- 2020Video2Commonsense: Generating Commonsense Descriptions to Enrich Video Captioningcited by 36
- 2019A Surprisingly Robust Trick for Winograd Schema Challengecited by 30
- 2020Self-supervised Knowledge Triplet Learning for Zero-shot Question Answeringcited by 29
- 2019Align, Mask and Select: A Simple Method for Incorporating Commonsense Knowledge into Language Representation Modelscited by 28
- 2020A Review of Winograd Schema Challenge Datasets and Approachescited by 27
- 2020Contrastive Self-Supervised Learning for Commonsense Reasoningcited by 25
- 2021Self-Supervised Test-Time Learning for Reading Comprehensioncited by 22
- 2020Harvesting and Refining Question-Answer Pairs for Unsupervised QAcited by 20
- 2019Resolving Gendered Ambiguous Pronouns with BERTcited by 16
- 2019Attention Is (not) All You Need for Commonsense Reasoningcited by 13
- 2019WikiCREM: A Large Unsupervised Corpus for Coreference Resolutioncited by 11
- 2019A Hybrid Neural Network Model for Commonsense Reasoningcited by 10
- 2019Unsupervised Deep Structured Semantic Models for Commonsense Reasoningcited by 4
- 2019Exploring Unsupervised Pretraining and Sentence Structure Modelling for Winograd Schema Challengecited by 3
- 2020TTTTTackling WinoGrande Schemascited by 3
Built on by
Citing papers per year: 2021: 1; 2022: 0; 2023: 0; 2024: 1.
2 papers.