{"list":"other","total":75,"rows":[{"id":"1804.07461","title":"GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding","created":"2018-04-20","cited_by_count":4899},{"id":"1606.05250","title":"SQuAD: 100,000+ Questions for Machine Comprehension of Text","created":"2016-06-16","cited_by_count":4148},{"id":"1809.09600","title":"HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering","created":"2018-09-25","cited_by_count":3754},{"id":"1705.03551","title":"TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension","created":"2017-05-09","cited_by_count":2955},{"id":"1704.05426","title":"A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference","created":"2017-04-18","cited_by_count":2682},{"id":"1508.05326","title":"A large annotated corpus for learning natural language inference","created":"2015-08-21","cited_by_count":1847},{"id":"1811.00937","title":"CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledge","created":"2018-11-02","cited_by_count":1822},{"id":"1905.00537","title":"SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems","created":"2019-05-02","cited_by_count":1729},{"id":"1803.09010","title":"Datasheets for Datasets","created":"2018-03-23","cited_by_count":1386},{"id":"1808.08745","title":"Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization","created":"2018-08-27","cited_by_count":1317},{"id":"2005.04118","title":"Beyond Accuracy: Behavioral Testing of NLP models with CheckList","created":"2020-05-08","cited_by_count":1006},{"id":"1809.05053","title":"XNLI: Evaluating Cross-lingual Sentence Representations","created":"2018-09-13","cited_by_count":915},{"id":"1902.01007","title":"Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference","created":"2019-02-04","cited_by_count":876},{"id":"1602.06023","title":"Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyond","created":"2016-02-19","cited_by_count":812},{"id":"2003.11080","title":"XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization","created":"2020-03-24","cited_by_count":742},{"id":"1803.02324","title":"Annotation Artifacts in Natural Language Inference Data","created":"2018-03-06","cited_by_count":671},{"id":"2109.02846","title":"Datasets: A Community Library for Natural Language Processing","created":"2021-09-07","cited_by_count":530},{"id":"2102.01454","title":"MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontiers","created":"2021-02-02","cited_by_count":470},{"id":"2103.14749","title":"Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks","created":"2021-03-26","cited_by_count":395},{"id":"2111.15366","title":"AI and the Everything in the Whole Wide World Benchmark","created":"2021-11-26","cited_by_count":349},{"id":"1803.07640","title":"AllenNLP: A Deep Semantic Natural Language Processing Platform","created":"2018-03-20","cited_by_count":347},{"id":"2110.05719","title":"Dealing with Disagreements: Looking Beyond the Majority Vote in Subjective Annotations","created":"2021-10-12","cited_by_count":314},{"id":"1912.05511","title":"Measurement and Fairness","created":"2019-12-11","cited_by_count":308},{"id":"1805.01042","title":"Hypothesis Only Baselines in Natural Language Inference","created":"2018-05-02","cited_by_count":295},{"id":"2111.07997","title":"Annotators with Attitudes: How Annotator Beliefs And Identities Bias Toxic Language Detection","created":"2021-11-15","cited_by_count":264},{"id":"2012.05345","title":"Data and its (dis)contents: A survey of dataset development and use in machine learning research","created":"2020-12-09","cited_by_count":260},{"id":"2102.01672","title":"The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics","created":"2021-02-02","cited_by_count":239},{"id":"1907.07355","title":"Probing Neural Network Comprehension of Natural Language Arguments","created":"2019-07-17","cited_by_count":214},{"id":"2104.02145","title":"What Will it Take to Fix Benchmarking in Natural Language Understanding?","created":"2021-04-05","cited_by_count":203},{"id":"2212.03551","title":"Talking About Large Language Models","created":"2022-12-07","cited_by_count":175},{"id":"2010.03532","title":"What Can We Learn from Collective Human Opinions on Natural Language Inference Data?","created":"2020-10-07","cited_by_count":153},{"id":"2211.02570","title":"The 'Problem' of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation","created":"2022-11-04","cited_by_count":139},{"id":"2204.07931","title":"On the Origin of Hallucinations in Conversational Models: Is it the Datasets or the Models?","created":"2022-04-17","cited_by_count":138},{"id":"2107.07002","title":"The Benchmark Lottery","created":"2021-07-14","cited_by_count":136},{"id":"2104.04302","title":"Annotating and Modeling Fine-grained Factuality in Summarization","created":"2021-04-09","cited_by_count":131},{"id":"2108.12084","title":"Harms of Gender Exclusivity and Challenges in Non-Binary Representation in Language Technologies","created":"2021-08-27","cited_by_count":128},{"id":"2205.12854","title":"Understanding Factual Errors in Summarization: Errors, Summarizers, Datasets, Error Detectors","created":"2022-05-25","cited_by_count":104},{"id":"1808.04926","title":"How Much Reading Does Reading Comprehension Require? A Critical Investigation of Popular Benchmarks","created":"2018-08-14","cited_by_count":88},{"id":"2106.15195","title":"Scientific Credibility of Machine Translation Research: A Meta-Evaluation of 769 Papers","created":"2021-06-29","cited_by_count":71},{"id":"2210.16133","title":"Stop Measuring Calibration When Humans Disagree","created":"2022-10-28","cited_by_count":71},{"id":"2105.05222","title":"Including Signed Languages in Natural Language Processing","created":"2021-05-11","cited_by_count":68},{"id":"1904.01172","title":"Recent Advances in Natural Language Inference: A Survey of Benchmarks, Resources, and Approaches","created":"2019-04-02","cited_by_count":65},{"id":"1707.02268","title":"Text Summarization Techniques: A Brief Survey","created":"2017-07-07","cited_by_count":59},{"id":"2112.04554","title":"Whose Ground Truth? Accounting for Individual and Collective Identities Underlying Dataset Annotation","created":"2021-12-08","cited_by_count":52},{"id":"1904.12106","title":"Understanding Dataset Design Choices for Multi-hop Reasoning","created":"2019-04-27","cited_by_count":50},{"id":"2205.00415","title":"Don't Blame the Annotator: Bias Already Starts in the Annotation Instructions","created":"2022-05-01","cited_by_count":47},{"id":"1911.09241","title":"Assessing the Benchmarking Capacity of Machine Reading Comprehension Datasets","created":"2019-11-21","cited_by_count":46},{"id":"2007.04792","title":"Targeting the Benchmark: On Methodology in Current Natural Language Processing Research","created":"2020-07-07","cited_by_count":45},{"id":"1911.00225","title":"When Choosing Plausible Alternatives, Clever Hans can be Clever","created":"2019-11-01","cited_by_count":40},{"id":"1702.01841","title":"The Effect of Different Writing Tasks on Linguistic Style: A Case Study of the ROC Story Cloze Task","created":"2017-02-07","cited_by_count":39},{"id":"2203.08929","title":"An Analysis of Negation in Natural Language Understanding Corpora","created":"2022-03-16","cited_by_count":39},{"id":"2210.04337","title":"Quantifying Social Biases Using Templates is Unreliable","created":"2022-10-09","cited_by_count":39},{"id":"2204.10216","title":"Re-Examining System-Level Correlations of Automatic Summarization Evaluation Metrics","created":"2022-04-21","cited_by_count":38},{"id":"2105.06020","title":"Are Larger Pretrained Language Models Uniformly Better? Comparing Performance at the Instance Level","created":"2021-05-13","cited_by_count":34},{"id":"2205.06828","title":"Deconstructing NLG Evaluation: Evaluation Practices, Assumptions, and Their Implications","created":"2022-05-13","cited_by_count":32},{"id":"2209.03549","title":"Extractive is not Faithful: An Investigation of Broad Unfaithfulness Problems in Extractive Summarization","created":"2022-09-08","cited_by_count":32},{"id":"2210.10040","title":"The Tail Wagging the Dog: Dataset Construction Biases of Social Bias Benchmarks","created":"2022-10-18","cited_by_count":31},{"id":"1910.12391","title":"What does BERT Learn from Multiple-Choice Reading Comprehension Datasets?","created":"2019-10-28","cited_by_count":30},{"id":"2209.03392","title":"Investigating Reasons for Disagreement in Natural Language Inference","created":"2022-09-07","cited_by_count":29},{"id":"2004.14065","title":"Automatically Identifying Gender Issues in Machine Translation using Perturbations","created":"2020-04-29","cited_by_count":28},{"id":"2208.12852","title":"What Do NLP Researchers Believe? Results of the NLP Community Metasurvey","created":"2022-08-26","cited_by_count":28},{"id":"2212.10711","title":"Task Ambiguity in Humans and Language Models","created":"2022-12-20","cited_by_count":28},{"id":"2207.02598","title":"Predicting is not Understanding: Recognizing and Addressing Underspecification in Machine Learning","created":"2022-07-06","cited_by_count":26},{"id":"1909.11291","title":"Question Answering is a Format; When is it Useful?","created":"2019-09-25","cited_by_count":25},{"id":"2210.15615","title":"ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics","created":"2022-10-27","cited_by_count":25},{"id":"2005.05738","title":"Reassessing Claims of Human Parity and Super-Human Performance in Machine Translation at WMT 2019","created":"2020-05-12","cited_by_count":20},{"id":"2003.04642","title":"A Framework for Evaluation of Machine Reading Comprehension Gold Standards","created":"2020-03-10","cited_by_count":18},{"id":"2210.11560","title":"Finding Dataset Shortcuts with Grammar Induction","created":"2022-10-20","cited_by_count":15},{"id":"2212.10297","title":"Extrinsic Evaluation of Machine Translation Metrics","created":"2022-12-20","cited_by_count":14},{"id":"2012.07619","title":"What Makes a Good and Useful Summary? Incorporating Users in Automatic Summarization Research","created":"2020-12-14","cited_by_count":8},{"id":"2210.14966","title":"What's Different between Visual Question Answering for Machine \"Understanding\" Versus for Accessibility?","created":"2022-10-26","cited_by_count":6},{"id":"2106.10084","title":"Subjective Bias in Abstractive Summarization","created":"2021-06-18","cited_by_count":5},{"id":"2109.07140","title":"On the Universality of Deep Contextual Language Models","created":"2021-09-15","cited_by_count":4},{"id":"2111.02326","title":"End-to-End Annotator Bias Approximation on Crowdsourced Single-Label Sentiment Analysis","created":"2021-11-03","cited_by_count":4},{"id":"1804.06004","title":"Monte Carlo Syntax Marginals for Exploring and Using Dependency Parses","created":"2018-04-17","cited_by_count":2}],"next_cursor":null}