ELQA: A Corpus of Metalinguistic Questions and Answers about English
Not on the map. Why?
Abstract (arXiv)
We present ELQA, a corpus of questions and answers in and about the English language. Collected from two online forums, the >70k questions (from English learners and others) cover wide-ranging topics including grammar, meaning, fluency, and etymology. The answers include descriptions of general properties of English vocabulary and grammar as well as explanations about specific (correct and incorrect) usage examples. Unlike most NLP datasets, this corpus is metalinguistic -- it consists of language about language. As such, it can facilitate investigations of the metalinguistic capabilities of NLU models, as well as educational applications in the language learning domain. To study this, we define a free-form question answering task on our dataset and conduct evaluations on multiple LLMs (Large Language Models) to analyze their capacity to generate metalinguistic answers.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 20 of its 50 references that are in the map. First posted on arXiv 1 May 2022.
Builds on
20 of 50 references.
References · 20
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2020How Much Knowledge Can You Pack Into the Parameters of a Language Model?cited by 719
- 2019ELI5: Long Form Question Answeringcited by 575
- 2020How Can We Know When Language Models Know? On the Calibration of Language Models for Question Answeringcited by 445
- 2020Evaluation of Text Generation: A Surveycited by 277
- 2022Scaling Up Models and Data with textttt5x and textttseqiocited by 187
- 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehensioncited by 91
- 2021Think you have Solved Direct-Answer Question Answering? Try ARC-DA, the Direct-Answer AI2 Reasoning Challengecited by 80
- 2021GooAQ: Open Question Answering with Diverse Answer Typescited by 53
- 2020DoQA -- Accessing Domain-Specific FAQs via Conversational QAcited by 42
8 more
- 2021Bidimensional Leaderboards: Generate and Evaluate Language Hand in Handcited by 32
- 2020ClarQ: A large-scale and diverse dataset for Clarification Question Generationcited by 31
- 2019Introducing MANtIS: a novel Multi-Domain Information Seeking Dialogues Datasetcited by 26
- 2018Neural Automated Essay Scoring and Coherence Modeling for Adversarially Crafted Inputcited by 16
- 2019SemEval-2017 Task 3: Community Question Answeringcited by 13
- 2018Learning to Automatically Generate Fill-In-The-Blank Quizzescited by 4
- 2013Want a Good Answer? Ask a Good Question First!cited by 3
- 2021Generating Answer Candidates for Quizzes and Answer-Aware Question Generatorscited by 3
Built on by
Citing papers per year: 2023: 2; 2024: 3; 2025: 1; 2026: 2.
8 papers.
- 2023Large Linguistic Models: Investigating LLMs' metalinguistic abilitiescited by 18
- 2024I am a Strange Dataset: Metalinguistic Tests for Language Modelscited by 10
- 2024Natural Language Processing RELIES on Linguisticscited by 9
- 2024Do language models practice what they preach? Examining language ideologies about gendered language reform encoded in LLMscited by 5
- 2025Prompting from the bench: Large-scale pretraining is not sufficient to prepare LLMs for ordinary meaning analysiscited by 4
- 2023CuRIAM: Corpus re Interpretation and Metalanguage in U.S. Supreme Court Opinionscited by 2
- 2026Speaking of Language: Reflections on Metalanguage Research in NLPcited by 1
- 2026Evaluating Metalinguistic Knowledge in Large Language Models across the World's Languagescited by 0
- 2026Speaking of Language: Reflections on Metalanguage Research in NLP3 Apr 2026
- 2026Evaluating Metalinguistic Knowledge in Large Language Models across the World's Languages2 Feb 2026
- 2025Prompting from the bench: Large-scale pretraining is not sufficient to prepare LLMs for ordinary meaning analysis29 Oct 2025
- 2024Do language models practice what they preach? Examining language ideologies about gendered language reform encoded in LLMs20 Sep 2024
- 2024Natural Language Processing RELIES on Linguistics9 May 2024
- 2024I am a Strange Dataset: Metalinguistic Tests for Language Models10 Jan 2024
- 2023CuRIAM: Corpus re Interpretation and Metalanguage in U.S. Supreme Court Opinions24 May 2023
- 2023Large Linguistic Models: Investigating LLMs' metalinguistic abilities1 May 2023