ReCoRD: Bridging the Gap between Human and Machine Commonsense Reading Comprehension
Not on the map. Why?
Abstract (arXiv)
We present a large-scale dataset, ReCoRD, for machine reading comprehension requiring commonsense reasoning. Experiments on this dataset demonstrate that the performance of state-of-the-art MRC systems fall far behind human performance. ReCoRD represents a challenge for future research to bridge the gap between human and machine commonsense reading comprehension. ReCoRD is available at http://nlp.jhu.edu/record.
Key facts. Cited by 200 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 Oct 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 43; 2022: 39; 2023: 40; 2024: 42; 2025: 22; 2026: 14.
200 papers.
Sort:
By area:
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
- 2023BloombergGPT: A Large Language Model for Financecited by 939
- 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 897
- 2023RWKV: Reinventing RNNs for the Transformer Eracited by 827
- 2023The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Onlycited by 763
- 2021GPT Understands, Toocited by 716
- 2023A Comprehensive Overview of Large Language Modelscited by 648
- 2023The Falcon Series of Open Language Modelscited by 535
- 2022ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformerscited by 526
- 2021Compacter: Efficient Low-Rank Hypercomplex Adapter Layerscited by 460
38 more
- 2021MetaICL: Learning to Learn In Contextcited by 454
- 2023Symbolic Discovery of Optimization Algorithmscited by 434
- 2022ST-MoE: Designing Stable and Transferable Sparse Expert Modelscited by 399
- 2023Fine-Tuning Language Models with Just Forward Passescited by 345
- 2021True Few-Shot Learning with Language Modelscited by 344
- 2023ARES: An Automated Evaluation Framework for Retrieval-Augmented Generation Systemscited by 265
- 2021ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generationcited by 260
- 2021SPoT: Better Frozen Model Adaptation through Soft Prompt Transfercited by 235
- 2021How Many Data Points is a Prompt Worth?cited by 198
- 2021Unlearnable Examples: Making Personal Data Unexploitablecited by 193
- 2021Muppet: Massive Multi-task Representations with Pre-Finetuningcited by 192
- 2022Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Modelscited by 180
- 2024Lessons from the Trenches on Reproducible Evaluation of Language Modelscited by 179
- 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answeringcited by 178
- 2021Efficient Large Scale Language Modeling with Mixtures of Expertscited by 175
- 2021ExT5: Towards Extreme Multi-Task Scaling for Transfer Learningcited by 161
- 2022Ask Me Anything: A simple strategy for prompting language modelscited by 155
- 2024Evaluation of Retrieval-Augmented Generation: A Surveycited by 146
- 2021CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLPcited by 142
- 2023LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructionscited by 124
- 2023A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark Datasetscited by 123
- 2023Multitask Prompt Tuning Enables Parameter-Efficient Transfer Learningcited by 115
- 2021KLUE: Korean Language Understanding Evaluationcited by 114
- 2022Task-aware Retrieval with Instructionscited by 107
- 2021UNICORN on RAINBOW: A Universal Commonsense Reasoning Model on a New Multitask Benchmarkcited by 98
- 2021Improving and Simplifying Pattern Exploiting Trainingcited by 97
- 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehensioncited by 91
- 2022ATTEMPT: Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Promptscited by 85
- 2021Few-Shot Self-Rationalization with Natural Language Promptscited by 83
- 2023LoRAMoE: Alleviate World Knowledge Forgetting in Large Language Models via MoE-Style Plugincited by 82
- 2021Probing Across Time: What Does RoBERTa Know and When?cited by 73
- 2024Instructional Fingerprinting of Large Language Modelscited by 68
- 2023Lifelong Language Pretraining with Distribution-Specialized Expertscited by 66
- 2023Residual Prompt Tuning: Improving Prompt Tuning with Residual Reparameterizationcited by 64
- 2021What to Pre-Train on? Efficient Intermediate Task Selectioncited by 63
- 2023NormBank: A Knowledge Bank of Situational Social Normscited by 60
- 2022UnifiedQA-v2: Stronger Generalization via Broader Cross-Format Trainingcited by 57
- 2022Improving In-Context Few-Shot Learning via Self-Supervised Trainingcited by 57
50 most cited of 200 All 200 (JSON)
- 2026StructZO: Structured Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning12 Oct 2026
- 2026Distributionally Robust Mixture-of-Experts Training5 Oct 2026
- 2026Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior30 Sep 2026
- 2026EAT: Expert Account Tracker for Efficient MoE Inference27 Sep 2026
- 2026POSPAN: Position-Constrained Span Masking for Language Model Pre-training13 Sep 2026
- 2026Information Abundance Paradox: Long-Context Training Undermines Parametric Knowledge12 Aug 2026
- 2026MultiHashFormer: Hash-based Generative Language Models26 Jun 2026
- 2026Universally Empowering Zeroth-Order Optimization via Adaptive Layer-wise Sampling20 Apr 2026
- 2026SeedFlood: A Step Toward Scalable Decentralized Fine-Tuning of LLMs20 Feb 2026
- 2026Perturbation-Induced Linearization: Constructing Unlearnable Data with Solely Linear Classifiers27 Jan 2026
- 2026Variance-Adaptive Muon: Pre-Orthogonalization Variance Modulation for Efficient Language Model Pretraining21 Jan 2026
- 2026Beyond Human Annotation: Recent Advances in Data Generation Methods for Document Intelligence18 Jan 2026
38 more
- 2026Steering the Noise: Turning Random Perturbations into Effective Descent for Memory-Efficient LLM Fine-Tuning8 Jan 2026
- 2026Enhancing Linguistic Competence of Language Models through Pre-training with Language Learning Tasks6 Jan 2026
- 2025PEFT-Factory: Unified Parameter-Efficient Fine-Tuning of Autoregressive Large Language Models2 Dec 2025
- 2025PEFT-Bench: A Parameter-Efficient Fine-Tuning Methods Benchmark26 Nov 2025
- 2025MoodBench 1.0: An Evaluation Benchmark for Emotional Companionship Dialogue Systems24 Nov 2025
- 2025ConMeZO: Adaptive Descent-Direction Sampling for Gradient-Free Finetuning of Large Language Models4 Nov 2025
- 2025Charting the European LLM Benchmarking Landscape: A New Taxonomy and a Set of Best Practices28 Oct 2025
- 2025First Attentions Last: Better Exploiting First Attentions for Efficient Transformer Training16 Oct 2025
- 2025Towards Fundamental Language Models: Does Linguistic Competence Scale with Model Size?2 Sep 2025
- 2025Maximum Score Routing For Mixture-of-Experts18 Aug 2025
- 2025AQuilt: Weaving Logic and Self-Inspection into Low-Cost, High-Relevance Data Synthesis for Specialist LLMs24 Jul 2025
- 2025DIVE into MoE: Diversity-Enhanced Reconstruction of Large Language Models from Dense into Mixture-of-Experts11 Jun 2025
- 2025MODP: Multi Objective Directional Prompting25 Apr 2025
- 2025Retrieval Augmented Generation Evaluation in the Era of Large Language Models: A Comprehensive Survey21 Apr 2025
- 2025D-GEN: Automatic Distractor Generation and Evaluation for Reliable Assessment of Generative Model18 Apr 2025
- 2025ExpertRAG: Efficient RAG with Mixture of Experts -- Optimizing Context Retrieval for Adaptive LLM Responses23 Mar 2025
- 2025Dynamic Task Vector Grouping for Efficient Multi-Task Prompt Tuning23 Mar 2025
- 2025The Box is in the Pen: Evaluating Commonsense Reasoning in Neural Machine Translation5 Mar 2025
- 2025Self-Adjust Softmax25 Feb 2025
- 2025Efficient and Effective Prompt Tuning via Prompt Decomposition and Compressed Outer Product16 Feb 2025
- 2025Bilevel ZOFO: Efficient LLM Fine-Tuning and Meta-Training5 Feb 2025
- 2025Analyzing Similarity Metrics for Data Selection for Language Model Pretraining4 Feb 2025
- 2025Elucidating Subspace Perturbation in Zeroth-Order Optimization: Theory and Practice at Scale31 Jan 2025
- 2025ADePT: Adaptive Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning6 Jan 2025
- 2024Building a Rich Dataset to Empower the Persian Question Answering Systems28 Dec 2024
- 2024Teaching Smaller Language Models To Generalise To Unseen Compositional Questions (Full Thesis)25 Nov 2024
- 2024LASER: Attention with Exponential Transformation5 Nov 2024
- 2024On the Crucial Role of Initialization for Matrix Factorization24 Oct 2024
- 2024A Little Help Goes a Long Way: Efficient LLM Training by Leveraging Small LMs24 Oct 2024
- 2024Implicit Regularization of Sharpness-Aware Minimization for Scale-Invariant Problems18 Oct 2024
- 2024ActionCOMET: A Zero-shot Approach to Learn Image-specific Commonsense Concepts about Actions17 Oct 2024
- 2024Zeroth-Order Fine-Tuning of LLMs in Random Subspaces11 Oct 2024
- 2024ACCEPT: Adaptive Codebook for Composite and Efficient Prompt Tuning10 Oct 2024
- 2024Enhancing Zeroth-order Fine-tuning for Language Models with Low-rank Structures10 Oct 2024
- 2024Initialization of Large Language Models via Reparameterization to Mitigate Loss Spikes7 Oct 2024
- 2024LoRTA: Low Rank Tensor Adaptation of Large Language Models5 Oct 2024
- 2024Scalable Frame-based Construction of Sociocultural NormBases for Socially-Aware Dialogues4 Oct 2024
- 2024Hyper-Compression: Model Compression via Hyperfunction1 Sep 2024
50 newest of 200 All 200 (JSON)
- 2022ST-MoE: Designing Stable and Transferable Sparse Expert Modelscited by 399
- 2021Efficient Large Scale Language Modeling with Mixtures of Expertscited by 175
- 2023LoRAMoE: Alleviate World Knowledge Forgetting in Large Language Models via MoE-Style Plugincited by 82
- 2023Lifelong Language Pretraining with Distribution-Specialized Expertscited by 66
- 2024HyperMoE: Towards Better Mixture of Experts via Transferring Among Expertscited by 26
- 2022Knowledge-in-Context: Towards Knowledgeable Semi-Parametric Language Modelscited by 24
- 2022Eliciting and Understanding Cross-Task Skills with Task-Level Mixture-of-Expertscited by 12
- 2022Efficient Language Modeling with Sparse all-MLPcited by 8
- 2024PEMT: Multi-Task Correlation Guided Mixture-of-Experts Enables Parameter-Efficient Transfer Learningcited by 7
- 2025DIVE into MoE: Diversity-Enhanced Reconstruction of Large Language Models from Dense into Mixture-of-Expertscited by 7
- 2025Maximum Score Routing For Mixture-of-Expertscited by 3
- 2026EAT: Expert Account Tracker for Efficient MoE Inferencecited by 0
12 most cited of 13 All 13 (JSON)
- 2026Distributionally Robust Mixture-of-Experts Training5 Oct 2026
- 2026EAT: Expert Account Tracker for Efficient MoE Inference27 Sep 2026
- 2025Maximum Score Routing For Mixture-of-Experts18 Aug 2025
- 2025DIVE into MoE: Diversity-Enhanced Reconstruction of Large Language Models from Dense into Mixture-of-Experts11 Jun 2025
- 2024PEMT: Multi-Task Correlation Guided Mixture-of-Experts Enables Parameter-Efficient Transfer Learning23 Feb 2024
- 2024HyperMoE: Towards Better Mixture of Experts via Transferring Among Experts20 Feb 2024
- 2023LoRAMoE: Alleviate World Knowledge Forgetting in Large Language Models via MoE-Style Plugin15 Dec 2023
- 2023Lifelong Language Pretraining with Distribution-Specialized Experts20 May 2023
- 2022Knowledge-in-Context: Towards Knowledgeable Semi-Parametric Language Models28 Oct 2022
- 2022Eliciting and Understanding Cross-Task Skills with Task-Level Mixture-of-Experts25 May 2022
- 2022Efficient Language Modeling with Sparse all-MLP14 Mar 2022
- 2022ST-MoE: Designing Stable and Transferable Sparse Expert Models17 Feb 2022
12 newest of 13 All 13 (JSON)
- 2023Benchmarks for Automated Commonsense Reasoning: A Surveycited by 40
- 2024mCSQA: Multilingual Commonsense Reasoning Dataset with Unified Creation Strategy by Language Models and Humanscited by 10
- 2023CRoW: Benchmarking Commonsense Reasoning in Real-World Taskscited by 8
- 2025The Box is in the Pen: Evaluating Commonsense Reasoning in Neural Machine Translationcited by 5
- 2022Down and Across: Introducing Crossword-Solving as a New NLP Benchmarkcited by 4
- 2023Few-shot Unified Question Answering: Tuning Models or Prompts?cited by 2
- 2025The Box is in the Pen: Evaluating Commonsense Reasoning in Neural Machine Translation5 Mar 2025
- 2024mCSQA: Multilingual Commonsense Reasoning Dataset with Unified Creation Strategy by Language Models and Humans6 Jun 2024
- 2023CRoW: Benchmarking Commonsense Reasoning in Real-World Tasks23 Oct 2023
- 2023Few-shot Unified Question Answering: Tuning Models or Prompts?23 May 2023
- 2023Benchmarks for Automated Commonsense Reasoning: A Survey9 Feb 2023
- 2022Down and Across: Introducing Crossword-Solving as a New NLP Benchmark20 May 2022
- 2023ARES: An Automated Evaluation Framework for Retrieval-Augmented Generation Systemscited by 265
- 2024Evaluation of Retrieval-Augmented Generation: A Surveycited by 146
- 2025Retrieval Augmented Generation Evaluation in the Era of Large Language Models: A Comprehensive Surveycited by 20
- 2025ExpertRAG: Efficient RAG with Mixture of Experts -- Optimizing Context Retrieval for Adaptive LLM Responsescited by 2
- 2025Retrieval Augmented Generation Evaluation in the Era of Large Language Models: A Comprehensive Survey21 Apr 2025
- 2025ExpertRAG: Efficient RAG with Mixture of Experts -- Optimizing Context Retrieval for Adaptive LLM Responses23 Mar 2025
- 2024Evaluation of Retrieval-Augmented Generation: A Survey13 May 2024
- 2023ARES: An Automated Evaluation Framework for Retrieval-Augmented Generation Systems16 Nov 2023
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
- 2023BloombergGPT: A Large Language Model for Financecited by 939
- 2023RWKV: Reinventing RNNs for the Transformer Eracited by 827
- 2023The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Onlycited by 763
- 2021GPT Understands, Toocited by 716
- 2023A Comprehensive Overview of Large Language Modelscited by 648
- 2023The Falcon Series of Open Language Modelscited by 535
- 2022ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformerscited by 526
- 2021Compacter: Efficient Low-Rank Hypercomplex Adapter Layerscited by 460
- 2021MetaICL: Learning to Learn In Contextcited by 454
12 most cited of 173 All 173 (JSON)
- 2026StructZO: Structured Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning12 Oct 2026
- 2026Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior30 Sep 2026
- 2026POSPAN: Position-Constrained Span Masking for Language Model Pre-training13 Sep 2026
- 2026Information Abundance Paradox: Long-Context Training Undermines Parametric Knowledge12 Aug 2026
- 2026MultiHashFormer: Hash-based Generative Language Models26 Jun 2026
- 2026Universally Empowering Zeroth-Order Optimization via Adaptive Layer-wise Sampling20 Apr 2026
- 2026SeedFlood: A Step Toward Scalable Decentralized Fine-Tuning of LLMs20 Feb 2026
- 2026Perturbation-Induced Linearization: Constructing Unlearnable Data with Solely Linear Classifiers27 Jan 2026
- 2026Variance-Adaptive Muon: Pre-Orthogonalization Variance Modulation for Efficient Language Model Pretraining21 Jan 2026
- 2026Beyond Human Annotation: Recent Advances in Data Generation Methods for Document Intelligence18 Jan 2026
- 2026Steering the Noise: Turning Random Perturbations into Effective Descent for Memory-Efficient LLM Fine-Tuning8 Jan 2026
- 2026Enhancing Linguistic Competence of Language Models through Pre-training with Language Learning Tasks6 Jan 2026
12 newest of 173 All 173 (JSON)