mlsanityData to 7 Oct 2026

Teaching Machines to Read and Comprehend

arXiv 1506.03340 ↗First posted 10 Jun 2015cs.CL cs.AI cs.NEcited by 1,039

Not on the map. Why?

Cited by 48 in Efficient LLM inference and serving, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Teaching machines to read natural language documents remains an elusive challenge. Machine reading systems can be tested on their ability to answer questions posed on the contents of documents that they have seen, but until now large scale training and test datasets have been missing for this type of evaluation. In this work we define a new methodology that resolves this bottleneck and provides large scale supervised reading comprehension data. This allows us to develop a class of attention based deep neural networks that learn to read real documents and answer complex questions with minimal prior knowledge of language structure.

Key facts. Cited by 1,039 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Jun 2015.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2019: 1; 2020: 2; 2021: 241; 2022: 202; 2023: 192; 2024: 187; 2025: 124; 2026: 90.

1,039 papers.

Sort:

By area:

  1. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
  2. 2020Learning to summarize from human feedbackcited by 2,562
  3. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
  4. 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
  5. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
  6. 2021BARTScore: Evaluating Generated Text as Text Generationcited by 719
  7. 2023C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Modelscited by 694
  8. 2023LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusioncited by 550
  9. 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 525
  10. 2021Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpuscited by 481
  11. 2023Benchmarking Large Language Models for News Summarizationcited by 444
  12. 2023CMMLU: Measuring massive multitask language understanding in Chinesecited by 436
38 more
  1. 2023Is ChatGPT a Good NLG Evaluator? A Preliminary Studycited by 420
  2. 2021A Survey of Data Augmentation Approaches for NLPcited by 408
  3. 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 402
  4. 2022ST-MoE: Designing Stable and Transferable Sparse Expert Modelscited by 391
  5. 2021A Survey on Automated Fact-Checkingcited by 376
  6. 2021QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarizationcited by 363
  7. 2023GPTScore: Evaluate as You Desirecited by 357
  8. 2021XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languagescited by 346
  9. 2023NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmarkcited by 339
  10. 2023AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuningcited by 337
  11. 2022News Summarization and Evaluation in the Era of GPT-3cited by 324
  12. 2023Statistical Rejection Sampling Improves Preference Optimizationcited by 321
  13. 2022Confident Adaptive Language Modelingcited by 297
  14. 2022UL2: Unifying Language Learning Paradigmscited by 292
  15. 2021Understanding Factuality in Abstractive Summarization with FRANK: A Benchmark for Factuality Metricscited by 285
  16. 2024Knowledge Conflicts for LLMs: A Surveycited by 274
  17. 2022Towards a Unified Multi-Dimensional Evaluator for Text Generationcited by 264
  18. 2023Provable Robust Watermarking for AI-Generated Textcited by 259
  19. 2024Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Textcited by 255
  20. 2023RECOMP: Improving Retrieval-Augmented LMs with Compression and Selective Augmentationcited by 253
  21. 2022Is Reinforcement Learning (Not) for Natural Language Processing: Benchmarks, Baselines, and Building Blocks for Natural Language Policy Optimizationcited by 244
  22. 2021The GEM Benchmark: Natural Language Generation, its Evaluation and Metricscited by 239
  23. 2022RealTime QA: What's the Answer Right Now?cited by 239
  24. 2024LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Taskscited by 236
  25. 2021SPoT: Better Frozen Model Adaptation through Soft Prompt Transfercited by 235
  26. 2021QAFactEval: Improved QA-Based Factual Consistency Evaluation for Summarizationcited by 233
  27. 2021R-Drop: Regularized Dropout for Neural Networkscited by 202
  28. 2024When Scaling Meets LLM Finetuning: The Effect of Data, Model and Finetuning Methodcited by 201
  29. 2023LoftQ: LoRA-Fine-Tuning-Aware Quantization for Large Language Modelscited by 195
  30. 2023RA-DIT: Retrieval-Augmented Dual Instruction Tuningcited by 194
  31. 2022Out-of-Distribution Detection and Selective Generation for Conditional Language Modelscited by 193
  32. 2021Muppet: Massive Multi-task Representations with Pre-Finetuningcited by 192
  33. 2023Power Hungry Processing: Watts Driving the Cost of AI Deployment?cited by 186
  34. 2021DialogSum: A Real-Life Scenario Dialogue Summarization Datasetcited by 181
  35. 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answeringcited by 178
  36. 2021Block Pruning For Faster Transformerscited by 176
  37. 2024Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuningcited by 174
  38. 2022SCROLLS: Standardized CompaRison Over Long Language Sequencescited by 170

50 most cited of 1,039 All 1,039 (JSON)