# WikiReading: A Novel Large-scale Language Understanding Task over Wikipedia

arXiv: https://arxiv.org/abs/1608.03542 · HTML: https://mlsanity.com/paper/1608.03542/

## Key facts

- Cited by 26 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 11 Aug 2016.

## Built on by (most cited first, 26 of 26)

- [Continual Learning of Large Language Models: A Comprehensive Survey](https://mlsanity.com/paper/2404.16789/) (2024)
- [Going Full-TILT Boogie on Document Understanding with Text-Image-Layout Transformer](https://mlsanity.com/paper/2102.09550/) (2021)
- [QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehension](https://mlsanity.com/paper/2107.12708/) (2021)
- [Kleister: Key Information Extraction Datasets Involving Long Documents with Complex Layouts](https://mlsanity.com/paper/2105.05796/) (2021)
- [Challenges in Generalization in Open Domain Question Answering](https://mlsanity.com/paper/2109.01156/) (2021)
- [VLKEB: A Large Vision-Language Model Knowledge Editing Benchmark](https://mlsanity.com/paper/2403.07350/) (2024)
- [English Machine Reading Comprehension Datasets: A Survey](https://mlsanity.com/paper/2101.10421/) (2021)
- [A Comprehensive Survey on Relation Extraction: Recent Advances and New Frontiers](https://mlsanity.com/paper/2306.02051/) (2023)
- [Deep Neural Approaches to Relation Triplets Extraction: A Comprehensive Survey](https://mlsanity.com/paper/2103.16929/) (2021)
- [KoRC: Knowledge oriented Reading Comprehension Benchmark for Deep Text Understanding](https://mlsanity.com/paper/2307.03115/) (2023)
- [Transformers and Language Models in Form Understanding: A Comprehensive Review of Scanned Document Analysis](https://mlsanity.com/paper/2403.04080/) (2024)
- [TWAG: A Topic-Guided Wikipedia Abstract Generator](https://mlsanity.com/paper/2106.15135/) (2021)
- [How Good is Your Wikipedia? Auditing Data Quality for Low-resource and Multilingual NLP](https://mlsanity.com/paper/2411.05527/) (2024)
- [MegaWika 2: A More Comprehensive Multilingual Collection of Articles and their Sources](https://mlsanity.com/paper/2508.03828/) (2025)
- [Towards Solving Multimodal Comprehension](https://mlsanity.com/paper/2104.10139/) (2021)
- [A Coarse to Fine Question Answering System based on Reinforcement Learning](https://mlsanity.com/paper/2106.00257/) (2021)
- [Machine Reading Comprehension using Case-based Reasoning](https://mlsanity.com/paper/2305.14815/) (2023)
- [Enabling and Analyzing How to Efficiently Extract Information from Hybrid Long Documents with LLMs](https://mlsanity.com/paper/2305.16344/) (2023)
- [Training on Synthetic Data Beats Real Data in Multimodal Relation Extraction](https://mlsanity.com/paper/2312.03025/) (2023)
- [DebiasRAG: A Tuning-Free Path to Fair Generation in Large Language Models through Retrieval-Augmented Generation](https://mlsanity.com/paper/2605.16113/) (2026)
- [Automatic Task Requirements Writing Evaluation via Machine Reading Comprehension](https://mlsanity.com/paper/2107.07957/) (2021)
- [Multi Document Reading Comprehension](https://mlsanity.com/paper/2201.01706/) (2022)
- [Exploring and Exploiting Multi-Granularity Representations for Machine Reading Comprehension](https://mlsanity.com/paper/2208.08750/) (2022)
- [EMERGE: A Benchmark for Updating Knowledge Graphs with Emerging Textual Knowledge](https://mlsanity.com/paper/2507.03617/) (2025)
- [Wikipedia-based Datasets in Russian Information Retrieval Benchmark RusBEIR](https://mlsanity.com/paper/2511.05079/) (2025)
- [Beyond Facts: Benchmarking Distributional Reading Comprehension in Large Language Models](https://mlsanity.com/paper/2604.06201/) (2026)

## Abstract (arXiv)

We present WikiReading, a large-scale natural language understanding task and publicly-available dataset with 18 million instances. The task is to predict textual values from the structured knowledge base Wikidata by reading the text of the corresponding Wikipedia articles. The task contains a rich variety of challenging classification and extraction sub-tasks, making it well-suited for end-to-end models such as deep neural networks (DNNs). We compare various state-of-the-art DNN-based architectures for document classification, information extraction, and question answering. We find that models supporting a rich answer space, such as word or character sequences, perform best. Our best-performing model, a word-level sequence to sequence model with a mechanism to copy out-of-vocabulary words, obtains an accuracy of 71.8%.