mlsanityData to 14 Oct 2026

MegaWika: Millions of reports and their sources across 50 diverse languages

arXiv 2307.07049 ↗First posted 13 Jul 2023cs.CLcited by 9

Not on the map. Why?

Abstract (arXiv)

To foster the development of new models for collaborative AI-assisted report generation, we introduce MegaWika, consisting of 13 million Wikipedia articles in 50 diverse languages, along with their 71 million referenced source materials. We process this dataset for a myriad of applications, going beyond the initial Wikipedia citation extraction and web scraping of content, including translating non-English articles for cross-lingual applications and providing FrameNet parses for automated semantic analysis. MegaWika is the largest resource for sentence-level report generation and the only report generation dataset that is multilingual. We manually analyze the quality of this resource through a semantically stratified sample. Finally, we provide baseline results and trained models for crucial steps in automated report generation: cross-lingual question answering and citation retrieval.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 26 of its 32 references that are in the map. First posted on arXiv 13 Jul 2023.

Builds on

26 of 32 references.

References · 26

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  3. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  4. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  5. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  6. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  7. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
  8. 2019On the Cross-lingual Transferability of Monolingual Representationscited by 578
  9. 2020Beyond English-Centric Multilingual Machine Translationcited by 561
  10. 2020TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languagescited by 488
  11. 2019MLQA: Evaluating Cross-lingual Extractive Question Answeringcited by 340
  12. 2021PAQ: 65 Million Probably-Asked Questions and What You Can Do With Themcited by 200
14 more
  1. 2021Exploring and Distilling Posterior and Prior Knowledge for Radiology Report Generationcited by 162
  2. 2020MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question Answeringcited by 153
  3. 2020XOR QA: Cross-lingual Open-Retrieval Question Answeringcited by 121
  4. 2023WiCE: Real-World Entailment for Claims in Wikipediacited by 120
  5. 2019Knowledge-driven Encode, Retrieve, Paraphrase for Medical Image Report Generationcited by 102
  6. 2021Auto-Encoding Knowledge Graph for Unsupervised Medical Report Generationcited by 47
  7. 2022Making a MIRACL: Multilingual Information Retrieval Across a Continuum of Languagescited by 47
  8. 2019Uncertain Natural Language Inferencecited by 35
  9. 2023WebBrain: Learning to Generate Factually Correct Articles for Queries by Grounding on Large Web Corpuscited by 29
  10. 2021LOME: Large Ontology Multilingual Extractioncited by 23
  11. 2020WikiTableT: A Large-Scale Data-to-Text Dataset for Generating Wikipedia Article Sectionscited by 22
  12. 2021Writing by Memorizing: Hierarchical Retrieval-based Medical Report Generationcited by 19
  13. 2021Everything Is All It Takes: A Multipronged Strategy for Zero-Shot Cross-Lingual Information Extractioncited by 16
  14. 2022Improving Wikipedia Verifiability with AIcited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 6; 2026: 1.

9 papers.

  1. 2025mmBERT: A Modern Multilingual Encoder with Annealed Language Learningcited by 45
  2. 2024On the Evaluation of Machine-Generated Reportscited by 23
  3. 2024AboutMe: Using Self-Descriptions in Webpages to Document the Effects of English Pretraining Data Filterscited by 22
  4. 2025WikiVideo: Article Generation from Multiple Videoscited by 13
  5. 2025MegaWika 2: A More Comprehensive Multilingual Collection of Articles and their Sourcescited by 3
  6. 2025MixtureVitae: Open Web-Scale Pretraining Dataset With High Quality Instruction and Reasoning Data Built from Permissive-First Text Sourcescited by 3
  7. 2025Pragyaan: Designing and Curating High-Quality Cultural Post-Training Datasets for Indian Languagescited by 3
  8. 2025Seeing Through the MiRAGE: Evaluating Multimodal Retrieval Augmented Generationcited by 1
  9. 2026Knowledge Pull Requests for Continual Document Authoringcited by 0