mlsanityData to 14 Oct 2026

MegaWika 2: A More Comprehensive Multilingual Collection of Articles and their Sources

arXiv 2508.03828 ↗First posted 5 Aug 2025cs.DL cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

We introduce MegaWika 2, a large, multilingual dataset of Wikipedia articles with their citations and scraped web sources; articles are represented in a rich data structure, and scraped source texts are stored inline with precise character offsets of their citations in the article text. MegaWika 2 is a major upgrade from the original MegaWika, spanning six times as many articles and twice as many fully scraped citations. Both MegaWika and MegaWika 2 support report generation research ; whereas MegaWika also focused on supporting question answering and retrieval applications, MegaWika 2 is designed to support fact checking and analyses across time and language.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 49 of its 76 references that are in the map. First posted on arXiv 5 Aug 2025.

Builds on

49 of 76 references.

References · 49

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  5. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  6. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  7. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
  8. 2016Pointer Sentinel Mixture Modelscited by 3,096
  9. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
  10. 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,202
  11. 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
  12. 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 687
37 more
  1. 2024OLMo: Accelerating the Science of Language Modelscited by 613
  2. 2019On the Cross-lingual Transferability of Monolingual Representationscited by 578
  3. 2020Beyond English-Centric Multilingual Machine Translationcited by 561
  4. 2023The Falcon Series of Open Language Modelscited by 535
  5. 2020TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languagescited by 488
  6. 2019TabFact: A Large-scale Dataset for Table-based Fact Verificationcited by 428
  7. 2024Multilingual E5 Text Embeddings: A Technical Reportcited by 372
  8. 2019MLQA: Evaluating Cross-lingual Extractive Question Answeringcited by 340
  9. 2018Generating Wikipedia by Summarizing Long Sequencescited by 335
  10. 2023Evaluating Verifiability in Generative Search Enginescited by 303
  11. 2020ToTTo: A Controlled Table-To-Text Generation Datasetcited by 268
  12. 2021PAQ: 65 Million Probably-Asked Questions and What You Can Do With Themcited by 200
  13. 2020MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question Answeringcited by 153
  14. 2020XOR QA: Cross-lingual Open-Retrieval Question Answeringcited by 121
  15. 2023WiCE: Real-World Entailment for Claims in Wikipediacited by 120
  16. 2021Mr. TyDi: A Multi-lingual Benchmark for Dense Retrievalcited by 119
  17. 2020Logical Natural Language Generation from Open-Domain Tablescited by 90
  18. 2021The Web Is Your Oyster - Knowledge-Intensive NLP against a Very Large Web Corpuscited by 60
  19. 2018Harvesting Paragraph-Level Question-Answer Pairs from Wikipediacited by 49
  20. 2022Making a MIRACL: Multilingual Information Retrieval Across a Continuum of Languagescited by 47
  21. 2023Open-WikiTable: Dataset for Open Domain Question Answering with Complex Reasoning over Tablecited by 40
  22. 2023TempTabQA: Temporal Question Answering for Semi-Structured Tablescited by 27
  23. 2016WikiReading: A Novel Large-scale Language Understanding Task over Wikipediacited by 26
  24. 2020WikiTableT: A Large-Scale Data-to-Text Dataset for Generating Wikipedia Article Sectionscited by 22
  25. 2019Generating Summaries with Topic Templates and Structured Convolutional Decoderscited by 20
  26. 2023Carpe Diem: On the Evaluation of World Knowledge in Lifelong Language Modelscited by 18
  27. 2018Why the World Reads Wikipedia: Beyond English Speakerscited by 15
  28. 2024AdapterSwap: Continuous Training of LLMs with Data Removal and Access-Control Guaranteescited by 14
  29. 2021WikiCheck: An end-to-end open source Automatic Fact-Checking API based on Wikipediacited by 12
  30. 2024GrowOVER: How Can LLMs Adapt to Growing Real-World Knowledge?cited by 11
  31. 2023MegaWika: Millions of reports and their sources across 50 diverse languagescited by 9
  32. 2024Simpson's Paradox and the Accuracy-Fluency Tradeoff in Translationcited by 8
  33. 2021A Multilingual Entity Linking System for Wikipedia with a Machine-in-the-Loop Approachcited by 5
  34. 2021WhatTheWikiFact: Fact-Checking Claims Against Wikipediacited by 3
  35. 2024Entity Insertion in Multilingual Linked Corpora: The Case of Wikipediacited by 3
  36. 2020Scalable Recommendation of Wikipedia Articles to Editors Using Representation Learningcited by 2
  37. 2023Leveraging Recommender Systems to Reduce Content Gaps on Peer Production Platformscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.

  1. 2025mmBERT: A Modern Multilingual Encoder with Annealed Language Learningcited by 45
  2. 2026OctoLong: Mid-Training On Cross-Repository Code Contexts Enhances Long-Context Modelingcited by 2
  3. 2026Knowledge Pull Requests for Continual Document Authoringcited by 0