mlsanityData to 14 Oct 2026

Free Access to World News: Reconstructing Full-Text Articles from GDELT

arXiv 2504.16063 ↗First posted 22 Apr 2025cs.CL cs.DB cs.IRcited by 0

Not on the map. Why?

Abstract (arXiv)

News data have become essential resources across various disciplines. Still, access to full-text news corpora remains challenging due to high costs and the limited availability of free alternatives. This paper presents a novel Python package (gdeltnews) that reconstructs full-text newspaper articles at near-zero cost by leveraging the Global Database of Events, Language, and Tone (GDELT) Web News NGrams 3.0 dataset. Our method merges overlapping n-grams extracted from global online news to rebuild complete articles. We validate the approach on a benchmark set of 2211 articles from major U.S. news outlets, achieving up to 95% text similarity against original articles based on Levenshtein and SequenceMatcher metrics. Our tool facilitates economic forecasting, computational social science, information science, and natural language processing applications by enabling free and large-scale access to full-text news data.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 57 references that are in the map. First posted on arXiv 22 Apr 2025.

Builds on

6 of 57 references.

References · 6

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023Benchmarking Large Language Models for News Summarizationcited by 445
  3. 2021Forecasting election results by studying brand importance in online newscited by 7
  4. 2020Forecasting financial markets with semantic network analysis in the COVID-19 crisiscited by 5
  5. 2024Large language models for newspaper sentiment analysis during COVID-19: The Guardiancited by 4
  6. 2014Understanding News Geography and Major Determinants of Global News Coverage of Disasterscited by 3

Built on by

Not cited yet.