Forecasting Future International Events: A Reliable Dataset for Text-Based Event Modeling
Not on the map. Why?
Abstract (arXiv)
Predicting future international events from textual information, such as news articles, has tremendous potential for applications in global policy, strategic decision-making, and geopolitics. However, existing datasets available for this task are often limited in quality, hindering the progress of related research. In this paper, we introduce WORLDREP (WORLD Relationship and Event Prediction), a novel dataset designed to address these limitations by leveraging the advanced reasoning capabilities of large-language models (LLMs). Our dataset features high-quality scoring labels generated through advanced prompt modeling and rigorously validated by domain experts in political science. We showcase the quality and utility of WORLDREP for real-world event prediction tasks, demonstrating its effectiveness through extensive experiments and analysis. Furthermore, we publicly release our dataset along with the full automation source code for data collection, labeling, and benchmarking, aiming to support and advance research in text-based event prediction.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 27 of its 43 references that are in the map. First posted on arXiv 21 Nov 2024.
Builds on
27 of 43 references.
References · 27
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
- 2021Show Your Work: Scratchpads for Intermediate Computation with Language Modelscited by 871
- 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 525
- 2022Unnatural Instructions: Tuning Language Models with (Almost) No Human Laborcited by 395
15 more
- 2022News Summarization and Evaluation in the Era of GPT-3cited by 324
- 2021Time-Aware Language Models as Temporal Knowledge Basescited by 290
- 2024TimeXer: Empowering Transformers for Time Series Forecasting with Exogenous Variablescited by 241
- 2022WANLI: Worker and AI Collaboration for Natural Language Inference Dataset Creationcited by 200
- 2021Want To Reduce Labeling Cost? GPT-3 Can Helpcited by 196
- 2021GPT3Mix: Leveraging Large-scale Language Models for Text Augmentationcited by 185
- 2024Approaching Human-Level Forecasting with Language Modelscited by 102
- 2020Neural Spatio-Temporal Point Processescited by 92
- 2023LLMs Accelerate Annotation for Medical Information Extractioncited by 77
- 2022Forecasting Future World Events with Neural Networkscited by 63
- 2023Language Models Can Improve Event Prediction by Few-Shot Abductive Reasoningcited by 44
- 2023Making Large Language Models Better Data Creatorscited by 28
- 2023AutoCast++: Enhancing World Event Prediction with Zero-shot Ranking-based Context Retrievalcited by 18
- 2024Self-Supervised Contrastive Learning for Long-term Forecastingcited by 8
- 2023Deep Imbalanced Time-series Forecasting via Local Discrepancy Densitycited by 7
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024MIRAI: Evaluating LLM Agents for Event Forecasting
- 2026ThinkTank-ME: A Multi-Expert Framework for Middle East Event Forecasting
- 2024A Comprehensive Evaluation of Large Language Models on Temporal Event Forecasting
- 2024MM-Forecast: A Multimodal Approach to Temporal Event Forecasting with Large Language Models
- 2026ForecastAgentSearch: Towards a Multi-Expert Agent Search System for Geopolitical Event Forecasting
- 2025Advancing Event Forecasting through Massive Training of Large Language Models: Challenges, Solutions, and Broader Impacts
- 2026WorldReasoner: Evaluating Whether Language Model Agents Forecast Events with Valid Reasoning
- 2024From News to Forecast: Integrating Event Analysis in LLM-Based Time Series Forecasting with Reflection