Beyond the Norm: A Survey of Synthetic Data Generation for Rare Events
On the map: Synthetic data and self-improvement for LLMs → Model collapse from synthetic data
Abstract (arXiv)
Extreme events, such as market crashes, natural disasters, and pandemics, are rare but catastrophic, often triggering cascading failures across interconnected systems. Accurate prediction and early warning can help minimize losses and improve preparedness. While data-driven methods offer powerful capabilities for extreme event modeling, they require abundant training data, yet extreme event data is inherently scarce, creating a fundamental challenge. Synthetic data generation has emerged as a powerful solution. However, existing surveys focus on general data with privacy preservation emphasis, rather than extreme events' unique performance requirements. This survey provides the first overview of synthetic data generation for extreme events. We systematically review generative modeling techniques and large language models, particularly those enhanced by statistical theory as well as specialized training and sampling mechanisms to capture heavy-tailed distributions. We summarize benchmark datasets and introduce a tailored evaluation framework covering statistical, dependence, visual, and task-oriented metrics. A central contribution is our in-depth analysis of each metric's applicability in extremeness and domain-specific adaptations, providing actionable guidance for model evaluation in extreme settings. We categorize key application domains and identify underexplored areas like behavioral finance, wildfires, earthquakes, windstorms, and infectious outbreaks. Finally, we outline open challenges, providing a structured foundation for advancing synthetic rare-event research.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Model collapse from synthetic data, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 17 of its 72 references that are in the map. First posted on arXiv 4 Jun 2025.
Builds on
17 of 72 references.
References · 17
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2014Conditional Generative Adversarial Netscited by 2,162
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
- 2015Autoencoding beyond pixels using a learned similarity metriccited by 407
- 2016Ladder Variational Autoencoderscited by 318
- 2017VAE with a VampPriorcited by 248
- 2020ExGAN: Adversarial Generation of Extreme Samplescited by 29
- 2021Pareto GAN: Extending the Representational Power of GANs to Heavy-Tailed Distributionscited by 23
- 2024DiffESM: Conditional Emulation of Temperature and Precipitation in Earth System Models with 3D Diffusion Modelscited by 15
- 2020DeepClimGAN: A High-Resolution Climate Data Generatorcited by 9
- 2021Generative modeling of spatio-temporal weather patterns with extreme event conditioningcited by 6
5 more
- 2024Leveraging Generative Adversarial Networks for Addressing Data Imbalance in Financial Market Supervisioncited by 6
- 2023Stock Broad-Index Trend Patterns Learning via Domain Knowledge Informed Generative Networkcited by 3
- 2023Combining deep generative models with extreme value theory for synthetic hazard simulation: a multivariate and spatially coherent approachcited by 2
- 2024HI-GAN: Hierarchical Inpainting GAN with Auxiliary Inputs for Combined RGB and Depth Inpaintingcited by 2
- 2024Risk Management with Feature-Enriched Generative Adversarial Networks (FE-GAN)cited by 1
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026The Homogenization Problem in LLMs: Towards Meaningful Diversity in AI Safetycited by 2
- 2026E4GEN: Event-level Explainable Extreme-Enhanced Time-series Generationcited by 2
- 2026TailBooster: A Dual-Layer Generative Framework for Extreme Value Augmentation with Operational Validity Enforcementcited by 0
- 2026Score-based Outlier Generation via Controlling the Radon-Nikodym Derivativecited by 0
- 2026Cross-View Time-Frequency Diffusion for Extreme-Aware Time-Series Generationcited by 0
- 2026Cross-View Time-Frequency Diffusion for Extreme-Aware Time-Series Generation12 Oct 2026
- 2026Score-based Outlier Generation via Controlling the Radon-Nikodym Derivative10 Sep 2026
- 2026TailBooster: A Dual-Layer Generative Framework for Extreme Value Augmentation with Operational Validity Enforcement12 Aug 2026
- 2026E4GEN: Event-level Explainable Extreme-Enhanced Time-series Generation1 Jun 2026
- 2026The Homogenization Problem in LLMs: Towards Meaningful Diversity in AI Safety3 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025xTime: Extreme Event Prediction with Hierarchical Knowledge Distillation and Expert Fusion
- 2026Evaluating the Generalizability of Foundation Models for Extreme Environmental Events: Case Study of California Wildfire PM2.5
- 2026Physics-Informed Diffusion Model for Generating Synthetic Extreme Rare Weather Events Data
- 2025Empowering Time Series Analysis with Synthetic Data: A Survey and Outlook in the Era of Foundation Models
- 2026Realism VS Accuracy: Event Sequence Forecasting from a Generative Modeling Perspective
- 2025A RAG-Based Multi-Agent LLM System for Natural Hazard Resilience and Adaptation
- 2026Interpreting Emergent Extreme Events in Multi-Agent Systems
- 2026Towards accurate extreme event likelihoods from diffusion model climate emulators