Digital Typhoon: Long-term Satellite Image Dataset for the Spatio-Temporal Modeling of Tropical Cyclones
Not on the map. Why?
Abstract (arXiv)
This paper presents the official release of the Digital Typhoon dataset, the longest typhoon satellite image dataset for 40+ years aimed at benchmarking machine learning models for long-term spatio-temporal data. To build the dataset, we developed a workflow to create an infrared typhoon-centered image for cropping using Lambert azimuthal equal-area projection referring to the best track data. We also address data quality issues such as inter-satellite calibration to create a homogeneous dataset. To take advantage of the dataset, we organized machine learning tasks by the types and targets of inference, with other tasks for meteorological analysis, societal impact, and climate change. The benchmarking results on the analysis, forecasting, and reanalysis for the intensity suggest that the dataset is challenging for recent deep learning models, due to many choices that affect the performance of various models. This dataset reduces the barrier for machine learning researchers to meet large-scale real-world events called tropical cyclones and develop machine learning models that may contribute to advancing scientific knowledge on tropical cyclones as well as solving societal and sustainability issues such as disaster reduction and climate change. The dataset is publicly available at http://agora.ex.nii.ac.jp/digital-typhoon/dataset/ and https://github.com/kitamoto-lab/digital-typhoon/.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 9 of its 56 references that are in the map. First posted on arXiv 5 Nov 2023.
Builds on
9 of 56 references.
References · 9
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
- 2020WeatherBench: A benchmark dataset for data-driven weather forecastingcited by 272
- 2019Tackling Climate Change with Machine Learningcited by 264
- 2021ClimART: A Benchmark Dataset for Emulating Atmospheric Radiative Transfer in Weather and Climate Modelscited by 21
- 2022ENS-10: A Dataset For Post-Processing Ensemble Weather Forecastscited by 13
Built on by
Citing papers per year: 2023: 1; 2024: 6; 2025: 7; 2026: 5.
19 papers.
Sort:
By area:
- 2025Panopticon: Advancing Any-Sensor Foundation Models for Earth Observationcited by 34
- 2023Foundation Models for Weather and Climate Data Understanding: A Comprehensive Surveycited by 32
- 2024CLLMate: A Multimodal Benchmark for Weather and Climate Events Forecastingcited by 19
- 2025Deep Learning and Foundation Models for Weather Prediction: A Surveycited by 15
- 2025OmniEarth-Bench: Towards Holistic Evaluation of Earth's Six Spheres and Cross-Spheres Interactions with Multimodal Observational Earth Datacited by 14
- 2024Global Tropical Cyclone Intensity Forecasting with Multi-modal Multi-scale Causal Autoregressive Modelcited by 9
- 2025SciVid: Cross-Domain Evaluation of Video Models in Scientific Applicationscited by 5
- 2024Latent Knowledge-Guided Video Diffusion for Scientific Phenomena Generation from a Single Initial Framecited by 4
- 2024Lightning UQ Box: A Comprehensive Framework for Uncertainty Quantification in Deep Learningcited by 3
- 2024Machine Learning for the Digital Typhoon Dataset: Extensions to Multiple Basins and New Developments in Representations and Taskscited by 3
- 2025SCENT: Robust Spatiotemporal Learning for Continuous Scientific Data via Scalable Conditioned Neural Fieldscited by 3
- 2024Estimating Atmospheric Variables from Digital Typhoon Satellite Images via Conditional Denoising Diffusion Modelscited by 1
7 more
- 2025PIPE: Physics-Informed Position Encoding for Alignment of Satellite Images and Time Seriescited by 1
- 2026WeatherSyn: An Instruction Tuning MLLM For Weather Forecasting Report Generationcited by 1
- 2025IDOL: Meeting Diverse Distribution Shifts with Prior Physics for Tropical Cyclone Multi-Task Estimationcited by 0
- 2026Physics Encoded Spatial and Temporal Generative Adversarial Network for Tropical Cyclone Image Super-resolutioncited by 0
- 2026Improving Ensemble Forecasts of Abnormally Deflecting Tropical Cyclones with Fused Atmosphere-Ocean-Terrain Datacited by 0
- 2026Earth Science Foundation Models: From Perception to Reasoning and Discoverycited by 0
- 2026The Perception-Physics Paradox: Probing Scientific Alignment with TC-Benchcited by 0
- 2026The Perception-Physics Paradox: Probing Scientific Alignment with TC-Bench23 May 2026
- 2026Earth Science Foundation Models: From Perception to Reasoning and Discovery9 May 2026
- 2026WeatherSyn: An Instruction Tuning MLLM For Weather Forecasting Report Generation8 May 2026
- 2026Improving Ensemble Forecasts of Abnormally Deflecting Tropical Cyclones with Fused Atmosphere-Ocean-Terrain Data31 Mar 2026
- 2026Physics Encoded Spatial and Temporal Generative Adversarial Network for Tropical Cyclone Image Super-resolution19 Feb 2026
- 2025IDOL: Meeting Diverse Distribution Shifts with Prior Physics for Tropical Cyclone Multi-Task Estimation13 Nov 2025
- 2025SciVid: Cross-Domain Evaluation of Video Models in Scientific Applications4 Jul 2025
- 2025OmniEarth-Bench: Towards Holistic Evaluation of Earth's Six Spheres and Cross-Spheres Interactions with Multimodal Observational Earth Data29 May 2025
- 2025PIPE: Physics-Informed Position Encoding for Alignment of Satellite Images and Time Series27 May 2025
- 2025SCENT: Robust Spatiotemporal Learning for Continuous Scientific Data via Scalable Conditioned Neural Fields16 Apr 2025
- 2025Panopticon: Advancing Any-Sensor Foundation Models for Earth Observation13 Mar 2025
- 2025Deep Learning and Foundation Models for Weather Prediction: A Survey12 Jan 2025
7 more
- 2024Machine Learning for the Digital Typhoon Dataset: Extensions to Multiple Basins and New Developments in Representations and Tasks25 Nov 2024
- 2024Latent Knowledge-Guided Video Diffusion for Scientific Phenomena Generation from a Single Initial Frame18 Nov 2024
- 2024Lightning UQ Box: A Comprehensive Framework for Uncertainty Quantification in Deep Learning4 Oct 2024
- 2024CLLMate: A Multimodal Benchmark for Weather and Climate Events Forecasting27 Sep 2024
- 2024Estimating Atmospheric Variables from Digital Typhoon Satellite Images via Conditional Denoising Diffusion Models12 Sep 2024
- 2024Global Tropical Cyclone Intensity Forecasting with Multi-modal Multi-scale Causal Autoregressive Model16 Feb 2024
- 2023Foundation Models for Weather and Climate Data Understanding: A Comprehensive Survey5 Dec 2023
- 2025Panopticon: Advancing Any-Sensor Foundation Models for Earth Observationcited by 34
- 2023Foundation Models for Weather and Climate Data Understanding: A Comprehensive Surveycited by 32
- 2024CLLMate: A Multimodal Benchmark for Weather and Climate Events Forecastingcited by 19
- 2025Deep Learning and Foundation Models for Weather Prediction: A Surveycited by 15
- 2025OmniEarth-Bench: Towards Holistic Evaluation of Earth's Six Spheres and Cross-Spheres Interactions with Multimodal Observational Earth Datacited by 14
- 2024Global Tropical Cyclone Intensity Forecasting with Multi-modal Multi-scale Causal Autoregressive Modelcited by 9
- 2025SciVid: Cross-Domain Evaluation of Video Models in Scientific Applicationscited by 5
- 2024Lightning UQ Box: A Comprehensive Framework for Uncertainty Quantification in Deep Learningcited by 3
- 2024Machine Learning for the Digital Typhoon Dataset: Extensions to Multiple Basins and New Developments in Representations and Taskscited by 3
- 2025SCENT: Robust Spatiotemporal Learning for Continuous Scientific Data via Scalable Conditioned Neural Fieldscited by 3
- 2025PIPE: Physics-Informed Position Encoding for Alignment of Satellite Images and Time Seriescited by 1
- 2026WeatherSyn: An Instruction Tuning MLLM For Weather Forecasting Report Generationcited by 1
12 most cited of 17 All 17 (JSON)
- 2026The Perception-Physics Paradox: Probing Scientific Alignment with TC-Bench23 May 2026
- 2026Earth Science Foundation Models: From Perception to Reasoning and Discovery9 May 2026
- 2026WeatherSyn: An Instruction Tuning MLLM For Weather Forecasting Report Generation8 May 2026
- 2026Improving Ensemble Forecasts of Abnormally Deflecting Tropical Cyclones with Fused Atmosphere-Ocean-Terrain Data31 Mar 2026
- 2026Physics Encoded Spatial and Temporal Generative Adversarial Network for Tropical Cyclone Image Super-resolution19 Feb 2026
- 2025IDOL: Meeting Diverse Distribution Shifts with Prior Physics for Tropical Cyclone Multi-Task Estimation13 Nov 2025
- 2025SciVid: Cross-Domain Evaluation of Video Models in Scientific Applications4 Jul 2025
- 2025OmniEarth-Bench: Towards Holistic Evaluation of Earth's Six Spheres and Cross-Spheres Interactions with Multimodal Observational Earth Data29 May 2025
- 2025PIPE: Physics-Informed Position Encoding for Alignment of Satellite Images and Time Series27 May 2025
- 2025SCENT: Robust Spatiotemporal Learning for Continuous Scientific Data via Scalable Conditioned Neural Fields16 Apr 2025
- 2025Panopticon: Advancing Any-Sensor Foundation Models for Earth Observation13 Mar 2025
- 2025Deep Learning and Foundation Models for Weather Prediction: A Survey12 Jan 2025
12 newest of 17 All 17 (JSON)