Deep Space Weather Model: Long-Range Solar Flare Prediction from Multi-Wavelength Images
Not on the map. Why?
Abstract (arXiv)
Accurate, reliable solar flare prediction is crucial for mitigating potential disruptions to critical infrastructure, while predicting solar flares remains a significant challenge. Existing methods based on heuristic physical features often lack representation learning from solar images. On the other hand, end-to-end learning approaches struggle to model long-range temporal dependencies in solar images. In this study, we propose Deep Space Weather Model (Deep SWM), which is based on multiple deep state space models for handling both ten-channel solar images and long-range spatio-temporal dependencies. Deep SWM also features a sparse masked autoencoder, a novel pretraining strategy that employs a two-phase masking approach to preserve crucial regions such as sunspots while compressing spatial information. Furthermore, we built FlareBench, a new public benchmark for solar flare prediction covering a full 11-year solar activity cycle, to validate our method. Our method outperformed baseline methods and even human expert performance on standard metrics in terms of performance and reliability. The project page can be found at https://keio-smilab25.github.io/DeepSWM.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 34 of its 77 references that are in the map. First posted on arXiv 11 Aug 2025.
Builds on
34 of 77 references.
References · 34
- 2017Attention Is All You Needcited by 60,361
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,322
- 2019Decoupling Representation and Classifier for Long-Tailed Recognitioncited by 809
- 2022Simplified State Space Layers for Sequence Modelingcited by 788
- 2017DOTA: A Large-scale Dataset for Object Detection in Aerial Imagescited by 623
- 2021Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layerscited by 608
22 more
- 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 605
- 2023VideoMAE V2: Scaling Video Masked Autoencoders with Dual Maskingcited by 528
- 2022On the Parameterization and Initialization of Diagonal State Space Modelscited by 424
- 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 308
- 2021Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Littlecited by 177
- 2023FLatten Transformer: Vision Transformer using Focused Linear Attentioncited by 171
- 2023Siamese Masked Autoencoderscited by 76
- 2023Forecast-MAE: Self-supervised Pre-training for Motion Forecasting with Masked Autoencoderscited by 73
- 2021Combiner: Full Attention Transformer with Sparse Computation Costcited by 64
- 2024Mamba-360: Survey of State Space Models as Transformer Alternative for Long Sequence Modelling: Methods, Applications, and Challengescited by 64
- 2019Satellite Pose Estimation Challenge: Dataset, Competition Design and Resultscited by 62
- 2022GD-MAE: Generative Decoder for MAE Pre-training on LiDAR Point Cloudscited by 57
- 2021Wide-Depth-Range 6D Object Pose Estimation in Spacecited by 45
- 2023Traj-MAE: Masked Autoencoders for Trajectory Predictioncited by 42
- 2022Nonparametric Masked Language Modelingcited by 40
- 2021EarthNet2021: A large-scale dataset and challenge for Earth surface forecasting as a guided video prediction taskcited by 34
- 2018Star Tracking using an Event Cameracited by 30
- 2019Predicting Solar Flares Using a Long Short-Term Memory Networkcited by 25
- 2024VideoMAC: Video Masked Autoencoders Meet ConvNetscited by 20
- 2022Predicting Solar Flares Using CNN and LSTM on Two Solar Cycles of Active Region Datacited by 15
- 2024SCE-MAE: Selective Correspondence Enhancement with Masked Autoencoder for Self-Supervised Landmark Estimationcited by 6
- 2020Shape-based Feature Engineering for Solar Flare Predictioncited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2024Solar synthetic imaging: Introducing denoising diffusion probabilistic models on SDO/AIA data
- 2022Incorporating Polar Field Data for Improved Solar Flare Prediction
- 2024Magnetogram-to-Magnetogram: Generative Forecasting of Solar Evolution
- 2024Generative Simulations of The Solar Corona Evolution With Denoising Diffusion : Proof of Concept
- 2026FarSky: Task-Aware Latent-Space Coupling for Generative Intra-Hour Solar Forecasting
- 2023A Comparative Study on Generative Models for High Resolution Solar Observation Imaging
- 2025Efficient Deep Learning for Short-Term Solar Irradiance Time Series Forecasting: A Benchmark Study in Ho Chi Minh City
- 2023Diffusion Models for High-Resolution Solar Forecasts