mlsanityData to 7 Oct 2026

Time Series Foundation Models and Deep Learning Architectures for Earthquake Temporal and Spatial Nowcasting

arXiv 2408.11990 ↗First posted 21 Aug 2024cs.LG physics.geo-phcited by 3

Not on the map. Why?

Abstract (arXiv)

Advancing the capabilities of earthquake nowcasting, the real-time forecasting of seismic activities remains a crucial and enduring objective aimed at reducing casualties. This multifaceted challenge has recently gained attention within the deep learning domain, facilitated by the availability of extensive, long-term earthquake datasets. Despite significant advancements, existing literature on earthquake nowcasting lacks comprehensive evaluations of pre-trained foundation models and modern deep learning architectures. These architectures, such as transformers or graph neural networks, uniquely focus on different aspects of data, including spatial relationships, temporal patterns, and multi-scale dependencies. This paper addresses the mentioned gap by analyzing different architectures and introducing two innovation approaches called MultiFoundationQuake and GNNCoder. We formulate earthquake nowcasting as a time series forecasting problem for the next 14 days within 0.1-degree spatial bins in Southern California, spanning from 1986 to 2024. Earthquake time series is forecasted as a function of logarithm energy released by quakes. Our comprehensive evaluation employs several key performance metrics, notably Nash-Sutcliffe Efficiency and Mean Squared Error, over time in each spatial region. The results demonstrate that our introduced models outperform other custom architectures by effectively capturing temporal-spatial relationships inherent in seismic data. The performance of existing foundation models varies significantly based on the pre-training datasets, emphasizing the need for careful dataset selection. However, we introduce a new general approach termed MultiFoundationPattern that combines a bespoke pattern with foundation model results handled as auxiliary streams. In the earthquake case, the resultant MultiFoundationQuake model achieves the best overall performance.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 18 of its 59 references that are in the map. First posted on arXiv 21 Aug 2024.

Builds on

18 of 59 references.

References · 18

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  5. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  6. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
  7. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 869
  8. 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 748
  9. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
  10. 2019Heterogeneous Graph Attention Networkcited by 732
  11. 2024Chronos: Learning the Language of Time Seriescited by 712
  12. 2023Long-term Forecasting with TiDE: Time-series Dense Encodercited by 327
6 more
  1. 2017Dilated Recurrent Neural Networkscited by 83
  2. 2020Graph Neural Networks in TensorFlow and Keras with Spektralcited by 59
  3. 2022Earthquake Phase Association with Graph Neural Networkscited by 10
  4. 2022GCNET: graph-based prediction of stock price movement using graph convolutional networkcited by 6
  5. 2021Earthquake Nowcasting with Deep Learningcited by 3
  6. 2022Persistence Initialization: A novel adaptation of the Transformer architecture for Time Series Forecastingcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 0; 2026: 2.

3 papers.