SeisT: A foundational deep learning model for earthquake monitoring tasks
Not on the map. Why?
Abstract (arXiv)
Seismograms, the fundamental seismic records, have revolutionized earthquake research and monitoring. Recent advancements in deep learning have further enhanced seismic signal processing, leading to even more precise and effective earthquake monitoring capabilities. This paper introduces a foundational deep learning model, the Seismogram Transformer (SeisT), designed for a variety of earthquake monitoring tasks. SeisT combines multiple modules tailored to different tasks and exhibits impressive out-of-distribution generalization performance, outperforming or matching state-of-the-art models in tasks like earthquake detection, seismic phase picking, first-motion polarity classification, magnitude estimation, back-azimuth estimation, and epicentral distance estimation. The performance scores on the tasks are 0.96, 0.96, 0.68, 0.95, 0.86, 0.55, and 0.81, respectively. The most significant improvements, in comparison to existing models, are observed in phase-P picking, phase-S picking, and magnitude estimation, with gains of 1.7%, 9.5%, and 8.0%, respectively. Our study, through rigorous experiments and evaluations, suggests that SeisT has the potential to contribute to the advancement of seismic signal processing and earthquake research.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 22 of its 54 references that are in the map. First posted on arXiv 2 Oct 2023.
Builds on
22 of 54 references.
References · 22
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
- 2020Linformer: Self-Attention with Linear Complexitycited by 1,462
- 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,368
- 2016Deep Networks with Stochastic Depthcited by 973
- 2021CvT: Introducing Convolutions to Vision Transformerscited by 946
- 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
- 2021PVT v2: Improved Baselines with Pyramid Vision Transformercited by 749
10 more
- 2015Cyclical Learning Rates for Training Neural Networkscited by 627
- 2021Conformer: Local Features Coupling Global Representations for Visual Recognitioncited by 164
- 2022Inception Transformercited by 99
- 2022TopFormer: Token Pyramid Transformer for Mobile Semantic Segmentationcited by 82
- 2022Next-ViT: Next Generation Vision Transformer for Efficient Deployment in Realistic Industrial Scenarioscited by 65
- 2015Equilibrated adaptive learning rates for non-convex optimizationcited by 42
- 2019Bayesian-Deep-Learning Estimation of Earthquake Location from Single-Station Observationscited by 15
- 2018CRED: A Deep Residual Network of Convolutional and Recurrent Units for Earthquake Signal Detectioncited by 13
- 2019A Machine-Learning Approach for Earthquake Magnitude Estimationcited by 10
- 2023SeisCLIP: A seismology foundation model pre-trained by multi-modal data for multi-purpose seismic feature extractioncited by 8
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 2.
4 papers.
- 2024SeisLM: a Foundation Model for Seismic Waveformscited by 8
- 2025SeisMoLLM: Advancing Seismic Monitoring via Cross-modal Transfer with Pre-trained Large Language Modelcited by 3
- 2026Earth Science Foundation Models: From Perception to Reasoning and Discoverycited by 0
- 2026Learning Earthquake Wave Arrival Time Picking from Labels with Inaccuraciescited by 0
- 2026Learning Earthquake Wave Arrival Time Picking from Labels with Inaccuracies13 Jun 2026
- 2026Earth Science Foundation Models: From Perception to Reasoning and Discovery9 May 2026
- 2025SeisMoLLM: Advancing Seismic Monitoring via Cross-modal Transfer with Pre-trained Large Language Model27 Feb 2025
- 2024SeisLM: a Foundation Model for Seismic Waveforms21 Oct 2024