Earthfarseer: Versatile Spatio-Temporal Dynamical Systems Modeling in One Model
Not on the map. Why?
Abstract (arXiv)
Efficiently modeling spatio-temporal (ST) physical processes and observations presents a challenging problem for the deep learning community. Many recent studies have concentrated on meticulously reconciling various advantages, leading to designed models that are neither simple nor practical. To address this issue, this paper presents a systematic study on existing shortcomings faced by off-the-shelf models, including lack of local fidelity, poor prediction performance over long time-steps,low scalability, and inefficiency. To systematically address the aforementioned problems, we propose an EarthFarseer, a concise framework that combines parallel local convolutions and global Fourier-based transformer architectures, enabling dynamically capture the local-global spatial interactions and dependencies. EarthFarseer also incorporates a multi-scale fully convolutional and Fourier architectures to efficiently and effectively capture the temporal evolution. Our proposal demonstrates strong adaptability across various tasks and datasets, with fast convergence and better local fidelity in long time-steps predictions. Extensive experiments and visualizations over eight human society physical and natural physical datasets demonstrates the state-of-the-art performance of EarthFarseer. We release our code at https://github.com/easylearningscores/EarthFarseer.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 44 of its 79 references that are in the map. First posted on arXiv 13 Dec 2023.
Builds on
44 of 79 references.
References · 44
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
- 2019Hamiltonian Neural Networkscited by 702
- 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 523
- 2015Unsupervised Learning of Video Representations using LSTMscited by 434
- 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 396
- 2018Video-to-Video Synthesiscited by 388
- 2016Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Predictioncited by 330
- 2017PDE-Net: Learning PDEs from Datacited by 304
32 more
- 2015Deep multi-scale video prediction beyond mean square errorcited by 297
- 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 237
- 2017Video Frame Synthesis using Deep Voxel Flowcited by 209
- 2016Deep Predictive Coding Networks for Video Prediction and Unsupervised Learningcited by 203
- 2020Disentangling Physical Dynamics from Unknown Factors for Unsupervised Video Predictioncited by 192
- 2019Scaling Autoregressive Video Modelscited by 189
- 2021PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learningcited by 181
- 2022SimVP: Simpler yet Better Video Predictioncited by 181
- 2015Action-Conditional Video Prediction using Deep Networks in Atari Gamescited by 171
- 2019Deep Learning for Spatio-Temporal Data Mining: A Surveycited by 171
- 2022Earthformer: Exploring Space-Time Transformers for Earth System Forecastingcited by 146
- 2021Enhancing Computational Fluid Dynamics with Machine Learningcited by 137
- 2014Video (language) modeling: a baseline for generative models of natural videoscited by 92
- 2017Learning to Generate Long-term Future via Hierarchical Predictioncited by 88
- 2021DL-Traff: Survey and Benchmark of Deep Learning Models for Urban Traffic Predictioncited by 73
- 2021Predicting Video with VQVAEcited by 61
- 2020Physics-Guided Machine Learning for Scientific Discovery: An Application in Simulating Lake Temperature Profilescited by 59
- 2020Future Video Synthesis with Object Motion Predictioncited by 57
- 2019Video Generation from Single Semantic Label Mapcited by 54
- 2023A Dynamic Multi-Scale Voxel Flow Network for Video Predictioncited by 53
- 2018Hierarchical Long-term Video Prediction without Supervisioncited by 50
- 2023PastNet: Introducing Physical Inductive Biases for Spatio-temporal Video Predictioncited by 44
- 2019Predicting Citywide Crowd Flows in Irregular Regions Using Multi-View Graph Convolutional Networkscited by 40
- 2020Vid-ODE: Continuous-Time Video Generation with Neural Ordinary Differential Equationcited by 39
- 2019Variational Temporal Abstractioncited by 37
- 2019UrbanFM: Inferring Fine-Grained Urban Flowscited by 31
- 2022STRPM: A Spatiotemporal Residual Predictive Model for High-Resolution Video Predictioncited by 31
- 2021Revisiting Hierarchical Approach for Persistent Long-Term Video Predictioncited by 23
- 2020PDE-Driven Spatiotemporal Disentanglementcited by 19
- 2021MC-LSTM: Mass-Conserving LSTMcited by 17
- 2023The Snowflake Hypothesis: Training Deep GNN with One Node One Receptive fieldcited by 11
- 2020Dimensionality reduction to maximize prediction generalization capabilitycited by 5
Built on by
Citing papers per year: 2024: 7; 2025: 5; 2026: 4.
16 papers.
Sort:
By area:
- 2024MolTC: Towards Molecular Relational Modeling In Language Modelscited by 22
- 2024EXGC: Bridging Efficiency and Explainability in Graph Condensationcited by 20
- 2025NeuralOM: Neural Ocean Model for Subseasonal-to-Seasonal Simulationcited by 11
- 2024CaT-GNN: Enhancing Credit Card Fraud Detection via Causal Temporal Graph Neural Networkscited by 7
- 2024Spatio-Temporal Fluid Dynamics Modeling via Physical-Awareness and Parameter Diffusion Guidancecited by 5
- 2024BeamVQ: Aligning Space-Time Forecasting Model via Self-training on Physics-aware Metricscited by 3
- 2024Adaptive Runge-Kutta Dynamics for Spatiotemporal Predictioncited by 1
- 2025Learning from History: A Retrieval-Augmented Framework for Spatiotemporal Predictioncited by 1
- 2025S^2-KD: Semantic-Spectral Knowledge Distillation Spatiotemporal Forecastingcited by 1
- 2026PnP-Corrector: A Universal Correction Framework for Coupled Spatiotemporal Forecastingcited by 1
- 2024Physics-informed Discovery of State Variables in Second-Order and Hamiltonian Systemscited by 0
- 2025VISION: Prompting Ocean Vertical Velocity Reconstruction from Incomplete Observationscited by 0
4 more
- 2025Rectifying Distribution Shift in Cascaded Precipitation Nowcastingcited by 0
- 2026REE-TTT: Highly Adaptive Radar Echo Extrapolation Based on Test-Time Trainingcited by 0
- 2026AsyncCouple-Flow: Asynchronous Cross-Modal Coupling and Flow Matching for Spatio-Temporal Forecastingcited by 0
- 2026Physics-Guided Flow-Map Matching for Precipitation Nowcastingcited by 0
- 2026Physics-Guided Flow-Map Matching for Precipitation Nowcasting27 Sep 2026
- 2026AsyncCouple-Flow: Asynchronous Cross-Modal Coupling and Flow Matching for Spatio-Temporal Forecasting15 Sep 2026
- 2026PnP-Corrector: A Universal Correction Framework for Coupled Spatiotemporal Forecasting9 May 2026
- 2026REE-TTT: Highly Adaptive Radar Echo Extrapolation Based on Test-Time Training4 Jan 2026
- 2025S^2-KD: Semantic-Spectral Knowledge Distillation Spatiotemporal Forecasting29 Nov 2025
- 2025Rectifying Distribution Shift in Cascaded Precipitation Nowcasting19 Nov 2025
- 2025Learning from History: A Retrieval-Augmented Framework for Spatiotemporal Prediction28 Oct 2025
- 2025VISION: Prompting Ocean Vertical Velocity Reconstruction from Incomplete Observations25 Sep 2025
- 2025NeuralOM: Neural Ocean Model for Subseasonal-to-Seasonal Simulation27 May 2025
- 2024Physics-informed Discovery of State Variables in Second-Order and Hamiltonian Systems21 Aug 2024
- 2024BeamVQ: Aligning Space-Time Forecasting Model via Self-training on Physics-aware Metrics27 May 2024
- 2024Adaptive Runge-Kutta Dynamics for Spatiotemporal Prediction23 May 2024
4 more
- 2024Spatio-Temporal Fluid Dynamics Modeling via Physical-Awareness and Parameter Diffusion Guidance18 Mar 2024
- 2024CaT-GNN: Enhancing Credit Card Fraud Detection via Causal Temporal Graph Neural Networks22 Feb 2024
- 2024MolTC: Towards Molecular Relational Modeling In Language Models6 Feb 2024
- 2024EXGC: Bridging Efficiency and Explainability in Graph Condensation5 Feb 2024
- 2024MolTC: Towards Molecular Relational Modeling In Language Modelscited by 22
- 2024EXGC: Bridging Efficiency and Explainability in Graph Condensationcited by 20
- 2025NeuralOM: Neural Ocean Model for Subseasonal-to-Seasonal Simulationcited by 11
- 2024CaT-GNN: Enhancing Credit Card Fraud Detection via Causal Temporal Graph Neural Networkscited by 7
- 2024Spatio-Temporal Fluid Dynamics Modeling via Physical-Awareness and Parameter Diffusion Guidancecited by 5
- 2024BeamVQ: Aligning Space-Time Forecasting Model via Self-training on Physics-aware Metricscited by 3
- 2024Adaptive Runge-Kutta Dynamics for Spatiotemporal Predictioncited by 1
- 2025Learning from History: A Retrieval-Augmented Framework for Spatiotemporal Predictioncited by 1
- 2025S^2-KD: Semantic-Spectral Knowledge Distillation Spatiotemporal Forecastingcited by 1
- 2026PnP-Corrector: A Universal Correction Framework for Coupled Spatiotemporal Forecastingcited by 1
- 2024Physics-informed Discovery of State Variables in Second-Order and Hamiltonian Systemscited by 0
- 2025VISION: Prompting Ocean Vertical Velocity Reconstruction from Incomplete Observationscited by 0
12 most cited of 15 All 15 (JSON)
- 2026Physics-Guided Flow-Map Matching for Precipitation Nowcasting27 Sep 2026
- 2026PnP-Corrector: A Universal Correction Framework for Coupled Spatiotemporal Forecasting9 May 2026
- 2026REE-TTT: Highly Adaptive Radar Echo Extrapolation Based on Test-Time Training4 Jan 2026
- 2025S^2-KD: Semantic-Spectral Knowledge Distillation Spatiotemporal Forecasting29 Nov 2025
- 2025Rectifying Distribution Shift in Cascaded Precipitation Nowcasting19 Nov 2025
- 2025Learning from History: A Retrieval-Augmented Framework for Spatiotemporal Prediction28 Oct 2025
- 2025VISION: Prompting Ocean Vertical Velocity Reconstruction from Incomplete Observations25 Sep 2025
- 2025NeuralOM: Neural Ocean Model for Subseasonal-to-Seasonal Simulation27 May 2025
- 2024Physics-informed Discovery of State Variables in Second-Order and Hamiltonian Systems21 Aug 2024
- 2024BeamVQ: Aligning Space-Time Forecasting Model via Self-training on Physics-aware Metrics27 May 2024
- 2024Adaptive Runge-Kutta Dynamics for Spatiotemporal Prediction23 May 2024
- 2024Spatio-Temporal Fluid Dynamics Modeling via Physical-Awareness and Parameter Diffusion Guidance18 Mar 2024
12 newest of 15 All 15 (JSON)