mlsanityData to 7 Oct 2026

Earthfarseer: Versatile Spatio-Temporal Dynamical Systems Modeling in One Model

arXiv 2312.08403 ↗First posted 13 Dec 2023cs.AIcited by 16

Not on the map. Why?

Abstract (arXiv)

Efficiently modeling spatio-temporal (ST) physical processes and observations presents a challenging problem for the deep learning community. Many recent studies have concentrated on meticulously reconciling various advantages, leading to designed models that are neither simple nor practical. To address this issue, this paper presents a systematic study on existing shortcomings faced by off-the-shelf models, including lack of local fidelity, poor prediction performance over long time-steps,low scalability, and inefficiency. To systematically address the aforementioned problems, we propose an EarthFarseer, a concise framework that combines parallel local convolutions and global Fourier-based transformer architectures, enabling dynamically capture the local-global spatial interactions and dependencies. EarthFarseer also incorporates a multi-scale fully convolutional and Fourier architectures to efficiently and effectively capture the temporal evolution. Our proposal demonstrates strong adaptability across various tasks and datasets, with fast convergence and better local fidelity in long time-steps predictions. Extensive experiments and visualizations over eight human society physical and natural physical datasets demonstrates the state-of-the-art performance of EarthFarseer. We release our code at https://github.com/easylearningscores/EarthFarseer.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 44 of its 79 references that are in the map. First posted on arXiv 13 Dec 2023.

Builds on

44 of 79 references.

References · 44

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  3. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  4. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
  5. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
  6. 2019Hamiltonian Neural Networkscited by 702
  7. 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 523
  8. 2015Unsupervised Learning of Video Representations using LSTMscited by 434
  9. 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 396
  10. 2018Video-to-Video Synthesiscited by 388
  11. 2016Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Predictioncited by 330
  12. 2017PDE-Net: Learning PDEs from Datacited by 304
32 more
  1. 2015Deep multi-scale video prediction beyond mean square errorcited by 297
  2. 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 237
  3. 2017Video Frame Synthesis using Deep Voxel Flowcited by 209
  4. 2016Deep Predictive Coding Networks for Video Prediction and Unsupervised Learningcited by 203
  5. 2020Disentangling Physical Dynamics from Unknown Factors for Unsupervised Video Predictioncited by 192
  6. 2019Scaling Autoregressive Video Modelscited by 189
  7. 2021PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learningcited by 181
  8. 2022SimVP: Simpler yet Better Video Predictioncited by 181
  9. 2015Action-Conditional Video Prediction using Deep Networks in Atari Gamescited by 171
  10. 2019Deep Learning for Spatio-Temporal Data Mining: A Surveycited by 171
  11. 2022Earthformer: Exploring Space-Time Transformers for Earth System Forecastingcited by 146
  12. 2021Enhancing Computational Fluid Dynamics with Machine Learningcited by 137
  13. 2014Video (language) modeling: a baseline for generative models of natural videoscited by 92
  14. 2017Learning to Generate Long-term Future via Hierarchical Predictioncited by 88
  15. 2021DL-Traff: Survey and Benchmark of Deep Learning Models for Urban Traffic Predictioncited by 73
  16. 2021Predicting Video with VQVAEcited by 61
  17. 2020Physics-Guided Machine Learning for Scientific Discovery: An Application in Simulating Lake Temperature Profilescited by 59
  18. 2020Future Video Synthesis with Object Motion Predictioncited by 57
  19. 2019Video Generation from Single Semantic Label Mapcited by 54
  20. 2023A Dynamic Multi-Scale Voxel Flow Network for Video Predictioncited by 53
  21. 2018Hierarchical Long-term Video Prediction without Supervisioncited by 50
  22. 2023PastNet: Introducing Physical Inductive Biases for Spatio-temporal Video Predictioncited by 44
  23. 2019Predicting Citywide Crowd Flows in Irregular Regions Using Multi-View Graph Convolutional Networkscited by 40
  24. 2020Vid-ODE: Continuous-Time Video Generation with Neural Ordinary Differential Equationcited by 39
  25. 2019Variational Temporal Abstractioncited by 37
  26. 2019UrbanFM: Inferring Fine-Grained Urban Flowscited by 31
  27. 2022STRPM: A Spatiotemporal Residual Predictive Model for High-Resolution Video Predictioncited by 31
  28. 2021Revisiting Hierarchical Approach for Persistent Long-Term Video Predictioncited by 23
  29. 2020PDE-Driven Spatiotemporal Disentanglementcited by 19
  30. 2021MC-LSTM: Mass-Conserving LSTMcited by 17
  31. 2023The Snowflake Hypothesis: Training Deep GNN with One Node One Receptive fieldcited by 11
  32. 2020Dimensionality reduction to maximize prediction generalization capabilitycited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 7; 2025: 5; 2026: 4.

16 papers.

Sort:

By area: