mlsanityData to 7 Oct 2026

PDETime: Rethinking Long-Term Multivariate Time Series Forecasting from the perspective of partial differential equations

arXiv 2402.16913 ↗First posted 25 Feb 2024cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Recent advancements in deep learning have led to the development of various models for long-term multivariate time-series forecasting (LMTF), many of which have shown promising results. Generally, the focus has been on historical-value-based models, which rely on past observations to predict future series. Notably, a new trend has emerged with time-index-based models, offering a more nuanced understanding of the continuous dynamics underlying time series. Unlike these two types of models that aggregate the information of spatial domains or temporal domains, in this paper, we consider multivariate time series as spatiotemporal data regularly sampled from a continuous dynamical system, which can be represented by partial differential equations (PDEs), with the spatial domain being fixed. Building on this perspective, we present PDETime, a novel LMTF model inspired by the principles of Neural PDE solvers, following the encoding-integration-decoding operations. Our extensive experimentation across seven diverse real-world LMTF datasets reveals that PDETime not only adapts effectively to the intrinsic spatiotemporal nature of the data but also sets new benchmarks, achieving state-of-the-art results

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 35 of its 45 references that are in the map. First posted on arXiv 25 Feb 2024.

Builds on

35 of 45 references.

References · 35

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2018Neural Ordinary Differential Equationscited by 3,733
  4. 2015Fast R-CNNcited by 2,930
  5. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  6. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  7. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  8. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  9. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  10. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  11. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  12. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
23 more
  1. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
  2. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
  3. 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 606
  4. 2022Transformers in Time Series: A Surveycited by 489
  5. 2021Neural Operator: Learning Maps Between Function Spacescited by 413
  6. 2018Meta-learning with differentiable closed-form solverscited by 395
  7. 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 385
  8. 2022Message Passing Neural PDE Solverscited by 368
  9. 2021SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interactioncited by 335
  10. 2019Texture Fields: Learning Texture Representations in Function Spacecited by 210
  11. 2019DIST: Rendering Deep Implicit Signed Distance Function with Differentiable Sphere Tracingcited by 179
  12. 2019Learning to Infer Implicit Surfaces without 3D Supervisioncited by 103
  13. 2019Learning to Optimize Multigrid PDE Solverscited by 79
  14. 2019Learning Neural PDE Solvers with Convergence Guaranteescited by 77
  15. 2022Continuous PDE Dynamics Forecasting with Implicit Neural Representationscited by 71
  16. 2022CROM: Continuous Reduced-Order Modeling of PDEs Using Implicit Neural Representationscited by 56
  17. 2019Learning a Neural 3D Texture Space from 2D Exemplarscited by 53
  18. 2022Learning to Accelerate Partial Differential Equations via Latent Global Evolutioncited by 38
  19. 2022HyperTime: Implicit Neural Representation for Time Seriescited by 24
  20. 2022Learning Deep Time-index Models for Time Series Forecastingcited by 18
  21. 2023Time Series Continuous Modeling for Imputation and Forecasting with Implicit Neural Representationscited by 16
  22. 2022Time-Series Anomaly Detection with Implicit Neural Representationcited by 10
  23. 2023NeRT: Implicit Neural Representations for General Unsupervised Turbulence Mitigationcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.