PDETime: Rethinking Long-Term Multivariate Time Series Forecasting from the perspective of partial differential equations
Not on the map. Why?
Abstract (arXiv)
Recent advancements in deep learning have led to the development of various models for long-term multivariate time-series forecasting (LMTF), many of which have shown promising results. Generally, the focus has been on historical-value-based models, which rely on past observations to predict future series. Notably, a new trend has emerged with time-index-based models, offering a more nuanced understanding of the continuous dynamics underlying time series. Unlike these two types of models that aggregate the information of spatial domains or temporal domains, in this paper, we consider multivariate time series as spatiotemporal data regularly sampled from a continuous dynamical system, which can be represented by partial differential equations (PDEs), with the spatial domain being fixed. Building on this perspective, we present PDETime, a novel LMTF model inspired by the principles of Neural PDE solvers, following the encoding-integration-decoding operations. Our extensive experimentation across seven diverse real-world LMTF datasets reveals that PDETime not only adapts effectively to the intrinsic spatiotemporal nature of the data but also sets new benchmarks, achieving state-of-the-art results
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 35 of its 45 references that are in the map. First posted on arXiv 25 Feb 2024.
Builds on
35 of 45 references.
References · 35
- 2017Attention Is All You Needcited by 59,932
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2015Fast R-CNNcited by 2,930
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
23 more
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
- 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 606
- 2022Transformers in Time Series: A Surveycited by 489
- 2021Neural Operator: Learning Maps Between Function Spacescited by 413
- 2018Meta-learning with differentiable closed-form solverscited by 395
- 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 385
- 2022Message Passing Neural PDE Solverscited by 368
- 2021SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interactioncited by 335
- 2019Texture Fields: Learning Texture Representations in Function Spacecited by 210
- 2019DIST: Rendering Deep Implicit Signed Distance Function with Differentiable Sphere Tracingcited by 179
- 2019Learning to Infer Implicit Surfaces without 3D Supervisioncited by 103
- 2019Learning to Optimize Multigrid PDE Solverscited by 79
- 2019Learning Neural PDE Solvers with Convergence Guaranteescited by 77
- 2022Continuous PDE Dynamics Forecasting with Implicit Neural Representationscited by 71
- 2022CROM: Continuous Reduced-Order Modeling of PDEs Using Implicit Neural Representationscited by 56
- 2019Learning a Neural 3D Texture Space from 2D Exemplarscited by 53
- 2022Learning to Accelerate Partial Differential Equations via Latent Global Evolutioncited by 38
- 2022HyperTime: Implicit Neural Representation for Time Seriescited by 24
- 2022Learning Deep Time-index Models for Time Series Forecastingcited by 18
- 2023Time Series Continuous Modeling for Imputation and Forecasting with Implicit Neural Representationscited by 16
- 2022Time-Series Anomaly Detection with Implicit Neural Representationcited by 10
- 2023NeRT: Implicit Neural Representations for General Unsupervised Turbulence Mitigationcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.