mlsanityData to 7 Oct 2026

Recent Trends in Modelling the Continuous Time Series using Deep Learning: A Survey

arXiv 2409.09106 ↗First posted 13 Sep 2024cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Continuous-time series is essential for different modern application areas, e.g. healthcare, automobile, energy, finance, Internet of things (IoT) and other related areas. Different application needs to process as well as analyse a massive amount of data in time series structure in order to determine the data-driven result, for example, financial trend prediction, potential probability of the occurrence of a particular event occurrence identification, patient health record processing and so many more. However, modeling real-time data using a continuous-time series is challenging since the dynamical systems behind the data could be a differential equation. Several research works have tried to solve the challenges of modelling the continuous-time series using different neural network models and approaches for data processing and learning. The existing deep learning models are not free from challenges and limitations due to diversity among different attributes, behaviour, duration of steps, energy, and data sampling rate. This paper has described the general problem domain of time series and reviewed the challenges of modelling the continuous time series. We have presented a comparative analysis of recent developments in deep learning models and their contribution to solving different difficulties of modelling the continuous time series. We have also identified the limitations of the existing neural network model and open issues. The main goal of this review is to understand the recent trend of neural network models used in a different real-world application with continuous-time data.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 174 references that are in the map. First posted on arXiv 13 Sep 2024.

Builds on

32 of 174 references.

References · 32

  1. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
  2. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
  3. 2018FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Modelscited by 584
  4. 2015Bidirectional LSTM-CRF Models for Sequence Taggingcited by 544
  5. 2020Neural Controlled Differential Equations for Irregular Time Seriescited by 501
  6. 2020Time Series Forecasting With Deep Learning: A Surveycited by 457
  7. 2017Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equationscited by 362
  8. 2020Time Series Data Augmentation for Deep Learning: A Surveycited by 225
  9. 2019Symplectic ODE-Net: Learning Hamiltonian Dynamics with Controlcited by 183
  10. 2017Physics Informed Deep Learning (Part II): Data-driven Discovery of Nonlinear Partial Differential Equationscited by 158
  11. 2018Physics-Informed Generative Adversarial Networks for Stochastic Differential Equationscited by 133
  12. 2020Learning to Control PDEs with Differentiable Physicscited by 131
20 more
  1. 2019Neural SDE: Stabilizing Neural ODE Networks with Stochastic Noisecited by 98
  2. 2016Quasi-Recurrent Neural Networkscited by 87
  3. 2017Reversible Architectures for Arbitrarily Deep Residual Neural Networkscited by 69
  4. 2020Physics-Guided Machine Learning for Scientific Discovery: An Application in Simulating Lake Temperature Profilescited by 59
  5. 2017Deep Learning for Time-Series Analysiscited by 55
  6. 2017Skip RNN: Learning to Skip State Updates in Recurrent Neural Networkscited by 49
  7. 2019NeuPDE: Neural Network Based Ordinary and Partial Differential Equations for Modeling Time-Dependent Datacited by 42
  8. 2020nPINNs: nonlocal Physics-Informed Neural Networks for a parametrized nonlocal universal Laplacian operator. Algorithms and Applicationscited by 36
  9. 2018Convolutional Neural Networks combined with Runge-Kutta Methodscited by 18
  10. 2017An overview and comparative analysis of Recurrent Neural Networks for Short Term Load Forecastingcited by 12
  11. 2020Neural Ordinary Differential Equation based Recurrent Neural Network Modelcited by 12
  12. 2019Temporal-Clustering Invariance in Irregular Healthcare Time Seriescited by 8
  13. 2014Automatic Differentiation of Algorithms for Machine Learningcited by 7
  14. 2019Multi-resolution Networks For Flexible Irregular Time Series Modeling (Multi-FIT)cited by 7
  15. 2020Neural ODEs for Informative Missingness in Multivariate Time Seriescited by 7
  16. 2019Physics Informed Data Driven model for Flood Prediction: Application of Deep Learning in prediction of urban flood developmentcited by 5
  17. 2020SciANN: A Keras/Tensorflow wrapper for scientific computations and physics-informed deep learning using artificial neural networkscited by 5
  18. 2019Synthetic Event Time Series Health Data Generationcited by 3
  19. 2019Predicting Treatment Initiation from Clinical Time Series Data via Graph-Augmented Time-Sensitive Modelcited by 1
  20. 2019ODE guided Neural Data Augmentation Techniques for Time Series Data and its Benefits on Robustnesscited by 1

Built on by

Not cited yet.