mlsanityData to 7 Oct 2026

Recent Advances in Recurrent Neural Networks

arXiv 1801.01078 ↗First posted 29 Dec 2017cs.NEcited by 89

Not on the map. Why?

Abstract (arXiv)

Recurrent neural networks (RNNs) are capable of learning features and long term dependencies from sequential and time-series data. The RNNs have a stack of non-linear units where at least one connection between units forms a directed cycle. A well-trained RNN can model any dynamical system; however, training RNNs is mostly plagued by issues in learning long-term dependencies. In this paper, we present a survey on RNNs and several new advances for newcomers and professionals in the field. The fundamentals and recent advances are explained and the research challenges are introduced.

Key facts. Cited by 89 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Dec 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 12; 2022: 16; 2023: 14; 2024: 28; 2025: 13; 2026: 6.

89 papers.

Sort:

By area:

  1. 2024A Survey on Large Language Model Acceleration based on KV Cache Managementcited by 125
  2. 2024Kolmogorov-Arnold Networks for Time Series: Bridging Predictive Power and Interpretabilitycited by 69
  3. 2022A Survey on Explainable Anomaly Detectioncited by 39
  4. 2024Queue management for slo-oriented large language model servingcited by 36
  5. 2021Is Sparse Attention more Interpretable?cited by 31
  6. 2022Green Learning: Introduction, Examples and Outlookcited by 30
  7. 2021Explainable Reinforcement Learning for Broad-XAI: A Conceptual Framework and Surveycited by 24
  8. 2025Foundation Models for Time Series: A Surveycited by 19
  9. 2023A Survey on Graph Neural Network Acceleration: Algorithms, Systems, and Customized Hardwarecited by 18
  10. 2021A Survey on Deep Reinforcement Learning for Audio-Based Applicationscited by 17
  11. 2021CAMul: Calibrated and Accurate Multi-view Time-Series Forecastingcited by 17
  12. 2024On the Resurgence of Recurrent Models for Long Sequences -- Survey and Research Opportunities in the Transformer Eracited by 17
38 more
  1. 2022Reservoir Computing via Quantum Recurrent Neural Networkscited by 14
  2. 2022Rapid training of quantum recurrent neural networkscited by 13
  3. 2023Leveraging arbitrary mobile sensor trajectories with shallow recurrent decoder networks for full-state reconstructioncited by 12
  4. 2023Recurrent Neural Networks and Long Short-Term Memory Networks: Tutorial and Surveycited by 10
  5. 2024An L-BFGS-B approach for linear and nonlinear system identification under ℓ1 and group-Lasso regularizationcited by 8
  6. 2024MixLinear: Extreme Low Resource Multivariate Time Series Forecasting with 0.1K Parameterscited by 8
  7. 2021Initializing LSTM internal states via manifold learningcited by 7
  8. 2022A Review of Machine Learning Methods Applied to Structural Dynamics and Vibroacousticcited by 7
  9. 2022A Mathematical Framework for Learning Probability Distributionscited by 7
  10. 2022S-Rocket: Selective Random Convolution Kernels for Time Series Classificationcited by 6
  11. 2022GM-TCNet: Gated Multi-scale Temporal Convolutional Network using Emotion Causality for Speech Emotion Recognitioncited by 6
  12. 2022Predicting Human Mobility via Self-supervised Disentanglement Learningcited by 5
  13. 2024UniCL: A Universal Contrastive Learning Framework for Large Time Series Modelscited by 5
  14. 2024A Reality check of the benefits of LLM in businesscited by 5
  15. 2021Prediction of the Position of External Markers Using a Recurrent Neural Network Trained With Unbiased Online Recurrent Optimization for Safe Lung Cancer Radiotherapycited by 4
  16. 2024Recursively Feasible Shrinking-Horizon MPC in Dynamic Environments with Conformal Prediction Guaranteescited by 4
  17. 2021Intrusion Detection System in Smart Home Network Using Bidirectional LSTM and Convolutional Neural Networks Hybrid Modelcited by 3
  18. 2022Stability Analysis of Recurrent Neural Networks by IQC with Copositive Mutiplierscited by 3
  19. 2022Decomposing a Recurrent Neural Network into Modules for Enabling Reusability and Replacementcited by 3
  20. 2024Rethinking the Relationship between Recurrent and Non-Recurrent Neural Networks: A Study in Sparsitycited by 3
  21. 2024KODA: A Data-Driven Recursive Model for Time Series Forecasting and Data Assimilation using Koopman Operatorscited by 3
  22. 2021ViPTT-Net: Video pretraining of spatio-temporal model for tuberculosis type classification from chest CT scanscited by 2
  23. 2021Deep Sequence Modeling: Development and Applications in Asset Pricingcited by 2
  24. 2022Vau da muntanialas: Energy-efficient multi-die scalable acceleration of RNN inferencecited by 2
  25. 2023KARNet: Kalman Filter Augmented Recurrent Neural Network for Learning World Models in Autonomous Driving Taskscited by 2
  26. 2023Hypertension Detection From High-Dimensional Representation of Photoplethysmogram Signalscited by 2
  27. 2023A Comprehensive Survey on Deep Neural Image Deblurringcited by 2
  28. 2024Improving Entity Recognition Using Ensembles of Deep Learning and Fine-tuned Large Language Models: A Case Study on Adverse Event Extraction from Multiple Sourcescited by 2
  29. 2024scFusionTTT: Single-cell transcriptomics and proteomics fusion with Test-Time Training layerscited by 2
  30. 2024RingGesture: A Ring-Based Mid-Air Gesture Typing System Powered by a Deep-Learning Word Prediction Frameworkcited by 2
  31. 2025EGG-SR: Embedding Symbolic Equivalence into Symbolic Regression via Equality Graphcited by 2
  32. 2021Language Semantics Interpretation with an Interaction-based Recurrent Neural Networkscited by 1
  33. 2022A Trainable Approach to Zero-delay Smoothing Spline Interpolationcited by 1
  34. 2022PAVI: Plate-Amortized Variational Inferencecited by 1
  35. 2022A Case Report On The "A.I. Locked-In Problem": social concerns with modern NLPcited by 1
  36. 2023Predicting Visit Cost of Obstructive Sleep Apnea using Electronic Healthcare Records with Transformercited by 1
  37. 2023PAVI: Plate-Amortized Variational Inferencecited by 1
  38. 2023Advancing Perception in Artificial Intelligence through Principles of Cognitive Sciencecited by 1

50 most cited of 89 All 89 (JSON)