Understanding LSTM -- a tutorial into Long Short-Term Memory Recurrent Neural Networks
Not on the map. Why?
Abstract (arXiv)
Long Short-Term Memory Recurrent Neural Networks (LSTM-RNN) are one of the most powerful dynamic classifiers publicly known. The network itself and the related learning algorithms are reasonably well documented to get an idea how it works. This paper will shed more light into understanding how LSTM-RNNs evolved and why they work impressively well, focusing on the early, ground-breaking publications. We significantly improved documentation and fixed a number of errors and inconsistencies that accumulated in previous publications. To support understanding we as well revised and unified the notation used.
Key facts. Cited by 103 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 14; 2023: 18; 2024: 29; 2025: 25; 2026: 10.
103 papers.
Sort:
By area:
- 2023DepGraph: Towards Any Structural Pruningcited by 202
- 2024A Survey of Large Language Models for Financial Applications: Progress, Prospects and Challengescited by 86
- 2024TKAN: Temporal Kolmogorov-Arnold Networkscited by 70
- 2024A Temporal Kolmogorov-Arnold Transformer for Time Series Forecastingcited by 50
- 2022Overview of Deep Learning-based CSI Feedback in Massive MIMO Systemscited by 35
- 2022Vision Transformers for Action Recognition: A Surveycited by 25
- 2022How Crucial is Transformer in Decision Transformer?cited by 14
- 2022VQA and Visual Reasoning: An Overview of Recent Datasets, Methods and Challengescited by 14
- 2023PersianLLaMA: Towards Building First Persian Large Language Modelcited by 14
- 2024TaxoLLaMA: WordNet-based Model for Solving Multiple Lexical Semantic Taskscited by 14
- 2023Multi-Modal Deep Learning for Credit Rating Prediction Using Text and Numerical Data Streamscited by 13
- 2021MalBERT: Using Transformers for Cybersecurity and Malicious Software Detectioncited by 12
38 more
- 2024Artificial Intelligence for Operations Research: Revolutionizing the Operations Research Processcited by 11
- 2023Recurrent Neural Networks and Long Short-Term Memory Networks: Tutorial and Surveycited by 10
- 2023Transformation vs Tradition: Artificial General Intelligence (AGI) for Arts and Humanitiescited by 9
- 2022All You Need In Sign Language Productioncited by 8
- 2022Synthesizing Rolling Bearing Fault Samples in New Conditions: A framework based on a modified CGANcited by 8
- 2023JOADAA: joint online action detection and action anticipationcited by 7
- 2024Generative AI Agents in Autonomous Machines: A Safety Perspectivecited by 7
- 2023Predicting COVID-19 pandemic by spatio-temporal graph neural networks: A New Zealand's studycited by 6
- 2023Latent Representation and Simulation of Markov Processes via Time-Lagged Information Bottleneckcited by 6
- 2024Machine Learning on Dynamic Graphs: A Survey on Applicationscited by 4
- 2024Research and application of artificial intelligence based webshell detection model: A literature reviewcited by 4
- 2025ConFit v2: Improving Resume-Job Matching using Hypothetical Resume Embedding and Runner-Up Hard-Negative Miningcited by 4
- 2025Improving the Serving Performance of Multi-LoRA Large Language Models via Efficient LoRA and KV Cache Managementcited by 4
- 2026Real-Time Sensing of Inaccessible Physical Fields via an Edge-Deployable Hardware-Portable Graph Neural Operatorcited by 4
- 2022RESAM: Requirements Elicitation and Specification for Deep-Learning Anomaly Models with Applications to UAV Flight Controllerscited by 3
- 2023A Review of Hybrid and Ensemble in Deep Learning for Natural Language Processingcited by 3
- 2024Domain Adaptation for Time series Transformers using One-step fine-tuningcited by 3
- 2024ML KPI Prediction in 5G and B5G Networkscited by 3
- 2025From Black Box to Insight: Explainable AI for Extreme Event Preparednesscited by 3
- 2021DeepWORD: A GCN-based Approach for Owner-Member Relationship Detection in Autonomous Drivingcited by 2
- 2021End-to-end LSTM based estimation of volcano event epicenter localizationcited by 2
- 2024Large Language Models are Few-shot Generators: Proposing Hybrid Prompt Algorithm To Generate Webshell Escape Samplescited by 2
- 2024A Systematic Review on Sleep Stage Classification and Sleep Disorder Detection Using Artificial Intelligencecited by 2
- 2024On the choice of the non-trainable internal weights in random feature mapscited by 2
- 2025Joint Flow And Feature Refinement Using Attention For Video Restorationcited by 2
- 2025The Epistemological Consequences of Large Language Models: Rethinking collective intelligence and institutional knowledgecited by 2
- 2021Pastprop-RNN: improved predictions of the future by correcting the pastcited by 1
- 2022Res-CNN-BiLSTM Network for overcoming Mental Health Disturbances caused due to Cyberbullying through Social Mediacited by 1
- 2022A Case Report On The "A.I. Locked-In Problem": social concerns with modern NLPcited by 1
- 2023A two stages Deep Learning Architecture for Model Reduction of Parametric Time-Dependent Problemscited by 1
- 2023Insert or Attach: Taxonomy Completion via Box Embeddingcited by 1
- 2023MASON-NLP at eRisk 2023: Deep Learning-Based Detection of Depression Symptoms from Social Media Textscited by 1
- 2023Benchmarking Toxic Molecule Classification using Graph Neural Networks and Few Shot Learningcited by 1
- 2024ConFit: Improving Resume-Job Matching using Data Augmentation and Contrastive Learningcited by 1
- 2024SISSA: Real-time Monitoring of Hardware Functional Safety and Cybersecurity with In-vehicle SOME/IP Ethernet Trafficcited by 1
- 2024Predicting Energy Budgets in Droplet Dynamics: A Recurrent Neural Network Approachcited by 1
- 2024Exploiting Individual Graph Structures to Enhance Ecological Momentary Assessment (EMA) Forecastingcited by 1
- 2024MMASD+: A Novel Dataset for Privacy-Preserving Behavior Analysis of Children with Autism Spectrum Disordercited by 1
50 most cited of 103 All 103 (JSON)
- 2026AI-based detection of worsening heart failure from low-resolution telemonitoring data24 Sep 2026
- 2026Urdu Katib Handwritten Dataset: A Historical Document Dataset for Offline Urdu Handwritten Text Recognition with CRNN-Based Baseline Evaluation17 Jun 2026
- 2026Risk Averse Alert Prioritization for IDS Using Subnormal Gaussian Fuzzy Models26 May 2026
- 2026Exploitation of Hidden Context in Dynamic Movement Forecasting: A Neural Network Journey from Recurrent to Graph Neural Networks and General Purpose Transformers14 May 2026
- 2026BEAM: Bi-level Memory-adaptive Algorithmic Evolution for LLM-Powered Heuristic Design14 Apr 2026
- 2026Leveraging Large Language Models for Sentiment Analysis: Multi-Modal Analysis of Decentraland's MANA Token4 Apr 2026
- 2026Real-Time Sensing of Inaccessible Physical Fields via an Edge-Deployable Hardware-Portable Graph Neural Operator2 Apr 2026
- 2026Emotion-Aware Classroom Quality Assessment Leveraging IoT-Based Real-Time Student Monitoring17 Mar 2026
- 2026When Metrics Disagree: Automatic Similarity vs. LLM-as-a-Judge for Clinical Dialogue Evaluation27 Feb 2026
- 2026SpikySpace: A Spiking State Space Model for Energy-Efficient Time Series Forecasting2 Jan 2026
- 2025The Epistemological Consequences of Large Language Models: Rethinking collective intelligence and institutional knowledge22 Dec 2025
- 2025Exploring Machine Learning, Deep Learning, and Explainable AI Methods for Seasonal Precipitation Prediction in South America15 Dec 2025
38 more
- 2025A Granular Framework for Construction Material Price Forecasting: Econometric and Machine-Learning Approaches10 Dec 2025
- 2025From Black Box to Insight: Explainable AI for Extreme Event Preparedness17 Nov 2025
- 2025VOLTAGE: A Versatile Contrastive Learning based OCR Methodology for ultra low-resource scripts through Auto Glyph Feature Extraction12 Oct 2025
- 2025DiffInk: Glyph- and Style-Aware Latent Diffusion Transformer for Text to Online Handwriting Generation28 Sep 2025
- 2025Dynamic Novel View Synthesis in High Dynamic Range26 Sep 2025
- 2025LEMs: A Primer On Large Execution Models21 Sep 2025
- 2025Assessing Classical Machine Learning and Transformer-based Approaches for Detecting AI-Generated Research Text20 Sep 2025
- 2025Automating the Deep Space Network Data Systems; A Case Study in Adaptive Anomaly Detection through Agentic AI28 Aug 2025
- 2025Differential-UMamba: Rethinking Tumor Segmentation Under Limited Data Scenarios24 Jul 2025
- 2025Neural Inhibition Improves Dynamic Routing and Mixture of Experts3 Jul 2025
- 2025Joint Flow And Feature Refinement Using Attention For Video Restoration22 May 2025
- 2025PAPN: Proximity Attention Encoder and Pointer Network Decoder for Parcel Pickup Route Prediction30 Apr 2025
- 2025Axial-UNet: A Neural Weather Model for Precipitation Nowcasting28 Apr 2025
- 2025Improving the Serving Performance of Multi-LoRA Large Language Models via Efficient LoRA and KV Cache Management19 Apr 2025
- 2025Hall Effect Thruster Forecasting using a Topological Approach for Data Assimilation8 Apr 2025
- 2025Shape Modeling of Longitudinal Medical Images: From Diffeomorphic Metric Mapping to Deep Learning27 Mar 2025
- 2025Controllable Latent Diffusion for Traffic Simulation14 Mar 2025
- 2025HGO-YOLO: Advancing Anomaly Behavior Detection with Hierarchical Features and Lightweight Optimized Detection10 Mar 2025
- 2025A Supervised Machine-Learning Approach For Turboshaft Engine Dynamic Modeling Under Real Flight Conditions19 Feb 2025
- 2025ConFit v2: Improving Resume-Job Matching using Hypothetical Resume Embedding and Runner-Up Hard-Negative Mining17 Feb 2025
- 2025Likelihood-Free Estimation for Spatiotemporal Hawkes processes with missing data and application to predictive policing10 Feb 2025
- 2025Machine Learning and statistical classification of CRISPR-Cas12a diagnostic assays8 Jan 2025
- 2025GNN-based Decentralized Perception in Multirobot Systems for Predicting Worker Actions8 Jan 2025
- 2024When Mamba Meets xLSTM: An Efficient and Precise Method with the xLSTM-VMUNet Model for Skin lesion Segmentation14 Nov 2024
- 2024KLCBL: An Improved Police Incident Classification Model11 Nov 2024
- 2024Generative AI Agents in Autonomous Machines: A Safety Perspective20 Oct 2024
- 2024SwiftQueue: Optimizing Low-Latency Applications with Swift Packet Queuing8 Oct 2024
- 2024Model Comparisons: XNet Outperforms KAN2 Oct 2024
- 2024Hybridization of Persistent Homology with Neural Networks for Time-Series Prediction: A Case Study in Wave Height3 Sep 2024
- 2024C-RADAR: A Centralized Deep Learning System for Intrusion Detection in Software Defined Networks30 Aug 2024
- 2024MMASD+: A Novel Dataset for Privacy-Preserving Behavior Analysis of Children with Autism Spectrum Disorder27 Aug 2024
- 2024On the choice of the non-trainable internal weights in random feature maps7 Aug 2024
- 2024Deep self-supervised learning with visualisation for automatic gesture recognition18 Jun 2024
- 2024A Survey of Large Language Models for Financial Applications: Progress, Prospects and Challenges15 Jun 2024
- 2024A Temporal Kolmogorov-Arnold Transformer for Time Series Forecasting4 Jun 2024
- 2024A Systematic Review on Sleep Stage Classification and Sleep Disorder Detection Using Artificial Intelligence17 May 2024
- 2024TKAN: Temporal Kolmogorov-Arnold Networks12 May 2024
- 2024Research and application of artificial intelligence based webshell detection model: A literature review28 Apr 2024
50 newest of 103 All 103 (JSON)
- 2022How Crucial is Transformer in Decision Transformer?cited by 14
- 2022How Crucial is Transformer in Decision Transformer?26 Nov 2022
- 2023DepGraph: Towards Any Structural Pruningcited by 202
- 2024A Survey of Large Language Models for Financial Applications: Progress, Prospects and Challengescited by 86
- 2024TKAN: Temporal Kolmogorov-Arnold Networkscited by 70
- 2024A Temporal Kolmogorov-Arnold Transformer for Time Series Forecastingcited by 50
- 2022Overview of Deep Learning-based CSI Feedback in Massive MIMO Systemscited by 35
- 2022Vision Transformers for Action Recognition: A Surveycited by 25
- 2023PersianLLaMA: Towards Building First Persian Large Language Modelcited by 14
- 2024TaxoLLaMA: WordNet-based Model for Solving Multiple Lexical Semantic Taskscited by 14
- 2023Multi-Modal Deep Learning for Credit Rating Prediction Using Text and Numerical Data Streamscited by 13
- 2021MalBERT: Using Transformers for Cybersecurity and Malicious Software Detectioncited by 12
- 2024Artificial Intelligence for Operations Research: Revolutionizing the Operations Research Processcited by 11
- 2023Recurrent Neural Networks and Long Short-Term Memory Networks: Tutorial and Surveycited by 10
12 most cited of 94 All 94 (JSON)
- 2026AI-based detection of worsening heart failure from low-resolution telemonitoring data24 Sep 2026
- 2026Urdu Katib Handwritten Dataset: A Historical Document Dataset for Offline Urdu Handwritten Text Recognition with CRNN-Based Baseline Evaluation17 Jun 2026
- 2026Risk Averse Alert Prioritization for IDS Using Subnormal Gaussian Fuzzy Models26 May 2026
- 2026Exploitation of Hidden Context in Dynamic Movement Forecasting: A Neural Network Journey from Recurrent to Graph Neural Networks and General Purpose Transformers14 May 2026
- 2026BEAM: Bi-level Memory-adaptive Algorithmic Evolution for LLM-Powered Heuristic Design14 Apr 2026
- 2026Leveraging Large Language Models for Sentiment Analysis: Multi-Modal Analysis of Decentraland's MANA Token4 Apr 2026
- 2026Real-Time Sensing of Inaccessible Physical Fields via an Edge-Deployable Hardware-Portable Graph Neural Operator2 Apr 2026
- 2026Emotion-Aware Classroom Quality Assessment Leveraging IoT-Based Real-Time Student Monitoring17 Mar 2026
- 2026When Metrics Disagree: Automatic Similarity vs. LLM-as-a-Judge for Clinical Dialogue Evaluation27 Feb 2026
- 2026SpikySpace: A Spiking State Space Model for Energy-Efficient Time Series Forecasting2 Jan 2026
- 2025Exploring Machine Learning, Deep Learning, and Explainable AI Methods for Seasonal Precipitation Prediction in South America15 Dec 2025
- 2025A Granular Framework for Construction Material Price Forecasting: Econometric and Machine-Learning Approaches10 Dec 2025
12 newest of 94 All 94 (JSON)