Data to 7 Oct 2026

Recurrent Neural Networks (RNNs): A gentle Introduction and Overview

arXiv 1912.05911 ↗First posted 23 Nov 2019cs.LG stat.MLcited by 68

Not on the map. Why?

Abstract (arXiv)

State-of-the-art solutions in the areas of "Language Modelling & Generating Text", "Speech Recognition", "Generating Image Descriptions" or "Video Tagging" have been using Recurrent Neural Networks as the foundation for their approaches. Understanding the underlying concepts is therefore of tremendous importance if we want to keep up with recent or upcoming publications in those areas. In this work we give a short overview over some of the most important concepts in the realm of Recurrent Neural Networks which enables readers to easily understand the fundamentals such as but not limited to "Backpropagation through Time" or "Long Short-Term Memory Units" as well as some of the more recent advances like the "Attention Mechanism" or "Pointer Networks". We also give recommendations for further reading regarding more complex topics where it is necessary.

Key facts. Cited by 68 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Nov 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 2; 2022: 3; 2023: 9; 2024: 16; 2025: 25; 2026: 13.

68 papers.

Sort:

By area:

2024Vision-Language Models for Medical Report Generation and Visual Question Answering: A Reviewcited by 121
2022Equivariant quantum circuits for learning on weighted graphscited by 41
2025Foundation Models for Time Series: A Surveycited by 19
2023Searching for High-Value Molecules Using Reinforcement Learning and Transformerscited by 18
2024Mamba in Vision: A Comprehensive Survey of Techniques and Applicationscited by 18
2025Large language models for artificial general intelligence (AGI): A survey of foundational principles and approachescited by 18
2023Forecasting steam mass flow in power plants using the parallel hybrid networkcited by 10
2023Hybrid quantum cycle generative adversarial network for small molecule generationcited by 8
2024CuriousLLM: Elevating Multi-Document Question Answering with LLM-Enhanced Knowledge Graph Reasoningcited by 7
2024OccamLLM: Fast and Exact Language Model Arithmetic in a Single Stepcited by 7
2025Evaluation of LLMs for mathematical problem solvingcited by 7
2021ChunkFormer: Learning Long Time Series with Multi-stage Chunked Transformercited by 4

38 more

2025Leveraging the Spatial Hierarchy: Coarse-to-fine Trajectory Generation via Cascaded Hybrid Diffusioncited by 4
2024Transfer Learning with Foundational Models for Time Series Forecasting using Low-Rank Adaptationscited by 3
2024Optimal Gradient Checkpointing for Sparse and Recurrent Architectures using Off-Chip Memorycited by 3
2025IM-BERT: Enhancing Robustness of BERT through the Implicit Euler Methodcited by 3
2023Spanish Built Factual Freectianary (Spanish-BFF): the first AI-generated free dictionarycited by 2
2023Spherical Position Encoding for Transformerscited by 2
2024SecureNet: A Comparative Study of DeBERTa and Large Language Models for Phishing Detectioncited by 2
2024Continual Low-Rank Scaled Dot-product Attentioncited by 2
2025Can Large Language Models Predict the Outcome of Judicial Decisions?cited by 2
2025GAMDTP: Dynamic Trajectory Prediction with Graph Attention Mamba Networkcited by 2
2025DyTTP: Trajectory Prediction with Normalization-Free Transformerscited by 2
2026Hidden State Poisoning Attacks against Mamba-based Language Modelscited by 2
2021Explainability-aided Domain Generalization for Image Classificationcited by 1
2023Data Generation for Post-OCR correction of Cyrillic handwritingcited by 1
2023A Survey of Classical And Quantum Sequence Modelscited by 1
2024Distribution-informed and wavelength-flexible data-driven photoacoustic oximetrycited by 1
2024Merged ChemProt-DrugProt for Relation Extraction from Biomedical Literaturecited by 1
2024C-RADAR: A Centralized Deep Learning System for Intrusion Detection in Software Defined Networkscited by 1
2025A Woman with a Knife or A Knife with a Woman? Measuring Directional Bias Amplification in Image Captionscited by 1
2025Outlook Towards Deployable Continual Learning for Particle Acceleratorscited by 1
2025Flexible and Efficient Spatio-Temporal Transformer for Sequential Visual Place Recognitioncited by 1
2025Towards Migrating Neural Network Implementationscited by 1
2025RRAEDy: Adaptive Latent Linearization of Nonlinear Dynamical Systemscited by 1
2026Process-of-Thought Reasoning for Videoscited by 1
2026When Metrics Disagree: Automatic Similarity vs. LLM-as-a-Judge for Clinical Dialogue Evaluationcited by 1
2026Quantum-Inspired Self-Attention in a Large Language Modelcited by 1
2022A Differential Attention Fusion Model Based on Transformer for Time Series Forecastingcited by 0
2022Introduction to the Artificial Intelligence that can be applied to the Network Automation Journeycited by 0
2023Physics-Informed Neural Networks for an optimal counterdiabatic quantum computationcited by 0
2023SurvTimeSurvival: Survival Analysis On The Patient With Multiple Visits/Recordscited by 0
2024Geotokens and Geotransformerscited by 0
2024Hybridization of Persistent Homology with Neural Networks for Time-Series Prediction: A Case Study in Wave Heightcited by 0
2024Pricing American Options using Machine Learning Algorithmscited by 0
2024Self-Driving Car Racing: Application of Deep Reinforcement Learningcited by 0
2024Shrinking the Giant : Quasi-Weightless Transformers for Low Energy Inferencecited by 0
2025Deep Learning for Ophthalmology: The State-of-the-Art and Future Trendscited by 0
2025Machine Learning-based Regional Cooling Demand Prediction with Optimised Dataset Partitioningcited by 0
2025A comparative study of deep learning and ensemble learning to extend the horizon of traffic forecastingcited by 0

50 most cited of 68 All 68 (JSON)