mlsanityData to 14 Oct 2026

Neural Episodic Control

arXiv 1703.01988 ↗First posted 6 Mar 2017cs.LG stat.MLcited by 151

Not on the map. Why?

Cited by 21 in Deep reinforcement learning methods, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Deep reinforcement learning methods attain super-human performance in a wide range of environments. Such methods are grossly inefficient, often taking orders of magnitudes more data than humans to achieve reasonable performance. We propose Neural Episodic Control: a deep reinforcement learning agent that is able to rapidly assimilate new experiences and act upon them. Our agent uses a semi-tabular representation of the value function: a buffer of past experience containing slowly changing state representations and rapidly updated estimates of the value function. We show across a wide range of environments that our agent learns significantly faster than other state-of-the-art, general purpose deep reinforcement learning agents.

Key facts. Cited by 151 papers in the map (data through 14 Oct 2026). First posted on arXiv 6 Mar 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2018: 2; 2019: 0; 2020: 2; 2021: 25; 2022: 26; 2023: 25; 2024: 17; 2025: 21; 2026: 33.

151 papers.

Sort:

By area:

  1. 2022Memory-Based Model Editing at Scalecited by 447
  2. 2023Cognitive Architectures for Language Agentscited by 429
  3. 2021Combinatorial optimization and reasoning with graph neural networkscited by 268
  4. 2018Self-Imitation Learningcited by 138
  5. 2021The Benchmark Lotterycited by 136
  6. 2026MemRL: Self-Evolving Agents via Runtime Reinforcement Learning on Episodic Memorycited by 129
  7. 2025Memento: Fine-tuning LLM Agents without Fine-tuning LLMscited by 127
  8. 2021Replay in Deep Learning: Current Approaches and Missing Biological Elementscited by 72
  9. 2024Human-inspired Episodic Memory for Infinite Context LLMscited by 62
  10. 2023Continual Learning: Applications and the Road Forwardcited by 59
  11. 2022Retrieval-Augmented Reinforcement Learningcited by 53
  12. 2021Episodic Multi-agent Reinforcement Learning with Curiosity-Driven Explorationcited by 49
38 more
  1. 2023A Survey on Causal Reinforcement Learningcited by 45
  2. 2021Offline Reinforcement Learning with Value-based Episodic Memorycited by 36
  3. 2025MemVerse: Multimodal Memory for Lifelong Learning Agentscited by 35
  4. 2021Iterative Bounding MDPs: Learning Interpretable Policies via Non-Interpretable Methodscited by 31
  5. 2021Rank the Episodes: A Simple Approach for Exploration in Procedurally-Generated Environmentscited by 28
  6. 2023The Relational Bottleneck as an Inductive Bias for Efficient Abstractioncited by 27
  7. 2022On Neural Architecture Inductive Biases for Relational Taskscited by 26
  8. 2018Generative Adversarial Self-Imitation Learningcited by 25
  9. 2022Large-Scale Retrieval for Reinforcement Learningcited by 24
  10. 2025Embodied AI: From LLMs to World Modelscited by 24
  11. 2021Generalizable Episodic Memory for Deep Reinforcement Learningcited by 23
  12. 2024Retrieval-Augmented Decision Transformer: External Memory for In-context RLcited by 21
  13. 2022Object Memory Transformer for Object Goal Navigationcited by 20
  14. 2021Deep Graph Memory Networks for Forgetting-Robust Knowledge Tracingcited by 17
  15. 2020DeepAveragers: Offline Reinforcement Learning by Solving Derived Non-Parametric MDPscited by 16
  16. 2022Navigating to Objects in Unseen Environments by Distance Predictioncited by 16
  17. 2022On the link between conscious function and general intelligence in humans and machinescited by 16
  18. 2025Episodic Novelty Through Temporal Distancecited by 16
  19. 2025Latent learning: episodic memory complements parametric learning by enabling flexible reuse of experiencescited by 15
  20. 2021Model-Based Episodic Memory Induces Dynamic Hybrid Controlscited by 14
  21. 2021Hierarchical Variational Memory for Few-shot Learning Across Domainscited by 14
  22. 2020Self-Imitation Learning via Generalized Lower Bound Q-learningcited by 13
  23. 2021Persistent Message Passingcited by 13
  24. 2022Zipfian environments for Reinforcement Learningcited by 13
  25. 2026Self-Evolving World Models for LLM Agent Planningcited by 13
  26. 2023Abstractors and relational cross-attention: An inductive bias for explicit relational reasoning in Transformerscited by 12
  27. 2021Theoretically Principled Deep RL Acceleration via Nearest Neighbor Function Approximationcited by 11
  28. 2022BATS: Best Action Trajectory Stitchingcited by 10
  29. 2023Unlocking the Power of Representations in Long-term Novelty-based Explorationcited by 9
  30. 2023Accountability in Offline Reinforcement Learning: Explaining Decisions with a Corpus of Examplescited by 9
  31. 2021Solving Continuous Control with Episodic Memorycited by 8
  32. 2022A Rubric for Human-like Agents and NeuroAIcited by 8
  33. 2025WebSight: A Vision-First Architecture for Robust Web Agentscited by 8
  34. 2023Neural Episodic Control with State Abstractioncited by 7
  35. 2023DEIR: Efficient and Robust Exploration through Discriminative-Model-Based Episodic Intrinsic Rewardscited by 7
  36. 2024MacroHFT: Memory Augmented Context-aware Reinforcement Learning On High Frequency Tradingcited by 7
  37. 2024Random Latent Exploration for Deep Reinforcement Learningcited by 6
  38. 2025Reasoning Under 1 Billion: Memory-Augmented Reinforcement Learning for Large Language Modelscited by 6

50 most cited of 151 All 151 (JSON)