One-shot Learning with Memory-Augmented Neural Networks
Not on the map. Why?
Abstract (arXiv)
Despite recent breakthroughs in the applications of deep neural networks, one setting that presents a persistent challenge is that of "one-shot learning." Traditional gradient-based networks require a lot of data to learn, often through extensive iterative training. When new data is encountered, the models must inefficiently relearn their parameters to adequately incorporate the new information without catastrophic interference. Architectures with augmented memory capacities, such as Neural Turing Machines (NTMs), offer the ability to quickly encode and retrieve new information, and hence can potentially obviate the downsides of conventional models. Here, we demonstrate the ability of a memory-augmented neural network to rapidly assimilate new data, and leverage this data to make accurate predictions after only a few samples. We also introduce a new method for accessing an external memory that focuses on memory content, unlike previous methods that additionally use memory location-based focusing mechanisms.
Key facts. Cited by 60 papers in the map (data through 14 Oct 2026). First posted on arXiv 19 May 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 1; 2019: 0; 2020: 0; 2021: 25; 2022: 14; 2023: 8; 2024: 3; 2025: 7; 2026: 2.
60 papers.
Sort:
By area:
- 2021Learning To Count Everythingcited by 150
- 2025Towards System 2 Reasoning in LLMs: Learning How to Think With Meta Chain-of-Thoughtcited by 109
- 2022Learning from Few Examples: A Summary of Approaches to Few-Shot Learningcited by 86
- 2021Mining Latent Classes for Few-shot Segmentationcited by 69
- 2022Exemplar Free Class Agnostic Countingcited by 32
- 2021Instant One-Shot Word-Learning for Context-Specific Neural Sequence-to-Sequence Speech Recognitioncited by 30
- 2021Deep Reinforcement Learning Versus Evolution Strategies: A Comparative Surveycited by 28
- 2021Learning Kernel-Smoothed Machine Translation with Retrieved Examplescited by 25
- 2022Cross-Domain Video Anomaly Detection without Target Domain Adaptationcited by 20
- 2023Learning to Extrapolate: A Transductive Approachcited by 19
- 2023One Adapter for All Programming Languages? Adapter Tuning for Code Search and Summarizationcited by 16
- 2023Traveling Waves Encode the Recent Past and Enhance Sequence Learningcited by 16
38 more
- 2025FSPO: Few-Shot Optimization of Synthetic Preferences Personalizes to Real Userscited by 15
- 2021OLED: One-Class Learned Encoder-Decoder Network with Adversarial Context Masking for Novelty Detectioncited by 14
- 2022Continuous-Time Meta-Learning with Forward Mode Differentiationcited by 12
- 2021Unsupervised Outlier Detection using Memory and Contrastive Learningcited by 11
- 2021MASTAF: A Model-Agnostic Spatio-Temporal Attention Fusion Network for Few-shot Video Classificationcited by 8
- 2021On the Importance of Firth Bias Reduction in Few-Shot Classificationcited by 7
- 2022Label-enhanced Prototypical Network with Contrastive Learning for Multi-label Few-shot Aspect Category Detectioncited by 7
- 2018Shared Multi-Task Imitation Learning for Indoor Self-Navigationcited by 5
- 2021Grid Cell Path Integration For Movement-Based Visual Object Recognitioncited by 5
- 2021Personalizing Pre-trained Modelscited by 5
- 2022Rethinking Task-Incremental Learning Baselinescited by 4
- 2022A Flexible Nadaraya-Watson Head Can Offer Explainable and Calibrated Classificationcited by 4
- 2023Boosting Few-Shot Text Classification via Distribution Estimationcited by 4
- 2023How to Do Machine Learning with Small Data? -- A Review from an Industrial Perspectivecited by 3
- 2021Combat Data Shift in Few-shot Learning with Knowledge Graphcited by 2
- 2021Hierarchical Representation based Query-Specific Prototypical Network for Few-Shot Image Classificationcited by 2
- 2021Updatable Siamese Tracker with Two-stage One-shot Learningcited by 2
- 2022Memory-guided Image De-raining Using Time-Lapse Datacited by 2
- 2022Self-Programming Artificial Intelligence Using Code-Generating Language Modelscited by 2
- 2023Learning Functional Transductioncited by 2
- 2024From Language Models to Practical Self-Improving Computer Agentscited by 2
- 2025Personalized Artificial General Intelligence (AGI) via Neuroscience-Inspired Continuous Learning Systemscited by 2
- 2025Deciphering Trajectory-Aided LLM Reasoning: An Optimization Perspectivecited by 2
- 2021An Empirical Comparison of Deep Learning Models for Knowledge Tracing on Large-Scale Datasetcited by 1
- 2021Real-Time Visual Object Tracking via Few-Shot Learningcited by 1
- 2021Beyond Categorical Label Representations for Image Classificationcited by 1
- 2021Neural Network based on Automatic Differentiation Transformation of Numeric Iterate-to-Fixedpointcited by 1
- 2021One-shot Weakly-Supervised Segmentation in Medical Imagescited by 1
- 2022Generating Pseudo-labels Adaptively for Few-shot Model-Agnostic Meta-Learningcited by 1
- 2022A Unified Framework with Meta-dropout for Few-shot Learningcited by 1
- 2022Searching for Effective Multilingual Fine-Tuning Methods: A Case Study in Summarizationcited by 1
- 2023Towards Faster k-Nearest-Neighbor Machine Translationcited by 1
- 2025Attention is All You Need Until You Need Retentioncited by 1
- 2021Feature Representation in Deep Metric Embeddingscited by 0
- 2021OR-Net: Pointwise Relational Inference for Data Completion under Partial Observationcited by 0
- 2021Application of Deep Self-Attention in Knowledge Tracingcited by 0
- 2021Representation Memorization for Fast Learning New Knowledge without Forgettingcited by 0
- 2021Wide and Narrow: Video Prediction from Context and Motioncited by 0
50 most cited of 60 All 60 (JSON)
- 2026Intern-S2-Mobius: Foundation Model with Decoupled Knowledge and Reasoning14 Aug 2026
- 2026Active perception and disentangled representations allow continual, episodic zero and few-shot learning22 Feb 2026
- 2025THIRDEYE: Cue-Aware Monocular Depth Estimation via Brain-Inspired Multi-Stage Fusion25 Jun 2025
- 2025Deciphering Trajectory-Aided LLM Reasoning: An Optimization Perspective26 May 2025
- 2025Personalized Artificial General Intelligence (AGI) via Neuroscience-Inspired Continuous Learning Systems27 Apr 2025
- 2025FSPO: Few-Shot Optimization of Synthetic Preferences Personalizes to Real Users26 Feb 2025
- 2025Attention is All You Need Until You Need Retention15 Jan 2025
- 2025Towards System 2 Reasoning in LLMs: Learning How to Think With Meta Chain-of-Thought8 Jan 2025
- 2025Noise-Tolerant Hybrid Prototypical Learning with Noisy Web Data5 Jan 2025
- 2024MU-MAE: Multimodal Masked Autoencoders-Based One-Shot Learning8 Aug 2024
- 2024Learning-to-learn enables rapid learning with phase-change memory-based in-memory computing22 Apr 2024
- 2024From Language Models to Practical Self-Improving Computer Agents18 Apr 2024
38 more
- 2023Reconciling Shared versus Context-Specific Information in a Neural Network Model of Latent Causes13 Dec 2023
- 2023Towards Faster k-Nearest-Neighbor Machine Translation12 Dec 2023
- 2023How to Do Machine Learning with Small Data? -- A Review from an Industrial Perspective13 Nov 2023
- 2023Traveling Waves Encode the Recent Past and Enhance Sequence Learning3 Sep 2023
- 2023Learning to Extrapolate: A Transductive Approach27 Apr 2023
- 2023One Adapter for All Programming Languages? Adapter Tuning for Code Search and Summarization28 Mar 2023
- 2023Boosting Few-Shot Text Classification via Distribution Estimation26 Mar 2023
- 2023Learning Functional Transduction1 Feb 2023
- 2022Cross-Domain Video Anomaly Detection without Target Domain Adaptation14 Dec 2022
- 2022Searching for Effective Multilingual Fine-Tuning Methods: A Case Study in Summarization12 Dec 2022
- 2022A Flexible Nadaraya-Watson Head Can Offer Explainable and Calibrated Classification7 Dec 2022
- 2022A Unified Framework with Meta-dropout for Few-shot Learning12 Oct 2022
- 2022Generating Pseudo-labels Adaptively for Few-shot Model-Agnostic Meta-Learning9 Jul 2022
- 2022Label-enhanced Prototypical Network with Contrastive Learning for Multi-label Few-shot Aspect Category Detection14 Jun 2022
- 2022Exemplar Free Class Agnostic Counting27 May 2022
- 2022Rethinking Task-Incremental Learning Baselines23 May 2022
- 2022Self-Programming Artificial Intelligence Using Code-Generating Language Models30 Apr 2022
- 2022Reinforced Meta Active Learning9 Mar 2022
- 2022Learning from Few Examples: A Summary of Approaches to Few-Shot Learning7 Mar 2022
- 2022Continuous-Time Meta-Learning with Forward Mode Differentiation2 Mar 2022
- 2022Echofilter: A Deep Learning Segmentation Model Improves the Automation, Standardization, and Timeliness for Post-Processing Echosounder Data in Tidal Energy Streams19 Feb 2022
- 2022Memory-guided Image De-raining Using Time-Lapse Data6 Jan 2022
- 2021MASTAF: A Model-Agnostic Spatio-Temporal Attention Fusion Network for Few-shot Video Classification8 Dec 2021
- 2021One-shot Weakly-Supervised Segmentation in Medical Images21 Nov 2021
- 2021Neural Network based on Automatic Differentiation Transformation of Numeric Iterate-to-Fixedpoint30 Oct 2021
- 2021Latent Cognizance: What Machine Really Learns29 Oct 2021
- 2021Wide and Narrow: Video Prediction from Context and Motion22 Oct 2021
- 2021On the Importance of Firth Bias Reduction in Few-Shot Classification6 Oct 2021
- 2021Deep Reinforcement Learning Versus Evolution Strategies: A Comparative Survey28 Sep 2021
- 2021Learning Kernel-Smoothed Machine Translation with Retrieved Examples21 Sep 2021
- 2021Representation Memorization for Fast Learning New Knowledge without Forgetting28 Aug 2021
- 2021Unsupervised Outlier Detection using Memory and Contrastive Learning27 Jul 2021
- 2021Instant One-Shot Word-Learning for Context-Specific Neural Sequence-to-Sequence Speech Recognition5 Jul 2021
- 2021Personalizing Pre-trained Models2 Jun 2021
- 2021Application of Deep Self-Attention in Knowledge Tracing17 May 2021
- 2021OR-Net: Pointwise Relational Inference for Data Completion under Partial Observation2 May 2021
- 2021Updatable Siamese Tracker with Two-stage One-shot Learning30 Apr 2021
- 2021Learning To Count Everything16 Apr 2021
50 newest of 60 All 60 (JSON)
- 2021Learning To Count Everythingcited by 150
- 2022Learning from Few Examples: A Summary of Approaches to Few-Shot Learningcited by 86
- 2021Mining Latent Classes for Few-shot Segmentationcited by 69
- 2022Exemplar Free Class Agnostic Countingcited by 32
- 2021Instant One-Shot Word-Learning for Context-Specific Neural Sequence-to-Sequence Speech Recognitioncited by 30
- 2021Deep Reinforcement Learning Versus Evolution Strategies: A Comparative Surveycited by 28
- 2021Learning Kernel-Smoothed Machine Translation with Retrieved Examplescited by 25
- 2022Cross-Domain Video Anomaly Detection without Target Domain Adaptationcited by 20
- 2023Learning to Extrapolate: A Transductive Approachcited by 19
- 2023One Adapter for All Programming Languages? Adapter Tuning for Code Search and Summarizationcited by 16
- 2023Traveling Waves Encode the Recent Past and Enhance Sequence Learningcited by 16
- 2021OLED: One-Class Learned Encoder-Decoder Network with Adversarial Context Masking for Novelty Detectioncited by 14
12 most cited of 55 All 55 (JSON)
- 2026Intern-S2-Mobius: Foundation Model with Decoupled Knowledge and Reasoning14 Aug 2026
- 2026Active perception and disentangled representations allow continual, episodic zero and few-shot learning22 Feb 2026
- 2025THIRDEYE: Cue-Aware Monocular Depth Estimation via Brain-Inspired Multi-Stage Fusion25 Jun 2025
- 2025Personalized Artificial General Intelligence (AGI) via Neuroscience-Inspired Continuous Learning Systems27 Apr 2025
- 2025Attention is All You Need Until You Need Retention15 Jan 2025
- 2025Noise-Tolerant Hybrid Prototypical Learning with Noisy Web Data5 Jan 2025
- 2024MU-MAE: Multimodal Masked Autoencoders-Based One-Shot Learning8 Aug 2024
- 2024Learning-to-learn enables rapid learning with phase-change memory-based in-memory computing22 Apr 2024
- 2023Reconciling Shared versus Context-Specific Information in a Neural Network Model of Latent Causes13 Dec 2023
- 2023Towards Faster k-Nearest-Neighbor Machine Translation12 Dec 2023
- 2023How to Do Machine Learning with Small Data? -- A Review from an Industrial Perspective13 Nov 2023
- 2023Traveling Waves Encode the Recent Past and Enhance Sequence Learning3 Sep 2023
12 newest of 55 All 55 (JSON)