Ask Me Anything: Dynamic Memory Networks for Natural Language Processing
Not on the map. Why?
Abstract (arXiv)
Most tasks in natural language processing can be cast into question answering (QA) problems over language input. We introduce the dynamic memory network (DMN), a neural network architecture which processes input sequences and questions, forms episodic memories, and generates relevant answers. Questions trigger an iterative attention process which allows the model to condition its attention on the inputs and the result of previous iterations. These results are then reasoned over in a hierarchical recurrent sequence model to generate answers. The DMN can be trained end-to-end and obtains state-of-the-art results on several types of tasks and datasets: question answering (Facebook's bAbI dataset), text classification for sentiment analysis (Stanford Sentiment Treebank) and sequence modeling for part-of-speech tagging (WSJ-PTB). The training for these different tasks relies exclusively on trained word vector representations and input-question-answer triplets.
Key facts. Cited by 116 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Jun 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 1; 2019: 0; 2020: 0; 2021: 42; 2022: 32; 2023: 24; 2024: 11; 2025: 5; 2026: 1.
116 papers.
Sort:
By area:
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,122
- 2022OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalizationcited by 235
- 2021Going Full-TILT Boogie on Document Understanding with Text-Image-Layout Transformercited by 134
- 2021Advances and Challenges in Conversational Recommender Systems: A Surveycited by 118
- 2022MeMOT: Multi-Object Tracking with Memorycited by 113
- 2022Training Language Models with Memory Augmentationcited by 112
- 2021MeGA-CDA: Memory Guided Attention for Category-Aware Unsupervised Domain Adaptive Object Detectioncited by 106
- 2021LFPT5: A Unified Framework for Lifelong Few-shot Language Learning Based on Prompt Tuning of T5cited by 103
- 2023Lift Yourself Up: Retrieval-augmented Text Generation with Self Memorycited by 103
- 2021STMTrack: Template-free Visual Tracking with Space-time Memory Networkscited by 91
38 more
- 2022Remember Intentions: Retrospective-Memory-based Trajectory Predictioncited by 86
- 2021Hierarchical Memory Matching Network for Video Object Segmentationcited by 72
- 2021Open-Domain, Content-based, Multi-modal Fact-checking of Out-of-Context Images via Online Resourcescited by 71
- 2023Large Language Models can Learn Rulescited by 66
- 2022When Physics Meets Machine Learning: A Survey of Physics-Informed Machine Learningcited by 64
- 2021Attention, please! A survey of Neural Attention Models in Deep Learningcited by 50
- 2024Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Surveycited by 50
- 2021HVPR: Hybrid Voxel-Point Representation for Single-stage 3D Object Detectioncited by 47
- 2021Auto-Encoding Knowledge Graph for Unsupervised Medical Report Generationcited by 47
- 2021Towards General Purpose Vision Systemscited by 46
- 2021SQUID: Deep Feature In-Painting for Unsupervised Anomaly Detectioncited by 34
- 2022DialogueNeRF: Towards Realistic Avatar Face-to-Face Conversation Video Generationcited by 30
- 2022Using natural language prompts for machine translationcited by 27
- 2022Heroes, Villains, and Victims, and GPT-3: Automated Extraction of Character Roles Without Training Datacited by 27
- 2024Automated Data Curation for Robust Language Model Fine-Tuningcited by 27
- 2022SMEMO: Social Memory for Trajectory Forecastingcited by 26
- 2023A Survey on User Behavior Modeling in Recommender Systemscited by 26
- 2023MEMTO: Memory-guided Transformer for Multivariate Time Series Anomaly Detectioncited by 26
- 2023MAMo: Leveraging Memory and Attention for Monocular Video Depth Estimationcited by 24
- 2023From Image to Language: A Critical Analysis of Visual Question Answering (VQA) Approaches, Challenges, and Opportunitiescited by 24
- 2021MV-TON: Memory-based Video Virtual Try-on networkcited by 23
- 2022Memories are One-to-Many Mapping Alleviators in Talking Face Generationcited by 22
- 2021Memory-guided Unsupervised Image-to-image Translationcited by 21
- 2021GNN is a Counter? Revisiting GNN for Question Answeringcited by 21
- 2023Discovering Spatio-Temporal Rationales for Video Question Answeringcited by 21
- 2022Visual Anomaly Detection Via Partition Memory Bank Module and Error Estimationcited by 20
- 2021A Few More Examples May Be Worth Billions of Parameterscited by 19
- 2021The NLP Cookbook: Modern Recipes for Transformer based Deep Learning Architecturescited by 16
- 2022STable: Table Generation Framework for Encoder-Decoder Modelscited by 15
- 2022Multi-Step Deductive Reasoning Over Natural Language: An Empirical Study on Out-of-Distribution Generalisationcited by 15
- 2021Cognitive Visual Commonsense Reasoning Using Dynamic Working Memorycited by 14
- 2022VQA and Visual Reasoning: An Overview of Recent Datasets, Methods and Challengescited by 14
- 2021Does Head Label Help for Long-Tailed Multi-Label Text Classificationcited by 13
- 2021Adaptive Knowledge-Enhanced Bayesian Meta-Learning for Few-shot Event Detectioncited by 13
- 2023In-Context Exemplars as Clues to Retrieving from Large Associative Memorycited by 13
- 2024Exploiting Structural Consistency of Chest Anatomy for Unsupervised Anomaly Detection in Radiography Imagescited by 13
- 2021Knowledge-driven Natural Language Understanding of English Text and its Applicationscited by 12
- 2022Motion-aware Memory Network for Fast Video Salient Object Detectioncited by 12
50 most cited of 116 All 116 (JSON)
- 2026Different Changes Require Different Reasoning: Change-Type-Specialized Experts for Robust Change Captioning1 Sep 2026
- 2025HEAD-QA v2: Expanding a Healthcare Benchmark for Reasoning19 Nov 2025
- 2025Generative AI in Depth: A Survey of Recent Advances, Model Variants, and Real-World Applications23 Oct 2025
- 2025Label-semantics Aware Generative Approach for Domain-Agnostic Multilabel Classification7 Jun 2025
- 2025Direct Prediction Set Minimization via Bilevel Conformal Classifier Training7 Jun 2025
- 2025Representation Discrepancy Bridging Method for Remote Sensing Image-Text Retrieval22 May 2025
- 2024Learning Group Interactions and Semantic Intentions for Multi-Object Trajectory Prediction20 Dec 2024
- 2024Squeeze-and-Remember Block1 Oct 2024
- 2024Automatic Scene Generation: State-of-the-Art Techniques, Models, Datasets, Challenges, and Future Prospects14 Sep 2024
- 2024Distinguish Confusion in Legal Judgment Prediction via Revised Relation Knowledge18 Aug 2024
- 2024MaxMind: A Memory Loop Network to Enhance Software Productivity based on Large Language Models7 Aug 2024
- 2024Retrieval-Enhanced Machine Learning: Synthesis and Opportunities17 Jul 2024
38 more
- 2024Automated Data Curation for Robust Language Model Fine-Tuning19 Mar 2024
- 2024Exploiting Structural Consistency of Chest Anatomy for Unsupervised Anomaly Detection in Radiography Images13 Mar 2024
- 2024KeNet:Knowledge-enhanced Doc-Label Attention Network for Multi-label text classification4 Mar 2024
- 2024Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Survey8 Feb 2024
- 2024Uncovering the human motion pattern: Pattern Memory-based Diffusion Model for Trajectory Prediction5 Jan 2024
- 2023MEMTO: Memory-guided Transformer for Multivariate Time Series Anomaly Detection5 Dec 2023
- 2023In-Context Exemplars as Clues to Retrieving from Large Associative Memory6 Nov 2023
- 2023From Image to Language: A Critical Analysis of Visual Question Answering (VQA) Approaches, Challenges, and Opportunities1 Nov 2023
- 2023Large Language Models can Learn Rules10 Oct 2023
- 2023VPA: Fully Test-Time Visual Prompt Adaptation26 Sep 2023
- 2023Syntax Tree Constrained Graph Network for Visual Question Answering17 Sep 2023
- 2023The Paradigm Shifts in Artificial Intelligence2 Aug 2023
- 2023Universal Recurrent Event Memories for Streaming Data28 Jul 2023
- 2023Dynamic Analysis and an Eigen Initializer for Recurrent Neural Networks28 Jul 2023
- 2023MAMo: Leveraging Memory and Attention for Monocular Video Depth Estimation26 Jul 2023
- 2023Discovering Spatio-Temporal Rationales for Video Question Answering22 Jul 2023
- 2023Statement-based Memory for Neural Source Code Summarization21 Jul 2023
- 2023Decoding the Enigma: Benchmarking Humans and AIs on the Many Facets of Working Memory20 Jul 2023
- 2023A Comprehensive Review of State-of-The-Art Methods for Java Code Generation from Natural Language Text10 Jun 2023
- 2023Lift Yourself Up: Retrieval-augmented Text Generation with Self Memory3 May 2023
- 2023Label Dependencies-aware Set Prediction Networks for Multi-label Text Classification14 Apr 2023
- 2023Adaptive Human Matting for Dynamic Videos12 Apr 2023
- 2023ImageCaptioner2: Image Captioner for Image Captioning Bias Amplification Assessment10 Apr 2023
- 2023Rethinking Visual Prompt Learning as Masked Visual Token Modeling9 Mar 2023
- 2023A Survey on User Behavior Modeling in Recommender Systems22 Feb 2023
- 2023Scalable Prompt Generation for Semi-supervised Learning with Language Models18 Feb 2023
- 2023BERT-ERC: Fine-tuning BERT is Enough for Emotion Recognition in Conversation17 Jan 2023
- 2023A Brain-inspired Memory Transformation based Differentiable Neural Computer for Reasoning-based Question Answering7 Jan 2023
- 2023Follow the Timeline! Generating Abstractive and Extractive Timeline Summary in Chronological Order2 Jan 2023
- 2022VQA and Visual Reasoning: An Overview of Recent Datasets, Methods and Challenges26 Dec 2022
- 2022OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization22 Dec 2022
- 2022Memories are One-to-Many Mapping Alleviators in Talking Face Generation9 Dec 2022
- 2022Pairwise Instance Relation Augmentation for Long-tailed Multi-label Text Classification19 Nov 2022
- 2022What Images are More Memorable to Machines?14 Nov 2022
- 2022ConEntail: An Entailment-based Framework for Universal Zero and Few Shot Classification with Supervised Contrastive Pretraining14 Oct 2022
- 2022Prompt Generation Networks for Input-Space Adaptation of Frozen Vision Transformers12 Oct 2022
- 2022Multifaceted Hierarchical Report Identification for Non-Functional Bugs in Deep Learning Frameworks4 Oct 2022
- 2022Extending Compositional Attention Networks for Social Reasoning in Videos3 Oct 2022
50 newest of 116 All 116 (JSON)
- 2022Multi-Step Deductive Reasoning Over Natural Language: An Empirical Study on Out-of-Distribution Generalisationcited by 15
- 2022VQA and Visual Reasoning: An Overview of Recent Datasets, Methods and Challengescited by 14
- 2022Attention Mechanism based Cognition-level Scene Understandingcited by 0
- 2025HEAD-QA v2: Expanding a Healthcare Benchmark for Reasoningcited by 0
- 2025HEAD-QA v2: Expanding a Healthcare Benchmark for Reasoning19 Nov 2025
- 2022VQA and Visual Reasoning: An Overview of Recent Datasets, Methods and Challenges26 Dec 2022
- 2022Multi-Step Deductive Reasoning Over Natural Language: An Empirical Study on Out-of-Distribution Generalisation28 Jul 2022
- 2022Attention Mechanism based Cognition-level Scene Understanding17 Apr 2022
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,122
- 2022OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalizationcited by 235
- 2021Going Full-TILT Boogie on Document Understanding with Text-Image-Layout Transformercited by 134
- 2021Advances and Challenges in Conversational Recommender Systems: A Surveycited by 118
- 2022MeMOT: Multi-Object Tracking with Memorycited by 113
- 2022Training Language Models with Memory Augmentationcited by 112
- 2021MeGA-CDA: Memory Guided Attention for Category-Aware Unsupervised Domain Adaptive Object Detectioncited by 106
- 2021LFPT5: A Unified Framework for Lifelong Few-shot Language Learning Based on Prompt Tuning of T5cited by 103
- 2021STMTrack: Template-free Visual Tracking with Space-time Memory Networkscited by 91
- 2022Remember Intentions: Retrospective-Memory-based Trajectory Predictioncited by 86
12 most cited of 108 All 108 (JSON)
- 2026Different Changes Require Different Reasoning: Change-Type-Specialized Experts for Robust Change Captioning1 Sep 2026
- 2025Label-semantics Aware Generative Approach for Domain-Agnostic Multilabel Classification7 Jun 2025
- 2025Direct Prediction Set Minimization via Bilevel Conformal Classifier Training7 Jun 2025
- 2025Representation Discrepancy Bridging Method for Remote Sensing Image-Text Retrieval22 May 2025
- 2024Learning Group Interactions and Semantic Intentions for Multi-Object Trajectory Prediction20 Dec 2024
- 2024Squeeze-and-Remember Block1 Oct 2024
- 2024Automatic Scene Generation: State-of-the-Art Techniques, Models, Datasets, Challenges, and Future Prospects14 Sep 2024
- 2024Distinguish Confusion in Legal Judgment Prediction via Revised Relation Knowledge18 Aug 2024
- 2024MaxMind: A Memory Loop Network to Enhance Software Productivity based on Large Language Models7 Aug 2024
- 2024Retrieval-Enhanced Machine Learning: Synthesis and Opportunities17 Jul 2024
- 2024Automated Data Curation for Robust Language Model Fine-Tuning19 Mar 2024
- 2024Exploiting Structural Consistency of Chest Anatomy for Unsupervised Anomaly Detection in Radiography Images13 Mar 2024
12 newest of 108 All 108 (JSON)