Visual Question Answering with Memory-Augmented Networks
Not on the map. Why?
Abstract (arXiv)
In this paper, we exploit a memory-augmented neural network to predict accurate answers to visual questions, even when those answers occur rarely in the training set. The memory network incorporates both internal and external memory blocks and selectively pays attention to each training exemplar. We show that memory-augmented neural networks are able to maintain a relatively long-term memory of scarce training exemplars, which is important for visual question answering due to the heavy-tailed distribution of answers in a general VQA setting. Experimental results on two large-scale benchmark datasets show the favorable performance of the proposed algorithm with a comparison to state of the art.
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Jul 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 11; 2023: 6; 2024: 2; 2025: 1.
25 papers.
Sort:
By area:
- 2022Remember Intentions: Retrospective-Memory-based Trajectory Predictioncited by 86
- 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Surveycited by 74
- 2021Bridge to Answer: Structure-aware Graph Interaction Network for Video Question Answeringcited by 56
- 2021HVPR: Hybrid Voxel-Point Representation for Single-stage 3D Object Detectioncited by 47
- 2022Memory-Guided Semantic Learning Network for Temporal Sentence Groundingcited by 46
- 2022SMEMO: Social Memory for Trajectory Forecastingcited by 26
- 2021Cross Attentional Audio-Visual Fusion for Dimensional Emotion Recognitioncited by 19
- 2022Visual Perturbation-aware Collaborative Learning for Overcoming the Language Prior Problemcited by 18
- 2022Audio-Visual Fusion for Emotion Recognition in the Valence-Arousal Space Using Joint Cross-Attentioncited by 18
- 2022MetAug: Contrastive Learning via Meta Feature Augmentationcited by 15
- 2022VQA and Visual Reasoning: An Overview of Recent Datasets, Methods and Challengescited by 14
- 2023S3C: Semi-Supervised VQA Natural Language Explanation via Self-Critical Learningcited by 10
13 more
- 2025Hadamard product in deep learning: Introduction, Advances and Challengescited by 9
- 2023Follow the Timeline! Generating Abstractive and Extractive Timeline Summary in Chronological Ordercited by 6
- 2023Towards More Faithful Natural Language Explanation Using Multi-Level Contrastive Learning in VQAcited by 5
- 2021Memory and attention in deep learningcited by 4
- 2023Audio-Visual Speaker Verification via Joint Cross-Attentioncited by 4
- 2022Relation Regularized Scene Graph Generationcited by 3
- 2022From Shallow to Deep: Compositional Reasoning over Graphs for Visual Question Answeringcited by 3
- 2023Multi-Clue Reasoning with Memory Augmentation for Knowledge-based Visual Question Answeringcited by 2
- 2021Memory Wrap: a Data-Efficient and Interpretable Extension to Image Classification Modelscited by 1
- 2022Mitigating Data Redundancy to Revitalize Transformer-based Long-Term Time Series Forecasting Systemcited by 1
- 2022Text-Aware Dual Routing Network for Visual Question Answeringcited by 0
- 2023Cross-Modal Reasoning with Event Correlation for Video Question Answeringcited by 0
- 2024Retrieval-Augmented Natural Language Reasoning for Explainable Visual Question Answeringcited by 0
- 2025Hadamard product in deep learning: Introduction, Advances and Challenges17 Apr 2025
- 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Survey26 Nov 2024
- 2024Retrieval-Augmented Natural Language Reasoning for Explainable Visual Question Answering30 Aug 2024
- 2023Towards More Faithful Natural Language Explanation Using Multi-Level Contrastive Learning in VQA21 Dec 2023
- 2023Multi-Clue Reasoning with Memory Augmentation for Knowledge-based Visual Question Answering20 Dec 2023
- 2023Cross-Modal Reasoning with Event Correlation for Video Question Answering20 Dec 2023
- 2023Audio-Visual Speaker Verification via Joint Cross-Attention28 Sep 2023
- 2023S3C: Semi-Supervised VQA Natural Language Explanation via Self-Critical Learning5 Sep 2023
- 2023Follow the Timeline! Generating Abstractive and Extractive Timeline Summary in Chronological Order2 Jan 2023
- 2022VQA and Visual Reasoning: An Overview of Recent Datasets, Methods and Challenges26 Dec 2022
- 2022Text-Aware Dual Routing Network for Visual Question Answering17 Nov 2022
- 2022Audio-Visual Fusion for Emotion Recognition in the Valence-Arousal Space Using Joint Cross-Attention19 Sep 2022
13 more
- 2022Visual Perturbation-aware Collaborative Learning for Overcoming the Language Prior Problem24 Jul 2022
- 2022Mitigating Data Redundancy to Revitalize Transformer-based Long-Term Time Series Forecasting System16 Jul 2022
- 2022From Shallow to Deep: Compositional Reasoning over Graphs for Visual Question Answering25 Jun 2022
- 2022SMEMO: Social Memory for Trajectory Forecasting23 Mar 2022
- 2022Remember Intentions: Retrospective-Memory-based Trajectory Prediction22 Mar 2022
- 2022MetAug: Contrastive Learning via Meta Feature Augmentation10 Mar 2022
- 2022Relation Regularized Scene Graph Generation22 Feb 2022
- 2022Memory-Guided Semantic Learning Network for Temporal Sentence Grounding3 Jan 2022
- 2021Cross Attentional Audio-Visual Fusion for Dimensional Emotion Recognition9 Nov 2021
- 2021Memory and attention in deep learning3 Jul 2021
- 2021Memory Wrap: a Data-Efficient and Interpretable Extension to Image Classification Models1 Jun 2021
- 2021Bridge to Answer: Structure-aware Graph Interaction Network for Video Question Answering29 Apr 2021
- 2021HVPR: Hybrid Voxel-Point Representation for Single-stage 3D Object Detection2 Apr 2021
- 2022Remember Intentions: Retrospective-Memory-based Trajectory Predictioncited by 86
- 2021Bridge to Answer: Structure-aware Graph Interaction Network for Video Question Answeringcited by 56
- 2021HVPR: Hybrid Voxel-Point Representation for Single-stage 3D Object Detectioncited by 47
- 2022Memory-Guided Semantic Learning Network for Temporal Sentence Groundingcited by 46
- 2022SMEMO: Social Memory for Trajectory Forecastingcited by 26
- 2021Cross Attentional Audio-Visual Fusion for Dimensional Emotion Recognitioncited by 19
- 2022Visual Perturbation-aware Collaborative Learning for Overcoming the Language Prior Problemcited by 18
- 2022Audio-Visual Fusion for Emotion Recognition in the Valence-Arousal Space Using Joint Cross-Attentioncited by 18
- 2022MetAug: Contrastive Learning via Meta Feature Augmentationcited by 15
- 2023S3C: Semi-Supervised VQA Natural Language Explanation via Self-Critical Learningcited by 10
- 2025Hadamard product in deep learning: Introduction, Advances and Challengescited by 9
- 2023Follow the Timeline! Generating Abstractive and Extractive Timeline Summary in Chronological Ordercited by 6
12 most cited of 22 All 22 (JSON)
- 2025Hadamard product in deep learning: Introduction, Advances and Challenges17 Apr 2025
- 2023Towards More Faithful Natural Language Explanation Using Multi-Level Contrastive Learning in VQA21 Dec 2023
- 2023Multi-Clue Reasoning with Memory Augmentation for Knowledge-based Visual Question Answering20 Dec 2023
- 2023Cross-Modal Reasoning with Event Correlation for Video Question Answering20 Dec 2023
- 2023Audio-Visual Speaker Verification via Joint Cross-Attention28 Sep 2023
- 2023S3C: Semi-Supervised VQA Natural Language Explanation via Self-Critical Learning5 Sep 2023
- 2023Follow the Timeline! Generating Abstractive and Extractive Timeline Summary in Chronological Order2 Jan 2023
- 2022Text-Aware Dual Routing Network for Visual Question Answering17 Nov 2022
- 2022Audio-Visual Fusion for Emotion Recognition in the Valence-Arousal Space Using Joint Cross-Attention19 Sep 2022
- 2022Visual Perturbation-aware Collaborative Learning for Overcoming the Language Prior Problem24 Jul 2022
- 2022Mitigating Data Redundancy to Revitalize Transformer-based Long-Term Time Series Forecasting System16 Jul 2022
- 2022From Shallow to Deep: Compositional Reasoning over Graphs for Visual Question Answering25 Jun 2022
12 newest of 22 All 22 (JSON)