Exploring Nearest Neighbor Approaches for Image Captioning
Not on the map. Why?
Abstract (arXiv)
We explore a variety of nearest neighbor baseline approaches for image captioning. These approaches find a set of nearest neighbor images in the training set from which a caption may be borrowed for the query image. We select a caption for the query image by finding the caption that best represents the "consensus" of the set of candidate captions gathered from the nearest neighbor images. When measured by automatic evaluation metrics on the MS COCO caption evaluation server, these approaches perform as well as many recent approaches that generate novel captions. However, human studies show that a method that generates novel captions is still preferred over the nearest neighbor approach.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 May 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 3; 2023: 4; 2024: 3; 2025: 2; 2026: 2.
19 papers.
Sort:
By area:
- 2022Clotho-AQA: A Crowdsourced Dataset for Audio Question Answeringcited by 84
- 2021ReFormer: The Relational Transformer for Image Captioningcited by 23
- 2021Cross-Modal Retrieval Augmentation for Multi-Modal Classificationcited by 20
- 2023NICE: CVPR 2023 Challenge on Zero-shot Image Captioningcited by 9
- 2021Rethinking Nearest Neighbors for Visual Classificationcited by 6
- 2023Nearest Neighbors Meet Deep Neural Networks for Point Cloud Analysiscited by 5
- 2022FlowEval: A Consensus-Based Dialogue Evaluation Framework Using Segment Act Flowscited by 4
- 2023Set Prediction Guided by Semantic Concepts for Diverse Video Captioningcited by 4
- 20243AM: An Ambiguity-Aware Multi-Modal Machine Translation Datasetcited by 4
- 2022Diverse Image Captioning with Grounded Stylecited by 3
- 2024Image Captioning via Dynamic Path Customizationcited by 3
- 2023Borrowing Human Senses: Comment-Aware Self-Training for Social Media Multimodal Classificationcited by 2
7 more
- 2025Explaining the Success of Nearest Neighbor Methods in Predictioncited by 2
- 2024Pixels to Prose: Understanding the art of Image Captioningcited by 1
- 2021A Hybrid Model for Combining Neural Image Caption and k-Nearest Neighbor Approach for Image Captioningcited by 0
- 2021Neural Abstructions: Abstractions that Support Construction for Grounded Language Learningcited by 0
- 2025From Image Captioning to Visual Storytellingcited by 0
- 2026Caption Generation for Dongba Paintings via Prompt Learning and Semantic Fusioncited by 0
- 2026NeuroSymbEAD: A Large Scale Neuro-Symbolic Caption Dataset for Omni-Directional Embodied Autonomous Drivingcited by 0
- 2026NeuroSymbEAD: A Large Scale Neuro-Symbolic Caption Dataset for Omni-Directional Embodied Autonomous Driving15 Sep 2026
- 2026Caption Generation for Dongba Paintings via Prompt Learning and Semantic Fusion24 Mar 2026
- 2025From Image Captioning to Visual Storytelling31 Jul 2025
- 2025Explaining the Success of Nearest Neighbor Methods in Prediction21 Feb 2025
- 2024Pixels to Prose: Understanding the art of Image Captioning28 Aug 2024
- 2024Image Captioning via Dynamic Path Customization1 Jun 2024
- 20243AM: An Ambiguity-Aware Multi-Modal Machine Translation Dataset29 Apr 2024
- 2023Set Prediction Guided by Semantic Concepts for Diverse Video Captioning25 Dec 2023
- 2023NICE: CVPR 2023 Challenge on Zero-shot Image Captioning5 Sep 2023
- 2023Borrowing Human Senses: Comment-Aware Self-Training for Social Media Multimodal Classification27 Mar 2023
- 2023Nearest Neighbors Meet Deep Neural Networks for Point Cloud Analysis1 Mar 2023
- 2022Diverse Image Captioning with Grounded Style3 May 2022
7 more
- 2022Clotho-AQA: A Crowdsourced Dataset for Audio Question Answering20 Apr 2022
- 2022FlowEval: A Consensus-Based Dialogue Evaluation Framework Using Segment Act Flows14 Feb 2022
- 2021Rethinking Nearest Neighbors for Visual Classification15 Dec 2021
- 2021ReFormer: The Relational Transformer for Image Captioning29 Jul 2021
- 2021Neural Abstructions: Abstractions that Support Construction for Grounded Language Learning20 Jul 2021
- 2021A Hybrid Model for Combining Neural Image Caption and k-Nearest Neighbor Approach for Image Captioning9 May 2021
- 2021Cross-Modal Retrieval Augmentation for Multi-Modal Classification16 Apr 2021
- 2022Clotho-AQA: A Crowdsourced Dataset for Audio Question Answeringcited by 84
- 2021ReFormer: The Relational Transformer for Image Captioningcited by 23
- 2021Cross-Modal Retrieval Augmentation for Multi-Modal Classificationcited by 20
- 2023NICE: CVPR 2023 Challenge on Zero-shot Image Captioningcited by 9
- 2021Rethinking Nearest Neighbors for Visual Classificationcited by 6
- 2023Nearest Neighbors Meet Deep Neural Networks for Point Cloud Analysiscited by 5
- 2022FlowEval: A Consensus-Based Dialogue Evaluation Framework Using Segment Act Flowscited by 4
- 2023Set Prediction Guided by Semantic Concepts for Diverse Video Captioningcited by 4
- 20243AM: An Ambiguity-Aware Multi-Modal Machine Translation Datasetcited by 4
- 2022Diverse Image Captioning with Grounded Stylecited by 3
- 2024Image Captioning via Dynamic Path Customizationcited by 3
- 2023Borrowing Human Senses: Comment-Aware Self-Training for Social Media Multimodal Classificationcited by 2
12 most cited of 18 All 18 (JSON)
- 2026Caption Generation for Dongba Paintings via Prompt Learning and Semantic Fusion24 Mar 2026
- 2025From Image Captioning to Visual Storytelling31 Jul 2025
- 2025Explaining the Success of Nearest Neighbor Methods in Prediction21 Feb 2025
- 2024Pixels to Prose: Understanding the art of Image Captioning28 Aug 2024
- 2024Image Captioning via Dynamic Path Customization1 Jun 2024
- 20243AM: An Ambiguity-Aware Multi-Modal Machine Translation Dataset29 Apr 2024
- 2023Set Prediction Guided by Semantic Concepts for Diverse Video Captioning25 Dec 2023
- 2023NICE: CVPR 2023 Challenge on Zero-shot Image Captioning5 Sep 2023
- 2023Borrowing Human Senses: Comment-Aware Self-Training for Social Media Multimodal Classification27 Mar 2023
- 2023Nearest Neighbors Meet Deep Neural Networks for Point Cloud Analysis1 Mar 2023
- 2022Diverse Image Captioning with Grounded Style3 May 2022
- 2022Clotho-AQA: A Crowdsourced Dataset for Audio Question Answering20 Apr 2022
12 newest of 18 All 18 (JSON)