mlsanityData to 7 Oct 2026

Automatic Description Generation from Images: A Survey of Models, Datasets, and Evaluation Measures

arXiv 1601.03896 ↗First posted 15 Jan 2016cs.CL cs.CVcited by 36

Not on the map. Why?

Abstract (arXiv)

Automatic description generation from natural images is a challenging problem that has recently received a large amount of interest from the computer vision and natural language processing communities. In this survey, we classify the existing approaches based on how they conceptualize this problem, viz., models that cast description as either generation problem or as a retrieval problem over a visual or multimodal representational space. We provide a detailed review of existing models, highlighting their advantages and disadvantages. Moreover, we give an overview of the benchmark image datasets and the evaluation measures that have been developed to assess the quality of machine-generated image descriptions. Finally we extrapolate future directions in the area of automatic image description generation.

Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Jan 2016.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 13; 2022: 7; 2023: 6; 2024: 2; 2025: 4; 2026: 4.

36 papers.

Sort:

By area:

  1. 2021From Show to Tell: A Survey on Deep Learning-based Image Captioningcited by 137
  2. 2021Learning to Predict Visual Attributes in the Wildcited by 95
  3. 2022IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languagescited by 54
  4. 2021Visually grounded models of spoken language: A survey of datasets, architectures and evaluation techniquescited by 32
  5. 2021INVIGORATE: Interactive Visual Grounding and Grasping in Cluttercited by 32
  6. 2022VQA and Visual Reasoning: An Overview of Recent Datasets, Methods and Challengescited by 14
  7. 2023Cross-Domain Image Captioning with Discriminative Finetuningcited by 14
  8. 2021Selective Replay Enhances Learning in Online Continual Analogical Reasoningcited by 12
  9. 2021MultiSubs: A Large-scale Multimodal and Multilingual Datasetcited by 10
  10. 2023Dealing with Semantic Underspecification in Multimodal NLPcited by 9
  11. 2022Keyword localisation in untranscribed speech using visually grounded speech modelscited by 7
  12. 2021Diagnostic Captioning: A Surveycited by 6
24 more
  1. 2023The Role of Data Curation in Image Captioningcited by 4
  2. 2021Comparative evaluation of CNN architectures for Image Caption Generationcited by 3
  3. 2023ContextRef: Evaluating Referenceless Metrics For Image Description Generationcited by 3
  4. 2021Bangla Image Caption Generation through CNN-Transformer based Encoder-Decoder Networkcited by 2
  5. 2022Are metrics measuring what they should? An evaluation of image captioning task metricscited by 2
  6. 2022Vision-and-Language Pretrainingcited by 2
  7. 2023Alt-Text with Context: Improving Accessibility for Images on Twittercited by 2
  8. 2024Introducing Brain-like Concepts to Embodied Hand-crafted Dialog Management Systemcited by 2
  9. 2021Narration Generation for Cartoon Videoscited by 1
  10. 2021Visual representation of negation: Real world data analysis on comic image designcited by 1
  11. 2025LecEval: An Automated Metric for Multimodal Knowledge Acquisition in Multimedia Learningcited by 1
  12. 2025Toward Reliable VLM: A Fine-Grained Benchmark and Framework for Exposure, Bias, and Inference in Korean Street Viewscited by 1
  13. 2025Studying Illustrations in Manuscripts: An Efficient Deep-Learning Approachcited by 1
  14. 2026Prune Once: Retraining-Free Task-Agnostic Pruning for Vision-Language Modelscited by 1
  15. 2021Characterization and recognition of handwritten digits using Juliacited by 0
  16. 2021We went to look for meaning and all we got were these lousy representations: aspects of meaning representation for computational semanticscited by 0
  17. 2022Zero-shot Cross-Linguistic Learning of Event Semanticscited by 0
  18. 2022Facial Expression Recognition and Image Description Generation in Vietnamesecited by 0
  19. 2023Describe me an Aucklet: Generating Grounded Perceptual Category Descriptionscited by 0
  20. 2024Surveying the Landscape of Image Captioning Evaluation: A Comprehensive Taxonomy, Trends and Metrics Analysiscited by 0
  21. 2025Surprisal reveals diversity gaps in image captioning and different scorers change the storycited by 0
  22. 2026CANVAS: Captioning Art with Narrative Visual-Audio AI Systemscited by 0
  23. 2026Search-based Testing of Vision Language Models for In-Car Scene Understandingcited by 0
  24. 2026A Systematic Survey on Image Description Techniques for STEM Domainscited by 0