mlsanityData to 7 Oct 2026

Image captioning in different languages

arXiv 2407.09495 ↗First posted 31 May 2024cs.CL cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

This short position paper provides a manually curated list of non-English image captioning datasets (as of May 2024). Through this list, we can observe the dearth of datasets in different languages: only 23 different languages are represented. With the addition of the Crossmodal-3600 dataset (Thapliyal et al., 2022, 36 languages) this number increases somewhat, but still this number is small compared to the +/-500 institutional languages that are out there. This paper closes with some open questions for the field of Vision & Language.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 63 references that are in the map. First posted on arXiv 31 May 2024.

Builds on

19 of 63 references.

References · 19

  1. 2016Multi30K: Multilingual English-German Image Descriptionscited by 250
  2. 2022Crossmodal-3600: A Massively Multilingual Multimodal Evaluation Datasetcited by 100
  3. 2018COCO-CN for Cross-Lingual Image Tagging, Captioning and Retrievalcited by 80
  4. 2017Findings of the Second Shared Task on Multimodal Machine Translation and Multilingual Image Descriptioncited by 76
  5. 2017AI Challenger : A Large-scale Dataset for Going Deeper in Image Understandingcited by 73
  6. 2017STAIR Captions: Constructing a Large-Scale Japanese Image Caption Datasetcited by 47
  7. 2017Fluency-Guided Cross-Lingual Image Captioningcited by 33
  8. 2015Bridge Correlational Neural Networks for Multilingual Multimodal Representation Learningcited by 18
  9. 2016Multimodal Pivots for Image Caption Translationcited by 18
  10. 2019Hindi Visual Genome: A Dataset for Multimodal English-to-Hindi Machine Translationcited by 16
  11. 2020UIT-ViIC: A Dataset for the First Evaluation on Vietnamese Image Captioningcited by 13
  12. 2017Cross-linguistic differences and similarities in image descriptionscited by 12
7 more
  1. 2018Chittron: An Automatic Bangla Image Captioning Systemcited by 8
  2. 2021#PraCegoVer: A Large Dataset for Image Captioning in Portuguesecited by 8
  3. 2023Violet: A Vision-Language Model for Arabic Image Captioning with Gemini Decodercited by 7
  4. 2021Bornon: Bengali Image Captioning with Transformer-based Deep learning approachcited by 5
  5. 2022BAN-Cap: A Multi-Purpose English-Bangla Image Descriptions Datasetcited by 4
  6. 2020Efficient Urdu Caption Generation using Attention based LSTMcited by 3
  7. 2023UIT-OpenViIC: A Novel Benchmark for Evaluating Image Captioning in Vietnamesecited by 2

Built on by

Not cited yet.