Visual Semantic Relatedness Dataset for Image Captioning
Not on the map. Why?
Abstract (arXiv)
Modern image captioning system relies heavily on extracting knowledge from images to capture the concept of a static story. In this paper, we propose a textual visual context dataset for captioning, in which the publicly available dataset COCO Captions (Lin et al., 2014) has been extended with information about the scene (such as objects in the image). Since this information has a textual form, it can be used to leverage any NLP task, such as text similarity or semantic relation methods, into captioning systems, either as an end-to-end training strategy or a post-processing based approach.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 37 of its 49 references that are in the map. First posted on arXiv 20 Jan 2023.
Builds on
37 of 49 references.
References · 37
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
- 2017Billion-scale similarity search with GPUscited by 2,477
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
25 more
- 2017Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answeringcited by 1,310
- 2020Oscar: Object-Semantics Aligned Pre-training for Vision-Language Taskscited by 1,213
- 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,209
- 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
- 2017SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused Evaluationcited by 998
- 2014Deep Visual-Semantic Alignments for Generating Image Descriptionscited by 966
- 2016SPICE: Semantic Propositional Image Caption Evaluationcited by 820
- 2018Object Hallucination in Image Captioningcited by 661
- 2018nocaps: novel object captioning at scalecited by 444
- 2017Supervised Learning of Universal Sentence Representations from Natural Language Inference Datacited by 428
- 2017Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraintscited by 420
- 2019Meshed-Memory Transformer for Image Captioningcited by 343
- 2020VirTex: Learning Visual Representations from Textual Annotationscited by 338
- 2019Attention on Attention for Image Captioningcited by 289
- 201912-in-1: Multi-Task Vision and Language Representation Learningcited by 278
- 2018Women also Snowboard: Overcoming Bias in Captioning Modelscited by 236
- 2016Speed/accuracy trade-offs for modern convolutional object detectorscited by 198
- 2014From Captions to Visual Concepts and Backcited by 109
- 2020Contrastive Learning for Weakly Supervised Phrase Groundingcited by 102
- 2017Towards a Visual Privacy Advisor: Understanding and Predicting Privacy Risks in Imagescited by 101
- 2018Show, Control and Tell: A Framework for Generating Controllable and Grounded Captionscited by 65
- 2018Fast, Diverse and Accurate Image Captioning Guided By Part-of-Speechcited by 55
- 2021Consensus Graph Representation Learning for Better Grounded Image Captioningcited by 28
- 2018Object Counts! Bringing Explicit Detections Back into Image Captioningcited by 5
- 2022Belief Revision based Caption Re-ranker with Visual Semantic Informationcited by 2
Built on by
Citing papers per year: 2023: 1; 2024: 1.
2 papers.