mlsanityData to 7 Oct 2026

Enhancing Multimodal Understanding with CLIP-Based Image-to-Text Transformation

arXiv 2401.06167 ↗First posted 2 Jan 2024cs.CV cs.AIcited by 14

Not on the map. Why?

Abstract (arXiv)

The process of transforming input images into corresponding textual explanations stands as a crucial and complex endeavor within the domains of computer vision and natural language processing. In this paper, we propose an innovative ensemble approach that harnesses the capabilities of Contrastive Language-Image Pretraining models.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 10 of its 17 references that are in the map. First posted on arXiv 2 Jan 2024.

Builds on

10 of 17 references.

References · 10

  1. 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,219
  2. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
  3. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
  4. 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,096
  5. 2014Deep Visual-Semantic Alignments for Generating Image Descriptionscited by 966
  6. 2016Self-critical Sequence Training for Image Captioningcited by 544
  7. 2017Zero-Shot Learning -- The Good, the Bad and the Uglycited by 254
  8. 2016Multi30K: Multilingual English-German Image Descriptionscited by 250
  9. 2015DenseCap: Fully Convolutional Localization Networks for Dense Captioningcited by 176
  10. 2017Stack-Captioning: Coarse-to-Fine Learning for Image Captioningcited by 27

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 7; 2025: 5; 2026: 2.

14 papers.

Sort:

By area:

  1. 2024SwitchTab: Switched Autoencoders Are Effective Tabular Learnerscited by 37
  2. 2025SmartCLIP: Modular Vision-language Alignment with Identification Guaranteescited by 14
  3. 2024Enhancing Multi-Hop Knowledge Graph Reasoning through Reward Shaping Techniquescited by 8
  4. 2024When is an Embedding Model More Promising than Another?cited by 7
  5. 2025Multi-modal Summarization in Model-Based Engineering: Automotive Software Development Case Studycited by 6
  6. 2024Progress in artificial intelligence applications based on the combination of self-driven sensors and deep learningcited by 4
  7. 2024Leveraging Deep Learning and Xception Architecture for High-Accuracy MRI Classification in Alzheimer Diagnosiscited by 4
  8. 2024AEye: A Visualization Tool for Image Datasetscited by 2
  9. 2026Enhancing Multimodal Retrieval via Complementary Information Extraction and Alignmentcited by 1
  10. 2024The intelligent prediction and assessment of financial information risk in the cloud computing modelcited by 0
  11. 2025An Iterative Feedback Mechanism for Improving Natural Language Class Descriptions in Open-Vocabulary Object Detectioncited by 0
  12. 2025Visually grounded emotion regulation via diffusion models and user-driven reappraisalcited by 0
2 more
  1. 2025LSDM: LLM-Enhanced Spatio-temporal Diffusion Model for Service-Level Mobile Traffic Predictioncited by 0
  2. 2026Image Augmentation as Test Generation for Deep Learning-Based Image Retrieval Systemscited by 0