mlsanityData to 7 Oct 2026

Show, Attend and Tell: Neural Image Caption Generation with Visual Attention

arXiv 1502.03044 ↗First posted 10 Feb 2015cs.LG cs.CVcited by 1,421

Not on the map. Why?

Cited by 90 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Inspired by recent work in machine translation and object detection, we introduce an attention based model that automatically learns to describe the content of images. We describe how we can train this model in a deterministic manner using standard backpropagation techniques and stochastically by maximizing a variational lower bound. We also show through visualization how the model is able to automatically learn to fix its gaze on salient objects while generating the corresponding words in the output sequence. We validate the use of attention with state-of-the-art performance on three benchmark datasets: Flickr8k, Flickr30k and MS COCO.

Key facts. Cited by 1,421 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Feb 2015.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2018: 4; 2019: 2; 2020: 2; 2021: 443; 2022: 310; 2023: 236; 2024: 204; 2025: 150; 2026: 70.

1,421 papers.

Sort:

By area:

  1. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  2. 2023ViperGPT: Visual Inference via Python Execution for Reasoningcited by 591
  3. 2021ClipCap: CLIP Prefix for Image Captioningcited by 557
  4. 2021DenseCLIP: Language-Guided Dense Prediction with Context-Aware Promptingcited by 530
  5. 2021Dynamic Neural Networks: A Surveycited by 405
  6. 2021Supervision Exists Everywhere: A Data Efficient Contrastive Language-Image Pre-training Paradigmcited by 405
  7. 2023FigStep: Jailbreaking Large Vision-Language Models via Typographic Visual Promptscited by 368
  8. 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 357
  9. 2021Pix2seq: A Language Modeling Framework for Object Detectioncited by 345
  10. 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 327
  11. 2018Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigationcited by 304
  12. 2021Understanding Robustness of Transformers for Image Classificationcited by 250
38 more
  1. 2021Coordinate Attention for Efficient Mobile Network Designcited by 239
  2. 2021Attention Mechanisms in Computer Vision: A Surveycited by 232
  3. 2023Driving with LLMs: Fusing Object-Level Vector Modality for Explainable Autonomous Drivingcited by 231
  4. 2021Co-Scale Conv-Attentional Image Transformerscited by 224
  5. 2021Scaling Local Self-Attention for Parameter Efficient Visual Backbonescited by 220
  6. 2021Trustworthy AI: From Principles to Practicescited by 206
  7. 2023RSGPT: A Remote Sensing Vision Language Model and Benchmarkcited by 204
  8. 2021VisualGPT: Data-efficient Adaptation of Pretrained Language Models for Image Captioningcited by 190
  9. 2022Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigationcited by 187
  10. 2022Cross-modal Memory Networks for Radiology Report Generationcited by 183
  11. 2021Combined Scaling for Zero-shot Transfer Learningcited by 182
  12. 2021Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyondcited by 177
  13. 2021Fast Convergence of DETR with Spatially Modulated Co-Attentioncited by 176
  14. 2022Interpretable and Generalizable Graph Learning via Stochastic Attention Mechanismcited by 171
  15. 2022Chart-to-Text: A Large-Scale Benchmark for Chart Summarizationcited by 166
  16. 2021Exploring and Distilling Posterior and Prior Knowledge for Radiology Report Generationcited by 160
  17. 2021SceneGraphFusion: Incremental 3D Scene Graph Prediction from RGB-D Sequencescited by 159
  18. 2022VLP: A Survey on Vision-Language Pre-trainingcited by 159
  19. 2022Multi-Granularity Cross-modal Alignment for Generalized Medical Visual Representation Learningcited by 159
  20. 2021ZeroCap: Zero-Shot Image-to-Text Generation for Visual-Semantic Arithmeticcited by 150
  21. 2021Inductive Biases and Variable Creation in Self-Attention Mechanismscited by 144
  22. 2021MultiBench: Multiscale Benchmarks for Multimodal Representation Learningcited by 143
  23. 2023Getting aligned on representational alignmentcited by 142
  24. 2023Interactive and Explainable Region-guided Radiology Report Generationcited by 139
  25. 2021From Show to Tell: A Survey on Deep Learning-based Image Captioningcited by 137
  26. 2021Benchmarking and Survey of Explanation Methods for Black Box Modelscited by 136
  27. 2022Natural Language Descriptions of Deep Visual Featurescited by 136
  28. 2022X-Pool: Cross-Modal Language-Video Attention for Text-Video Retrievalcited by 127
  29. 2022DRAMA: Joint Risk Localization and Captioning in Drivingcited by 125
  30. 2022A Survey of Deep Learning for Mathematical Reasoningcited by 124
  31. 2021Screen2Words: Automatic Mobile UI Summarization with Multimodal Learningcited by 119
  32. 2022Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questionscited by 116
  33. 2021Causal Attention for Vision-Language Taskscited by 111
  34. 2023R2GenGPT: Radiology Report Generation with Frozen LLMscited by 111
  35. 2021Beyond Self-attention: External Attention using Two Linear Layers for Visual Taskscited by 109
  36. 2021Causal Attention for Interpretable and Generalizable Graph Classificationcited by 108
  37. 2024Multimodal Autoregressive Pre-training of Large Vision Encoderscited by 108
  38. 2021LambdaNetworks: Modeling Long-Range Interactions Without Attentioncited by 107

50 most cited of 1,421 All 1,421 (JSON)