mlsanityData to 7 Oct 2026

Interactive Attention AI to translate low light photos to captions for night scene understanding in women safety

arXiv 2201.00969 ↗First posted 4 Jan 2022cs.CV cs.CL cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

There is amazing progress in Deep Learning based models for Image captioning and Low Light image enhancement. For the first time in literature, this paper develops a Deep Learning model that translates night scenes to sentences, opening new possibilities for AI applications in the safety of visually impaired women. Inspired by Image Captioning and Visual Question Answering, a novel Interactive Image Captioning is developed. A user can make the AI focus on any chosen person of interest by influencing the attention scoring. Attention context vectors are computed from CNN feature vectors and user-provided start word. The Encoder-Attention-Decoder neural network learns to produce captions from low brightness images. This paper demonstrates how women safety can be enabled by researching a novel AI capability in the Interactive Vision-Language model for perception of the environment in the night.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 21 references that are in the map. First posted on arXiv 4 Jan 2022.

Builds on

17 of 21 references.

References · 17

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,421
  4. 2017Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answeringcited by 1,310
  5. 2020Oscar: Object-Semantics Aligned Pre-training for Vision-Language Taskscited by 1,213
  6. 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
  7. 2014Show and Tell: A Neural Image Caption Generatorcited by 877
  8. 2021SimVLM: Simple Visual Language Model Pretraining with Weak Supervisioncited by 645
  9. 2019Attention on Attention for Image Captioningcited by 289
  10. 2021Learning to Enhance Low-Light Image via Zero-Reference Deep Curve Estimationcited by 192
  11. 2021Low-Light Image and Video Enhancement Using Deep Learning: A Surveycited by 148
  12. 2020Captioning Images Taken by People Who Are Blindcited by 108
5 more
  1. 2020Object-and-Action Aware Model for Visual Language Navigationcited by 77
  2. 2019On-Device Machine Learning: An Algorithms and Learning Theory Perspectivecited by 63
  3. 2017Convolutional Image Captioningcited by 52
  4. 2017Variational Attention for Sequence-to-Sequence Modelscited by 29
  5. 2020iCap: Interactive Image Captioning with Predictive Textcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Focus Where It Counts: A Salience-Driven Vision-Language Model for Low Vision Assistance
  2. 2025Attention-based transformer models for image captioning across languages: An in-depth survey and evaluation
  3. 2024How Vision-Language Tasks Benefit from Large Pre-trained Models: A Survey
  4. 2025CAI: Caption-Sensitive Attention Intervention for Mitigating Object Hallucination in Large Vision-Language Models
  5. 2025BlindSight: Harnessing Sparsity for Efficient Vision-Language Models
  6. 2022Deep Learning Approaches on Image Captioning: A Review
  7. 2025Instruction-Aligned Visual Attention for Mitigating Hallucinations in Large Vision-Language Models
  8. 2024Enhancing Visual Question Answering through Question-Driven Image Captions as Prompts