mlsanityData to 7 Oct 2026

More than a Moment: Towards Coherent Sequences of Audio Descriptions

arXiv 2510.25440 ↗First posted 29 Oct 2025cs.CV cs.CLcited by 5

Not on the map. Why?

Abstract (arXiv)

Audio Descriptions (ADs) convey essential on-screen information, allowing visually impaired audiences to follow videos. To be effective, ADs must form a coherent sequence that helps listeners to visualise the unfolding scene, rather than describing isolated moments. However, most automatic methods generate each AD independently, often resulting in repetitive, incoherent descriptions. To address this, we propose a training-free method, CoherentAD, that first generates multiple candidate descriptions for each AD time interval, and then performs auto-regressive selection across the sequence to form a coherent and informative narrative. To evaluate AD sequences holistically, we introduce a sequence-level metric, StoryRecall, which measures how well the predicted ADs convey the ground truth narrative, alongside repetition metrics that capture the redundancy across consecutive AD outputs. Our method produces coherent AD sequences with enhanced narrative understanding, outperforming prior approaches that rely on independent generations.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 19 of its 31 references that are in the map. First posted on arXiv 29 Oct 2025.

Builds on

19 of 31 references.

References · 19

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  3. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  4. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
  5. 2016SPICE: Semantic Propositional Image Caption Evaluationcited by 820
  6. 2016Movie Descriptioncited by 180
  7. 2021MAD: A Scalable Dataset for Language Grounding in Videos from Movie Audio Descriptionscited by 107
  8. 2023AutoAD II: The Sequel -- Who, When, and What in Movie Audio Descriptioncited by 48
  9. 2023MM-Narrator: Narrating Long-form Videos with Multimodal In-Context Learningcited by 46
  10. 2024AutoAD III: The Prequel -- Back to the Pixelscited by 35
  11. 2024Moving Object Segmentation: All You Need Is SAM (and Flow)cited by 30
  12. 2024AutoAD-Zero: A Training-Free Framework for Zero-Shot Audio Descriptioncited by 21
7 more
  1. 2024Learning Video Context as Interleaved Multimodal Sequencescited by 16
  2. 2024LLM-AD: Large Language Model based Audio Description Systemcited by 14
  3. 2025Shot-by-Shot: Film-Grammar-Aware Training-Free Audio Description Generationcited by 13
  4. 2023Appearance-Based Refinement for Object-Centric Motion Segmentationcited by 11
  5. 2024DistinctAD: Distinctive Audio Description Generation in Contextscited by 11
  6. 2025What You See is What You Ask: Evaluating Audio Descriptionscited by 7
  7. 2025FocusedAD: Character-centric Movie Audio Descriptioncited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.