mlsanityData to 7 Oct 2026

HiVid-Narrator: Hierarchical Video Narrative Generation with Scene-Primed ASR-anchored Compression

arXiv 2601.07366 ↗First posted 12 Jan 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Generating structured narrations for real-world e-commerce videos requires models to perceive fine-grained visual details and organize them into coherent, high-level stories--capabilities that existing approaches struggle to unify. We introduce the E-commerce Hierarchical Video Captioning (E-HVC) dataset with dual-granularity, temporally grounded annotations: a Temporal Chain-of-Thought that anchors event-level observations and Chapter Summary that compose them into concise, story-centric summaries. Rather than directly prompting chapters, we adopt a staged construction that first gathers reliable linguistic and visual evidence via curated ASR and frame-level descriptions, then refines coarse annotations into precise chapter boundaries and titles conditioned on the Temporal Chain-of-Thought, yielding fact-grounded, time-aligned narratives. We also observe that e-commerce videos are fast-paced and information-dense, with visual tokens dominating the input sequence. To enable efficient training while reducing input tokens, we propose the Scene-Primed ASR-anchored Compressor (SPA-Compressor), which compresses multimodal tokens into hierarchical scene and event representations guided by ASR semantic cues. Built upon these designs, our HiVid-Narrator framework achieves superior narrative quality with fewer input tokens compared to existing methods.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 31 of its 36 references that are in the map. First posted on arXiv 12 Jan 2026.

Builds on

31 of 36 references.

References · 31

  1. 2017Attention Is All You Needcited by 59,932
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  4. 2025Qwen2.5-VL Technical Reportcited by 5,418
  5. 2024GPT-4o System Cardcited by 4,467
  6. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  7. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  8. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
  9. 2023VideoChat: Chat-Centric Video Understandingcited by 851
  10. 2017Dense-Captioning Events in Videoscited by 789
  11. 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 749
  12. 2024An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Modelscited by 629
19 more
  1. 2017Towards Automatic Learning of Procedures from Web Instructional Videoscited by 616
  2. 2017TALL: Temporal Activity Localization via Language Querycited by 581
  3. 2023TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understandingcited by 399
  4. 2023Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understandingcited by 368
  5. 2024LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understandingcited by 341
  6. 2024PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioningcited by 320
  7. 2019COIN: A Large-scale Dataset for Comprehensive Instructional Video Analysiscited by 316
  8. 2024VisionZip: Longer is Better but Not Necessary in Vision Language Modelscited by 298
  9. 2023VTimeLLM: Empower LLM to Grasp Video Momentscited by 253
  10. 2023Valley: Video Assistant with Large Language model Enhanced abilitYcited by 231
  11. 2024LITA: Language Instructed Temporal-Localization Assistantcited by 124
  12. 2024Momentor: Advancing Video Large Language Model with Fine-Grained Temporal Reasoningcited by 122
  13. 2024TRACE: Temporal Grounding Video LLM via Causal Event Modelingcited by 87
  14. 2024VTG-LLM: Integrating Timestamp Knowledge into Video LLMs for Enhanced Video Temporal Groundingcited by 85
  15. 2020Multimodal Pretraining for Dense Video Captioningcited by 79
  16. 2025ARC-Hunyuan-Video-7B: Structured Video Comprehension of Real-World Shortscited by 36
  17. 2024xGen-MM-Vid (BLIP-3-Video): You Only Need 32 Tokens to Represent a Video Even in VLMscited by 34
  18. 2018Video Storytelling: Textual Summaries for Eventscited by 22
  19. 2024Synchronized Video Storytelling: Generating Video Narrations with Structured Storylinecited by 19

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Toward Scalable Video Narration: A Training-free Approach Using Multimodal Large Language Models
  2. 2026Script-a-Video: Deep Structured Audio-visual Captions via Factorized Streams and Relational Grounding
  3. 2026DATAREEL: Automated Data-Driven Video Story Generation with Animations
  4. 2025SeqBench: Benchmarking Sequential Narrative Generation in Text-to-Video Models
  5. 2024Openstory++: A Large-scale Dataset and Benchmark for Instance-aware Open-domain Visual Storytelling
  6. 2023DirecT2V: Large Language Models are Frame-Level Directors for Zero-Shot Text-to-Video Generation
  7. 2026Narrative Weaver: Towards Controllable Long-Range Visual Consistency with Multi-Modal Conditioning
  8. 2026TimeChat-Captioner: Scripting Multi-Scene Videos with Time-Aware and Structural Audio-Visual Captions