HiVid-Narrator: Hierarchical Video Narrative Generation with Scene-Primed ASR-anchored Compression
Not on the map. Why?
Abstract (arXiv)
Generating structured narrations for real-world e-commerce videos requires models to perceive fine-grained visual details and organize them into coherent, high-level stories--capabilities that existing approaches struggle to unify. We introduce the E-commerce Hierarchical Video Captioning (E-HVC) dataset with dual-granularity, temporally grounded annotations: a Temporal Chain-of-Thought that anchors event-level observations and Chapter Summary that compose them into concise, story-centric summaries. Rather than directly prompting chapters, we adopt a staged construction that first gathers reliable linguistic and visual evidence via curated ASR and frame-level descriptions, then refines coarse annotations into precise chapter boundaries and titles conditioned on the Temporal Chain-of-Thought, yielding fact-grounded, time-aligned narratives. We also observe that e-commerce videos are fast-paced and information-dense, with visual tokens dominating the input sequence. To enable efficient training while reducing input tokens, we propose the Scene-Primed ASR-anchored Compressor (SPA-Compressor), which compresses multimodal tokens into hierarchical scene and event representations guided by ASR semantic cues. Built upon these designs, our HiVid-Narrator framework achieves superior narrative quality with fewer input tokens compared to existing methods.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 31 of its 36 references that are in the map. First posted on arXiv 12 Jan 2026.
Builds on
31 of 36 references.
References · 31
- 2017Attention Is All You Needcited by 59,932
- 2025Qwen3 Technical Reportcited by 8,195
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
- 2023VideoChat: Chat-Centric Video Understandingcited by 851
- 2017Dense-Captioning Events in Videoscited by 789
- 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 749
- 2024An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Modelscited by 629
19 more
- 2017Towards Automatic Learning of Procedures from Web Instructional Videoscited by 616
- 2017TALL: Temporal Activity Localization via Language Querycited by 581
- 2023TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understandingcited by 399
- 2023Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understandingcited by 368
- 2024LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understandingcited by 341
- 2024PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioningcited by 320
- 2019COIN: A Large-scale Dataset for Comprehensive Instructional Video Analysiscited by 316
- 2024VisionZip: Longer is Better but Not Necessary in Vision Language Modelscited by 298
- 2023VTimeLLM: Empower LLM to Grasp Video Momentscited by 253
- 2023Valley: Video Assistant with Large Language model Enhanced abilitYcited by 231
- 2024LITA: Language Instructed Temporal-Localization Assistantcited by 124
- 2024Momentor: Advancing Video Large Language Model with Fine-Grained Temporal Reasoningcited by 122
- 2024TRACE: Temporal Grounding Video LLM via Causal Event Modelingcited by 87
- 2024VTG-LLM: Integrating Timestamp Knowledge into Video LLMs for Enhanced Video Temporal Groundingcited by 85
- 2020Multimodal Pretraining for Dense Video Captioningcited by 79
- 2025ARC-Hunyuan-Video-7B: Structured Video Comprehension of Real-World Shortscited by 36
- 2024xGen-MM-Vid (BLIP-3-Video): You Only Need 32 Tokens to Represent a Video Even in VLMscited by 34
- 2018Video Storytelling: Textual Summaries for Eventscited by 22
- 2024Synchronized Video Storytelling: Generating Video Narrations with Structured Storylinecited by 19
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Toward Scalable Video Narration: A Training-free Approach Using Multimodal Large Language Models
- 2026Script-a-Video: Deep Structured Audio-visual Captions via Factorized Streams and Relational Grounding
- 2026DATAREEL: Automated Data-Driven Video Story Generation with Animations
- 2025SeqBench: Benchmarking Sequential Narrative Generation in Text-to-Video Models
- 2024Openstory++: A Large-scale Dataset and Benchmark for Instance-aware Open-domain Visual Storytelling
- 2023DirecT2V: Large Language Models are Frame-Level Directors for Zero-Shot Text-to-Video Generation
- 2026Narrative Weaver: Towards Controllable Long-Range Visual Consistency with Multi-Modal Conditioning
- 2026TimeChat-Captioner: Scripting Multi-Scene Videos with Time-Aware and Structural Audio-Visual Captions