FlowNar: Scalable Streaming Narration for Long-Form Videos
On the map: Multimodal LLMs / vision-language models → Video understanding with MLLMs
Abstract (arXiv)
Recent Large Multimodal Models (LMMs), primarily designed for offline settings, are ill-suited for the dynamic requirements of streaming video. While recent online adaptations improve real-time processing, they still face critical scalability challenges, with resource demands typically growing at least linearly with video duration. To overcome this bottleneck, we propose FlowNar, a novel framework for scalable streaming video narration. The core of FlowNar is a dynamic context management strategy for historical visual context removal, combined with our CLAM (Cross Linear Attentive Memory) module for streaming visual history retention, ensuring bounded visual memory usage and computational complexity, crucial for efficient streaming. We also introduce a realistic self-conditioned evaluation protocol and complementary evaluation metrics to assess streaming narration models under deployment-like conditions. Experiments on the Ego4D, EgoExo4D, and EpicKitchens100 datasets demonstrate that FlowNar substantially improves narration quality over strong baselines while being highly efficient, supporting processing of 10× longer videos and achieving 3× higher throughput (FPS). The code is available at https://github.com/zeyun-zhong/FlowNar.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Video understanding with MLLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 68 of its 80 references that are in the map. First posted on arXiv 30 May 2026.
Builds on
68 of 80 references.
Closest ancestors · 6
Same direction, newest first
- 2025StreamForest: Efficient Online Video Understanding with Persistent Event Memory29 Sep
- 2025StreamMem: Query-Agnostic KV Cache Memory for Streaming Video Understanding21 Aug
- 2025LLaVAction: evaluating and training multi-modal large language models for action understanding24 Mar
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projection16 Nov
- 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding5 Jun
- 2023Vid2Seq: Large-Scale Pretraining of a Visual Language Model for Dense Video Captioning27 Feb
Other references · 62
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2023Visual Instruction Tuningcited by 7,792
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2023Mistral 7Bcited by 3,065
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,689
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2023Efficient Streaming Language Models with Attention Sinkscited by 2,115
- 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 1,979
38 more
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,361
- 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,047
- 2023VideoChat: Chat-Centric Video Understandingcited by 851
- 2023H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Modelscited by 805
- 2017Dense-Captioning Events in Videoscited by 789
- 2023Retentive Network: A Successor to Transformer for Large Language Modelscited by 594
- 2023MovieChat: From Dense Token to Sparse Memory for Long Video Understandingcited by 536
- 2020Rescaling Egocentric Visioncited by 529
- 2023Gated Linear Attention Transformers with Hardware-Efficient Trainingcited by 490
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
- 2023Scissorhands: Exploiting the Persistence of Importance Hypothesis for LLM KV Cache Compression at Test Timecited by 428
- 2025Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attentioncited by 391
- 2024VideoLLM-online: Online Video Large Language Model for Streaming Videocited by 216
- 2018End-to-End Dense Video Captioning with Masked Transformercited by 214
- 2022Learning Video Representations from Large Language Modelscited by 204
- 2024Streaming Long Video Understanding with Large Language Modelscited by 164
- 2015Sequence to Sequence -- Video to Textcited by 157
- 2021End-to-End Dense Video Captioning with Parallel Decodingcited by 133
- 2021TokenLearner: What Can 8 Learned Tokens Do for Images and Videos?cited by 127
- 2024ST-LLM: Large Language Models Are Effective Temporal Learnerscited by 126
- 2024Keyformer: KV Cache Reduction through Key Tokens Selection for Efficient Generative Inferencecited by 124
- 2025Dispider: Enabling Video LLMs with Active Real-Time Interaction via Disentangled Perception, Decision, and Reactioncited by 122
- 2023LM-Infinite: Zero-Shot Extreme Length Generalization for Large Language Modelscited by 120
- 2022End-to-end Generative Pretraining for Multimodal Video Captioningcited by 115
- 2025Streaming Video Question-Answering with In-context Video KV-Cache Retrievalcited by 112
- 2019What Would You Expect? Anticipating Egocentric Actions with Rolling-Unrolling LSTMs and Modality Attentioncited by 104
- 2024RazorAttention: Efficient KV Cache Compression Through Retrieval Headscited by 99
- 2018Reconstruction Network for Video Captioningcited by 98
- 2024Keep the Cost Down: A Review on Methods to Optimize LLM' s KV-Cache Consumptioncited by 96
- 2024Video ReCap: Recursive Captioning of Hour-Long Videoscited by 88
- 2024A Simple and Effective L2 Norm-Based Strategy for KV Cache Compressioncited by 84
- 2021OadTR: Online Action Detection with Transformerscited by 83
- 2024Streaming Dense Video Captioningcited by 82
- 2020MART: Memory-Augmented Recurrent Transformer for Coherent Video Paragraph Captioningcited by 79
- 2016Online Action Detectioncited by 68
- 2018Bidirectional Attentive Fusion with Context Gating for Dense Video Captioningcited by 68
- 2025LION-FS: Fast & Slow Video-Language Thinker as Online Video Assistantcited by 56
50 most cited of 62 All 62 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026StreamArena: Toward Continuous, Interactive, and Long-Horizon Agentic Streaming Video Understanding
- 2026StreamFlow: Dynamic Memory Flows for Streaming Video Understanding
- 2024StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understanding
- 2024StreamChat: Chatting with Streaming Video
- 2025LiveStar: Live Streaming Assistant for Real-World Online Video Understanding
- 2026What Should a Streaming Video Model Remember?
- 2026FlashBack: Knowing When to Remember in Streaming Vision-Language Models
- 2026Think While Watching: Online Streaming Segment-Level Memory for Multi-Turn Video Reasoning in Multimodal Large Language Models