mlsanityData to 7 Oct 2026

FlowNar: Scalable Streaming Narration for Long-Form Videos

arXiv 2606.00620 ↗First posted 30 May 2026cs.CVcited by 1

On the map: Multimodal LLMs / vision-language models → Video understanding with MLLMs

Abstract (arXiv)

Recent Large Multimodal Models (LMMs), primarily designed for offline settings, are ill-suited for the dynamic requirements of streaming video. While recent online adaptations improve real-time processing, they still face critical scalability challenges, with resource demands typically growing at least linearly with video duration. To overcome this bottleneck, we propose FlowNar, a novel framework for scalable streaming video narration. The core of FlowNar is a dynamic context management strategy for historical visual context removal, combined with our CLAM (Cross Linear Attentive Memory) module for streaming visual history retention, ensuring bounded visual memory usage and computational complexity, crucial for efficient streaming. We also introduce a realistic self-conditioned evaluation protocol and complementary evaluation metrics to assess streaming narration models under deployment-like conditions. Experiments on the Ego4D, EgoExo4D, and EpicKitchens100 datasets demonstrate that FlowNar substantially improves narration quality over strong baselines while being highly efficient, supporting processing of 10× longer videos and achieving 3× higher throughput (FPS). The code is available at https://github.com/zeyun-zhong/FlowNar.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Video understanding with MLLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 68 of its 80 references that are in the map. First posted on arXiv 30 May 2026.

Builds on

68 of 80 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025StreamForest: Efficient Online Video Understanding with Persistent Event Memory29 Sep
  2. 2025StreamMem: Query-Agnostic KV Cache Memory for Streaming Video Understanding21 Aug
  3. 2025LLaVAction: evaluating and training multi-modal large language models for action understanding24 Mar
  4. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projection16 Nov
  5. 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding5 Jun
  6. 2023Vid2Seq: Large-Scale Pretraining of a Visual Language Model for Dense Video Captioning27 Feb

Other references · 62

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2023Visual Instruction Tuningcited by 7,792
  3. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  4. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  5. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  6. 2020Longformer: The Long-Document Transformercited by 3,362
  7. 2023Mistral 7Bcited by 3,065
  8. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  9. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,689
  10. 2025Qwen3-VL Technical Reportcited by 2,534
  11. 2023Efficient Streaming Language Models with Attention Sinkscited by 2,115
  12. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 1,979
38 more
  1. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
  2. 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,361
  3. 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,047
  4. 2023VideoChat: Chat-Centric Video Understandingcited by 851
  5. 2023H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Modelscited by 805
  6. 2017Dense-Captioning Events in Videoscited by 789
  7. 2023Retentive Network: A Successor to Transformer for Large Language Modelscited by 594
  8. 2023MovieChat: From Dense Token to Sparse Memory for Long Video Understandingcited by 536
  9. 2020Rescaling Egocentric Visioncited by 529
  10. 2023Gated Linear Attention Transformers with Hardware-Efficient Trainingcited by 490
  11. 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
  12. 2023Scissorhands: Exploiting the Persistence of Importance Hypothesis for LLM KV Cache Compression at Test Timecited by 428
  13. 2025Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attentioncited by 391
  14. 2024VideoLLM-online: Online Video Large Language Model for Streaming Videocited by 216
  15. 2018End-to-End Dense Video Captioning with Masked Transformercited by 214
  16. 2022Learning Video Representations from Large Language Modelscited by 204
  17. 2024Streaming Long Video Understanding with Large Language Modelscited by 164
  18. 2015Sequence to Sequence -- Video to Textcited by 157
  19. 2021End-to-End Dense Video Captioning with Parallel Decodingcited by 133
  20. 2021TokenLearner: What Can 8 Learned Tokens Do for Images and Videos?cited by 127
  21. 2024ST-LLM: Large Language Models Are Effective Temporal Learnerscited by 126
  22. 2024Keyformer: KV Cache Reduction through Key Tokens Selection for Efficient Generative Inferencecited by 124
  23. 2025Dispider: Enabling Video LLMs with Active Real-Time Interaction via Disentangled Perception, Decision, and Reactioncited by 122
  24. 2023LM-Infinite: Zero-Shot Extreme Length Generalization for Large Language Modelscited by 120
  25. 2022End-to-end Generative Pretraining for Multimodal Video Captioningcited by 115
  26. 2025Streaming Video Question-Answering with In-context Video KV-Cache Retrievalcited by 112
  27. 2019What Would You Expect? Anticipating Egocentric Actions with Rolling-Unrolling LSTMs and Modality Attentioncited by 104
  28. 2024RazorAttention: Efficient KV Cache Compression Through Retrieval Headscited by 99
  29. 2018Reconstruction Network for Video Captioningcited by 98
  30. 2024Keep the Cost Down: A Review on Methods to Optimize LLM' s KV-Cache Consumptioncited by 96
  31. 2024Video ReCap: Recursive Captioning of Hour-Long Videoscited by 88
  32. 2024A Simple and Effective L2 Norm-Based Strategy for KV Cache Compressioncited by 84
  33. 2021OadTR: Online Action Detection with Transformerscited by 83
  34. 2024Streaming Dense Video Captioningcited by 82
  35. 2020MART: Memory-Augmented Recurrent Transformer for Coherent Video Paragraph Captioningcited by 79
  36. 2016Online Action Detectioncited by 68
  37. 2018Bidirectional Attentive Fusion with Context Gating for Dense Video Captioningcited by 68
  38. 2025LION-FS: Fast & Slow Video-Language Thinker as Online Video Assistantcited by 56

50 most cited of 62 All 62 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026StreamArena: Toward Continuous, Interactive, and Long-Horizon Agentic Streaming Video Understanding
  2. 2026StreamFlow: Dynamic Memory Flows for Streaming Video Understanding
  3. 2024StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understanding
  4. 2024StreamChat: Chatting with Streaming Video
  5. 2025LiveStar: Live Streaming Assistant for Real-World Online Video Understanding
  6. 2026What Should a Streaming Video Model Remember?
  7. 2026FlashBack: Knowing When to Remember in Streaming Vision-Language Models
  8. 2026Think While Watching: Online Streaming Segment-Level Memory for Multi-Turn Video Reasoning in Multimodal Large Language Models