mlsanityData to 7 Oct 2026

Complementary Retrieval-Augmented Prompting for Consistent Long-Form Video Generation

arXiv 2609.37407 ↗First posted 29 Sep 2026cs.CVcited by 0

On the map: Retrieval-augmented generation → Multimodal RAG

Abstract (arXiv)

While recent video foundation models excel at generating high-quality short videos, long-form video generation remains a critical challenge, where a major bottleneck lies in conditioning independently generated shots to preserve consistent characters, scenes, and objects throughout a story. Existing training-free approaches typically condition target shots using retrieved historical visuals. However, these references often suffer from severe informational mismatch, either introducing irrelevant contextual redundancy or failing to provide the full combination of required elements for the target shot. To resolve this, we present Complementary Retrieval-Augmented Prompting, an agentic framework that strategically aggregates a compact set of mutually supportive historical references to achieve complete and targeted conditioning for long-form video generation without retraining or modifying the underlying generator. Specifically, our framework explicitly models the visual elements required by each target shot by parsing the narrative script into a text-grounded visual element registry that tracks characters, objects, scenes, and their shot-level states. A VLM-annotated keyframe library further maps these elements to past visual observations. Guided by the required elements, our agent retrieves complementary references that maximize target-element coverage while minimizing historical noise. Finally, the retrieved references, structured element states, and grounding instructions are assembled into a unified prompt for the frozen video generator. This element-aware process provides comprehensive conditioning while remaining fully interpretable. Quantitative and qualitative evaluations on multi-shot story generation demonstrate that our method consistently outperforms recent-frame, memory-based, and entity-level retrieval baselines in cross-shot consistency and text-controllability.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal RAG, one of 15 directions in Retrieval-augmented generation. Builds on 19 of its 26 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

19 of 26 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026LongLive-RAG: A General Retrieval-Augmented Framework for Long Video Generation1 Jun

Other references · 18

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 196
  3. 2024Vidu: a Highly Consistent, Dynamic and Skilled Text-to-Video Generator with Diffusion Modelscited by 159
  4. 2023VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planningcited by 138
  5. 2025Automated Movie Generation via Multi-Agent CoT Planningcited by 82
  6. 2025HoloCine: Holistic Generation of Cinematic Multi-Shot Long Video Narrativescited by 51
  7. 2025StoryMem: Multi-shot Long Video Storytelling with Memorycited by 35
  8. 2025OneStory: Coherent Multi-Shot Video Generation with Adaptive Memorycited by 31
  9. 2025CineTrans: Learning to Generate Videos with Cinematic Transitions via Masked Diffusion Modelscited by 26
  10. 2025Step-Video-TI2V Technical Report: A State-of-the-Art Text-Driven Image-to-Video Generation Modelcited by 25
  11. 2026LongLive-2.0: An NVFP4 Parallel Infrastructure for Long Video Generationcited by 25
  12. 2026VideoMemory: Toward Consistent Video Generation via Memory Integrationcited by 22
6 more
  1. 2026ShotStream: Streaming Multi-Shot Video Generation for Interactive Storytellingcited by 22
  2. 2026EntityBench: Towards Entity-Consistent Long-Range Multi-Shot Video Generationcited by 6
  3. 2026ReCA: Multi-Shot Long Video Extrapolation via Recursive Context Allocationcited by 5
  4. 2026Memento: Reconstruct to Remember for Consistent Long Video Generationcited by 4
  5. 2026GroundShot: Visually Consistent Multi-Shot Long Video Generation via Entity-Grounded Shot Schedulingcited by 4
  6. 2026EvoState: Closed-Loop Visual State Management for Long-Form Video Generationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026CineWeaver: Training-Free Reference-Controllable Multi-Shot Long Video Generation for Cinematic Storytelling
  2. 2026Advancing Narrative Long Video Generation via Training-Free Identity-Aware Memory
  3. 2024VIMI: Grounding Video Generation through Multi-modal Instruction
  4. 2025NarrLV: Towards a Comprehensive Narrative-Centric Evaluation for Long Video Generation
  5. 2025One-Prompt-One-Story: Free-Lunch Consistent Text-to-Image Generation Using a Single Prompt
  6. 2026MemoGen: Can Past Experience Improve Future Text-to-Image Generation?
  7. 2023DirecT2V: Large Language Models are Frame-Level Directors for Zero-Shot Text-to-Video Generation
  8. 2025Video-As-Prompt: Unified Semantic Control for Video Generation