Soap2Soap: Long Cinematic Video Remaking via Multi-Agent Collaboration
Not on the map. Why?
Abstract (arXiv)
We study series-level cinematic remaking, a long-horizon video-to-video generation problem that localizes full episodes or films via stylization or actor replacement while strictly preserving narrative structure, motion choreography, and character identity across hundreds of shots. Existing video generation and editing pipelines often break down in this regime due to compounding identity drift, background mutation, and semantic erosion under large camera motions and viewpoint changes. We propose Soap2Soap, a multi-agent framework that enforces long-term language-visual consistency through a Dual-Bridge Consistency mechanism: a scene-aware JSON screenplay serving as a persistent semantic backbone, and dynamically allocated visual reference anchors at both scene and shot levels. To suppress drift before video synthesis, we introduce batch keyframe consistency, jointly generating multiple keyframes in a shared latent context via a grid-based formulation. A closed-loop verification agent further audits identity, stability, and alignment to trigger selective regeneration. Experiments on SoapBench demonstrate strong improvements over commercial video generation APIs in long-term consistency and narrative fidelity.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 43 of its 52 references that are in the map. First posted on arXiv 17 May 2026.
Builds on
43 of 52 references.
References · 43
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
- 2023ViperGPT: Visual Inference via Python Execution for Reasoningcited by 591
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 424
- 2023Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaborationcited by 246
- 2025Video models are zero-shot learners and reasonerscited by 208
- 2022Learning Video Representations from Large Language Modelscited by 204
- 2023Video Understanding with Large Language Models: A Surveycited by 203
31 more
- 2023VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Datasetcited by 168
- 2023VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planningcited by 138
- 2023Theory of Mind for Multi-Agent Collaboration via Large Language Modelscited by 129
- 2025Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Modelscited by 126
- 2025AdaWorld: Learning Adaptable World Models with Latent Actionscited by 108
- 2024An Image Grid Can Be Worth a Video: Zero-shot Video Question Answering Using a VLMcited by 97
- 2023MM-VID: Advancing Video Understanding with GPT-4V(ision)cited by 82
- 2025Automated Movie Generation via Multi-Agent CoT Planningcited by 82
- 2024MoReVQA: Exploring Modular Reasoning Models for Video Question Answeringcited by 74
- 2025Kling-Omni Technical Reportcited by 60
- 2025Long-Context State-Space Video World Modelscited by 59
- 2024Language Repository for Long Video Understandingcited by 55
- 2024EventHallusion: Diagnosing Event Hallucinations in Video LLMscited by 55
- 2020DMD: A Large-Scale Multi-Modal Driver Monitoring Dataset for Attention and Alertness Analysiscited by 47
- 2023Video ChatCaptioner: Towards Enriched Spatiotemporal Descriptionscited by 42
- 2024ProcessPainter: Learn Painting Process from Sequence Datacited by 37
- 2025StoryMem: Multi-shot Long Video Storytelling with Memorycited by 35
- 2025MultiShotMaster: A Controllable Multi-Shot Video Generation Frameworkcited by 33
- 2025FilmAgent: A Multi-Agent Framework for End-to-End Film Automation in Virtual 3D Spacescited by 28
- 2024AgentCoord: Visually Exploring Coordination Strategy for LLM-based Multi-Agent Collaborationcited by 26
- 2025TransAnimate: Taming Layer Diffusion to Generate RGBA Videocited by 24
- 2025SCAIL: Towards Studio-Grade Character Animation via In-Context Learning of 3D-Consistent Pose Representationscited by 13
- 2025Mitty: Diffusion-based Human-to-Robot Video Generationcited by 13
- 2025X-Humanoid: Robotize Human Videos to Generate Humanoid Videos at Scalecited by 12
- 2025WorldWander: Bridging Egocentric and Exocentric Worlds in Video Generationcited by 9
- 2025VLog: Video-Language Models by Generative Retrieval of Narration Vocabularycited by 7
- 2026MoCha:End-to-End Video Character Replacement without Structural Guidancecited by 6
- 2024ScreenWriter: Automatic Screenplay Generation and Movie Summarisationcited by 5
- 2025IC-Effect: Precise and Efficient Video Effects Editing via In-Context Learningcited by 4
- 2025CoAgent: Collaborative Planning and Consistency Agent for Coherent Video Generationcited by 4
- 2025FramePrompt: In-context Controllable Animation with Zero Structural Changescited by 1
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Prompt-Adapter Context Routing for Parameter-Efficient Multi-Shot Long Video Extrapolationcited by 0
- 2026Thinking on Shots: Consistent Multi-Shot Video Editing with Agentic Reasoningcited by 0
- 2026DramaChain Bench: An End-to-End Benchmark for Short-Drama Generationcited by 0
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 0
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026DramaChain Bench: An End-to-End Benchmark for Short-Drama Generation1 Sep 2026
- 2026Thinking on Shots: Consistent Multi-Shot Video Editing with Agentic Reasoning27 Aug 2026
- 2026Prompt-Adapter Context Routing for Parameter-Efficient Multi-Shot Long Video Extrapolation7 Jul 2026