mlsanityData to 7 Oct 2026

Memory-V2V: Memory-Augmented Video-to-Video Diffusion for Consistent Multi-Turn Editing

arXiv 2601.16296 ↗First posted 22 Jan 2026cs.CV cs.AI cs.LGcited by 2

On the map: Diffusion models → Video generation

Abstract (arXiv)

Video-to-video diffusion models achieve impressive single-turn editing performance, but practical editing workflows are inherently iterative. When edits are applied sequentially, existing models treat each turn independently, often causing previously generated regions to drift or be overwritten. We identify this failure mode as the problem of cross-turn consistency in multi-turn video editing. We introduce Memory-V2V, a memory-augmented framework that treats prior edits as structured constraints for subsequent generations. Memory-V2V maintains an external memory of previous outputs, retrieves task-relevant edits, and integrates them through relevance-aware tokenization and adaptive compression. These technical ingredients enable scalable conditioning without linear growth in computation. We demonstrate Memory-V2V on iterative video novel view synthesis and text-guided long video editing. Memory-V2V substantially enhances cross-turn consistency while maintaining visual quality, outperforming strong baselines with modest overhead.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 60 of its 67 references that are in the map. First posted on arXiv 22 Jan 2026.

Builds on

60 of 67 references.

Closest ancestors · 20

Same direction, newest first

  1. 2025LoViC: Efficient Long Video Generation with Context Compression17 Jul
  2. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusion9 Jun
  3. 2025Test-Time Training Done Right29 May
  4. 2025EPiC: Efficient Video Camera Control Learning with Precise Anchor-Video Guidance28 May
  5. 2025Long-Context State-Space Video World Models26 May
  6. 2025VSA: Faster Video Diffusion with Trainable Sparse Attention19 May
  7. 2025VACE: All-in-One Video Creation and Editing10 Mar
  8. 2025MALT Diffusion: Memory-Augmented Latent Transformers for Any-Length Video Generation18 Feb
  9. 2025Goku: Flow Based Video Generative Foundation Models7 Feb
  10. 2025Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsity3 Feb
  11. 2024FIFO-Diffusion: Generating Infinite Videos from Text without Training19 May
  12. 2024DreamMotion: Space-Time Self-Similar Score Distillation for Zero-Shot Video Editing18 Mar
8 more
  1. 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Models7 Dec
  2. 2023VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondence4 Dec
  3. 2023VMC: Video Motion Customization using Temporal Attention Adaption for Text-to-Video Diffusion Models1 Dec
  4. 2023FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editing9 Oct
  5. 2023Ground-A-Video: Zero-shot Grounded Video Editing using Text-to-image Diffusion Models2 Oct
  6. 2023CCEdit: Creative and Controllable Video Editing via Diffusion Models28 Sep
  7. 2023Pix2Video: Video Editing using Image Diffusion22 Mar
  8. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation22 Dec

Other references · 40

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  3. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  4. 2013Auto-Encoding Variational Bayescited by 3,980
  5. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  6. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  7. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  8. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
  9. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
  10. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
  11. 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
  12. 2025Continuous 3D Perception Model with Persistent Statecited by 527
28 more
  1. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
  2. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
  3. 2022Kubric: A scalable dataset generatorcited by 373
  4. 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 332
  5. 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
  6. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
  7. 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 214
  8. 2025Video models are zero-shot learners and reasonerscited by 208
  9. 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 178
  10. 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 157
  11. 2025WorldMem: Long-term Consistent World Simulation with Memorycited by 152
  12. 2023Space-Time Diffusion Features for Zero-Shot Text-Driven Motion Transfercited by 124
  13. 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 120
  14. 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesiscited by 116
  15. 2024Rolling Diffusion Modelscited by 102
  16. 2025VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View Memorycited by 102
  17. 2025One-Minute Video Generation with Test-Time Trainingcited by 100
  18. 2025HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixelscited by 91
  19. 2025Mixture of Contexts for Long Video Generationcited by 90
  20. 2024NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizercited by 79
  21. 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 76
  22. 2024ReCapture: Generative Video Camera Controls for User-Provided Videos using Masked Video Fine-Tuningcited by 68
  23. 2025Se~norita-2M: A High-Quality Instruction-based Dataset for General Video Editing by Video Specialistscited by 61
  24. 2025EditVerse: Unifying Image and Video Editing and Generation with In-Context Learningcited by 53
  25. 2023InstructVid2Vid: Controllable Video Editing with Natural Language Instructionscited by 44
  26. 2025Reangle-A-Video: 4D Video Generation as Video-to-Video Translationcited by 35
  27. 2025DynVFX: Augmenting Real Videos with Dynamic Contentcited by 9
  28. 2025LongAnimation: Long Animation Generation with Dynamic Global-Local Memorycited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025V2Edit: Versatile Video Diffusion Editor for Videos and 3D Scenes
  2. 2026Edit-VAR: Taming Visual Autoregressive Model for Precise Video Editing
  3. 2025Efficient Temporal Consistency in Diffusion-Based Video Editing with Adaptor Modules: A Theoretical Framework
  4. 2024COVE: Unleashing the Diffusion Feature Correspondence for Consistent Video Editing
  5. 2023Fairy: Fast Parallelized Instruction-Guided Video-to-Video Synthesis
  6. 2025Are Image-to-Video Models Good Zero-Shot Image Editors?
  7. 2024FastVideoEdit: Leveraging Consistency Models for Efficient Text-to-Video Editing
  8. 2026A2RD: Agentic Autoregressive Diffusion for Long Video Consistency