mlsanityData to 7 Oct 2026

Vera: A Layered Diffusion Model for Content-Preserving Video Editing

arXiv 2606.23610 ↗First posted 22 Jun 2026cs.CVcited by 0

On the map: Diffusion models → Video generation

Abstract (arXiv)

Video diffusion models have enabled remarkable progress in video generation and editing. However, content preservation remains a core challenge: existing methods regenerate every pixel and often alter elements that should remain unchanged, such as characters or background scenes. We introduce Vera, a layered diffusion framework for content-preserving video editing. Instead of regenerating the entire video, Vera generates an edit layer along with an alpha matte for compositing with the source video, separating creative editing from content preservation by design. To encourage coherent composition with the source video, we extend the text-to-video DiT into a Mixture-of-Transformers (MoT) architecture, with separate DiTs for each layer that interact through joint self-attention. To support the training of Vera, we further construct a high-quality layered dataset with accurate alpha mattes, diverse scenes and dynamics, and visual effects. Across our quantitative benchmark and human preference study, Vera outperforms leading open-source video editing models in content preservation while remaining competitive in edit quality, using 486K frames of layered training data.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 46 of its 61 references that are in the map. First posted on arXiv 22 Jun 2026.

Builds on

46 of 61 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025VACE: All-in-One Video Creation and Editing10 Mar
  2. 2024LTX-Video: Realtime Video Latent Diffusion30 Dec
  3. 2024VIVID-10M: A Dataset and Baseline for Versatile and Interactive Video Local Editing22 Nov
  4. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  5. 2023Structure and Content-Guided Video Synthesis with Diffusion Models6 Feb

Other references · 41

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  3. 2022Flow Matching for Generative Modelingcited by 5,426
  4. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  5. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  6. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  7. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  8. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  9. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  10. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  11. 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 942
  12. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
29 more
  1. 2025SAM 3: Segment Anything with Conceptscited by 835
  2. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
  3. 2023Any-to-Any Generation via Composable Diffusioncited by 203
  4. 2020Real-Time High-Resolution Background Mattingcited by 172
  5. 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 151
  6. 2024Transparent Image Layer Diffusion using Latent Transparencycited by 111
  7. 2019The 2019 DAVIS Challenge on VOS: Unsupervised Multi-Object Segmentationcited by 95
  8. 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 83
  9. 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 76
  10. 2025Se~norita-2M: A High-Quality Instruction-based Dataset for General Video Editing by Video Specialistscited by 61
  11. 2024CoCoCo: Improving Text-Guided Video Inpainting for Better Consistency, Controllability and Compatibilitycited by 49
  12. 2025MiniMax-Remover: Taming Bad Noise Helps Video Object Removalcited by 42
  13. 2024Generative Omnimatte: Learning to Decompose Video into Layerscited by 38
  14. 2025Light-A-Video: Training-free Video Relighting via Progressive Light Fusioncited by 38
  15. 2025In-Context Learning with Unpaired Clips for Instruction-based Video Editingcited by 34
  16. 2024Generative Image Layer Decomposition with Visual Effectscited by 33
  17. 2025Qwen-Image-Layered: Towards Inherent Editability via Layer Decompositioncited by 29
  18. 2025IVEBench: Modern Benchmark Suite for Instruction-Guided Video Editing Assessmentcited by 27
  19. 2025MatAnyone: Stable Video Matting with Consistent Memory Propagationcited by 24
  20. 2025Region-Constraint In-Context Generation for Instructional Video Editingcited by 22
  21. 2024LayerFusion: Harmonized Multi-Layer Text-to-Image Generation with Generative Priorscited by 19
  22. 2025Video-As-Prompt: Unified Semantic Control for Video Generationcited by 13
  23. 2025TransPixeler: Advancing Text-to-Video Generation with Transparencycited by 12
  24. 2025VFXMaster: Unlocking Dynamic Visual Effect Generation via In-Context Learningcited by 12
  25. 2025LayerFlow: A Unified Model for Layer-aware Video Generationcited by 9
  26. 2025LayerEdit: Disentangled Multi-Object Editing via Conflict-Aware Multi-Layer Learningcited by 7
  27. 2025Video Generation with Stable Transparency via Shiftable RGB-A Distribution Learnercited by 6
  28. 2026EditCtrl: Disentangled Local and Global Control for Real-Time Generative Video Editingcited by 4
  29. 2026VideoMaMa: Mask-Guided Video Matting via Generative Priorcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editing
  2. 2025FADE: Frequency-Aware Diffusion Model Factorization for Video Editing
  3. 2024Streamlining Image Editing with Layered Diffusion Brushes
  4. 2025TV-LiVE: Training-Free, Text-Guided Video Editing via Layer Informed Vitality Exploitation
  5. 2023Dreamix: Video Diffusion Models are General Video Editors
  6. 2023Pix2Video: Video Editing using Image Diffusion
  7. 2023CCEdit: Creative and Controllable Video Editing via Diffusion Models
  8. 2025V2Edit: Versatile Video Diffusion Editor for Videos and 3D Scenes