mlsanityData to 7 Oct 2026

Beyond Consistency: Preserving Temporal Structure in Zero-Shot Video Editing

arXiv 2606.08780 ↗First posted 7 Jun 2026cs.CVcited by 0

On the map: Diffusion models → Video generation

Abstract (arXiv)

Existing zero-shot video editing methods rely on pre-trained diffusion models, successfully achieving spatial control and basic temporal consistency but fundamentally fail to preserve the video's original temporal structure.This distinction is critical: temporal consistency ensures visual smoothness, but temporal structure dictates the video's high-level narrative, rhythm, and semantic flow. Without this preservation, the edited output, especially for long videos with complex semantic variations, becomes narratively incoherent and semantically ambiguous. To address this limitation, we introduce a novel zero-shot editing approach that, for the first time, explicitly focuses on preserving the source video's temporal structure. We achieve this by adaptively partitioning the video into semantically distinct clips based on feature similarity and selecting a representative anchor frame for each clip. To enhance both intra-clip fidelity and computational efficiency, we design a clip-adaptive token merging strategy which leverages the anchor's semantic dominance to stabilize the editing. Furthermore, we employ an alternating combination strategy that ensures seamless inter-clip transitions while maintaining semantic distinction. Extensive experiments demonstrate that our method achieves state-of-the-art results, successfully balancing the preservation of original temporal structure with computational efficiency, and setting a new benchmark for zero-shot video editing fidelity.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 42 of its 49 references that are in the map. First posted on arXiv 7 Jun 2026.

Builds on

42 of 49 references.

Closest ancestors · 17

Same direction, newest first

  1. 2025VideoGrain: Modulating Space-Time Attention for Multi-grained Video Editing24 Feb
  2. 2024Slicedit: Zero-Shot Video Editing With Text-to-Image Diffusion Models Using Spatio-Temporal Slices20 May
  3. 2024FRESCO: Spatial-Temporal Correspondence for Zero-Shot Video Translation19 Mar
  4. 2023VidToMe: Video Token Merging for Zero-Shot Video Editing17 Dec
  5. 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Models7 Dec
  6. 2023FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editing9 Oct
  7. 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation13 Jun
  8. 2023Towards Consistent Video Editing with Text-to-Image Diffusion Models27 May
  9. 2023ControlVideo: Training-free Controllable Text-to-Video Generation22 May
  10. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models18 Apr
  11. 2023Zero-Shot Video Editing Using Off-The-Shelf Image Diffusion Models30 Mar
  12. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generators23 Mar
5 more
  1. 2023Pix2Video: Video Editing using Image Diffusion22 Mar
  2. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editing16 Mar
  3. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation22 Dec
  4. 2022Imagen Video: High Definition Video Generation with Diffusion Models5 Oct
  5. 2022Video Diffusion Models7 Apr

Other references · 25

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  7. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  8. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  9. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  10. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  11. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  12. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
13 more
  1. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
  2. 2022Diffusion Models in Vision: A Surveycited by 1,008
  3. 2022Token Merging: Your ViT But Fastercited by 995
  4. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
  5. 2023Zero-shot Image-to-Image Translationcited by 503
  6. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
  7. 2023Emergent Correspondence from Image Diffusioncited by 437
  8. 2017Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolationcited by 321
  9. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 312
  10. 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
  11. 2024MiraData: A Large-Scale Video Dataset with Long Durations and Structured Captionscited by 144
  12. 2024FastEdit: Fast Text-Guided Single-Image Editing via Semantic-Aware Diffusion Fine-Tuningcited by 10
  13. 2025AdaFlow: Efficient Long Video Editing via Adaptive Attention Slimming And Keyframe Selectioncited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Zero-Shot Video Translation and Editing with Frame Spatial-Temporal Correspondence
  2. 2023Edit Temporal-Consistent Videos with Image Diffusion Model
  3. 2025Are Image-to-Video Models Good Zero-Shot Image Editors?
  4. 2023VidEdit: Zero-Shot and Spatially Aware Text-Driven Video Editing
  5. 2023Edit-A-Video: Single Video Editing with Object-Aware Consistency
  6. 2024FastVideoEdit: Leveraging Consistency Models for Efficient Text-to-Video Editing
  7. 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editing
  8. 2023EVE: Efficient zero-shot text-based Video Editing with Depth Map Guidance and Temporal Consistency Constraints