VALA: Learning Latent Anchors for Training-Free and Temporally Consistent
On the map: Diffusion models → Video generation
Abstract (arXiv)
Recent advances in training-free video editing have enabled lightweight and precise cross-frame generation by leveraging pre-trained text-to-image diffusion models. However, existing methods often rely on heuristic frame selection to maintain temporal consistency during DDIM inversion, which introduces manual bias and reduces the scalability of end-to-end inference. In this paper, we propose~VALA (Variational Alignment for Latent Anchors), a variational alignment module that adaptively selects key frames and compresses their latent features into semantic anchors for consistent video editing. To learn meaningful assignments, VALA propose a variational framework with a contrastive learning objective. Therefore, it can transform cross-frame latent representations into compressed latent anchors that preserve both content and temporal coherence. Our method can be fully integrated into training-free text-to-image based video editing models. Extensive experiments on real-world video editing benchmarks show that VALA achieves state-of-the-art performance in inversion fidelity, editing quality, and temporal consistency, while offering improved efficiency over prior methods.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 23 of its 31 references that are in the map. First posted on arXiv 27 Oct 2025.
Builds on
23 of 31 references.
Closest ancestors · 9
Same direction, newest first
- 2025VideoGrain: Modulating Space-Time Attention for Multi-grained Video Editing24 Feb
- 2024DeCo: Decoupled Human-Centered Diffusion Video Editing with Motion Consistency14 Aug
- 2024COVE: Unleashing the Diffusion Feature Correspondence for Consistent Video Editing13 Jun
- 2024Slicedit: Zero-Shot Video Editing With Text-to-Image Diffusion Models Using Spatio-Temporal Slices20 May
- 2024Object-Centric Diffusion for Efficient Video Editing11 Jan
- 2023VidToMe: Video Token Merging for Zero-Shot Video Editing17 Dec
- 2023A Video is Worth 256 Bases: Spatial-Temporal Expectation-Maximization Inversion for Zero-Shot Video Editing10 Dec
- 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Models7 Dec
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editing16 Mar
Other references · 14
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2017Neural Discrete Representation Learningcited by 4,650
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 942
- 2016Ladder Variational Autoencoderscited by 315
- 2017InfoVAE: Information Maximizing Variational Autoencoderscited by 124
2 more
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SAMA: Factorized Semantic Anchoring and Motion Alignment for Instruction-Guided Video Editing
- 2025Efficient Temporal Consistency in Diffusion-Based Video Editing with Adaptor Modules: A Theoretical Framework
- 2025Enhancing Low-Cost Video Editing with Lightweight Adaptors and Temporal-Aware Inversion
- 2026Edit-VAR: Taming Visual Autoregressive Model for Precise Video Editing
- 2023LOVECon: Text-driven Training-Free Long Video Editing with ControlNet
- 2025Inference-Time Text-to-Video Alignment with Diffusion Latent Beam Search
- 2023SAVE: Spectral-Shift-Aware Adaptation of Image Diffusion Models for Text-driven Video Editing
- 2026Reasoning to Align: Implicit Reasoning in Diffusion Transformers for Video Editing