MoCA-Video: Motion-Aware Concept Alignment for Consistent Video Editing
Not on the map. Why?
Abstract (arXiv)
Unlike traditional video editing or inpainting, video semantic mixing fuses a reference concept with a moving target entity to produce a hybrid while preserving the source video's motion and layout. We propose MoCA-Video, a training-free framework that steers a frozen video-diffusion denoising trajectory through concept-localized reference injection. At selected low-noise steps, MoCA-Video uses concept attention to localize the target object and injects the reference latent into the localized region, where object structure has formed but appearance remains editable. A momentum-based correction carries the injected prediction across frames to encourage coherent concept integration through the sequence. We further introduce CASS, a CLIP-based metric that measures the output's directional alignment shift toward the reference and away from the source prompt. Using the denoiser's internal attention avoids an external localization model; in our A100 FP16 setup, MoCA-Video takes 3.2 seconds per output frame, excluding preprocessing. Across the evaluated baselines, MoCA-Video achieves the highest CASS, rel-CASS, and ImageReward, while LPIPS-T and FVD expose separate temporal-coherence and video-quality trade-offs.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 28 of its 31 references that are in the map. First posted on arXiv 1 Jun 2025.
Builds on
28 of 31 references.
References · 28
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2022Video Diffusion Modelscited by 2,305
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
16 more
- 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 158
- 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 154
- 2024FIFO-Diffusion: Generating Infinite Videos from Text without Trainingcited by 137
- 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 124
- 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Modelscited by 114
- 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 84
- 2023MagicEdit: High-Fidelity and Temporally Coherent Video Editingcited by 76
- 2022MagicMix: Semantic Mixing with Diffusion Modelscited by 63
- 2023Putting People in Their Place: Affordance-Aware Human Insertion into Scenescited by 53
- 2024DreamVideo-2: Zero-Shot Subject-Driven Video Customization with Precise Motion Controlcited by 43
- 2025MagicMirror: ID-Preserved Video Generation in Video Diffusion Transformerscited by 34
- 2024DIVE: Taming DINO for Subject-Driven Video Editingcited by 17
- 2024ObjectMate: A Recurrence Prior for Object Insertion and Subject-Driven Generationcited by 16
- 2025EchoVideo: Identity-Preserving Human Video Generation by Multimodal Feature Fusioncited by 12
- 2025FreeBlend: Advancing Concept Blending with Staged Feedback-Driven Interpolation Diffusioncited by 8
- 2024Affordance-Aware Object Insertion via Mask-Aware Dual Diffusioncited by 6
Built on by
Citing papers per year: 2025: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026SAMA: Factorized Semantic Anchoring and Motion Alignment for Instruction-Guided Video Editing
- 2026Beyond Consistency: Preserving Temporal Structure in Zero-Shot Video Editing
- 2025MoAlign: Motion-Centric Representation Alignment for Video Diffusion Models
- 2025Efficient Temporal Consistency in Diffusion-Based Video Editing with Adaptor Modules: A Theoretical Framework
- 2024Shaping a Stabilized Video by Mitigating Unintended Changes for Concept-Augmented Video Editing
- 2026Occlusion-Aware Physics-Semantic Keyframe Selection for Robust Video Editing
- 2026Accelerating Diffusion-based Video Editing via Heterogeneous Caching: Beyond Full Computing at Sampled Denoising Timestep
- 2024Temporally Consistent Object Editing in Videos using Extended Attention