mlsanityData to 14 Oct 2026

MoCA-Video: Motion-Aware Concept Alignment for Consistent Video Editing

arXiv 2506.01004 ↗First posted 1 Jun 2025cs.CV cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Unlike traditional video editing or inpainting, video semantic mixing fuses a reference concept with a moving target entity to produce a hybrid while preserving the source video's motion and layout. We propose MoCA-Video, a training-free framework that steers a frozen video-diffusion denoising trajectory through concept-localized reference injection. At selected low-noise steps, MoCA-Video uses concept attention to localize the target object and injects the reference latent into the localized region, where object structure has formed but appearance remains editable. A momentum-based correction carries the injected prediction across frames to encourage coherent concept integration through the sequence. We further introduce CASS, a CLIP-based metric that measures the output's directional alignment shift toward the reference and away from the source prompt. Using the denoiser's internal attention avoids an external localization model; in our A100 FP16 setup, MoCA-Video takes 3.2 seconds per output frame, excluding preprocessing. Across the evaluated baselines, MoCA-Video achieves the highest CASS, rel-CASS, and ImageReward, while LPIPS-T and FVD expose separate temporal-coherence and video-quality trade-offs.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 28 of its 31 references that are in the map. First posted on arXiv 1 Jun 2025.

Builds on

28 of 31 references.

References · 28

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 2020Denoising Diffusion Implicit Modelscited by 9,781
  3. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  4. 2022Video Diffusion Modelscited by 2,305
  5. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  6. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  7. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  8. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
  9. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
  10. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
  11. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
  12. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
16 more
  1. 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 158
  2. 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 154
  3. 2024FIFO-Diffusion: Generating Infinite Videos from Text without Trainingcited by 137
  4. 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 124
  5. 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Modelscited by 114
  6. 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 84
  7. 2023MagicEdit: High-Fidelity and Temporally Coherent Video Editingcited by 76
  8. 2022MagicMix: Semantic Mixing with Diffusion Modelscited by 63
  9. 2023Putting People in Their Place: Affordance-Aware Human Insertion into Scenescited by 53
  10. 2024DreamVideo-2: Zero-Shot Subject-Driven Video Customization with Precise Motion Controlcited by 43
  11. 2025MagicMirror: ID-Preserved Video Generation in Video Diffusion Transformerscited by 34
  12. 2024DIVE: Taming DINO for Subject-Driven Video Editingcited by 17
  13. 2024ObjectMate: A Recurrence Prior for Object Insertion and Subject-Driven Generationcited by 16
  14. 2025EchoVideo: Identity-Preserving Human Video Generation by Multimodal Feature Fusioncited by 12
  15. 2025FreeBlend: Advancing Concept Blending with Staged Feedback-Driven Interpolation Diffusioncited by 8
  16. 2024Affordance-Aware Object Insertion via Mask-Aware Dual Diffusioncited by 6

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026SAMA: Factorized Semantic Anchoring and Motion Alignment for Instruction-Guided Video Editing
  2. 2026Beyond Consistency: Preserving Temporal Structure in Zero-Shot Video Editing
  3. 2025MoAlign: Motion-Centric Representation Alignment for Video Diffusion Models
  4. 2025Efficient Temporal Consistency in Diffusion-Based Video Editing with Adaptor Modules: A Theoretical Framework
  5. 2024Shaping a Stabilized Video by Mitigating Unintended Changes for Concept-Augmented Video Editing
  6. 2026Occlusion-Aware Physics-Semantic Keyframe Selection for Robust Video Editing
  7. 2026Accelerating Diffusion-based Video Editing via Heterogeneous Caching: Beyond Full Computing at Sampled Denoising Timestep
  8. 2024Temporally Consistent Object Editing in Videos using Extended Attention