mlsanityData to 14 Oct 2026

DAPE: Dual-Stage Parameter-Efficient Fine-Tuning for Consistent Video Editing with Diffusion Models

arXiv 2505.07057 ↗First posted 11 May 2025cs.CVcited by 2

On the map: Diffusion models → Video generation

Abstract (arXiv)

Video generation based on diffusion models presents a challenging multimodal task, with video editing emerging as a pivotal direction in this field. Recent video editing approaches primarily fall into two categories: training-required and training-free methods. While training-based methods incur high computational costs, training-free alternatives often yield suboptimal performance. To address these limitations, we propose DAPE, a high-quality yet cost-effective two-stage parameter-efficient fine-tuning (PEFT) framework for video editing. In the first stage, we design an efficient norm-tuning method to enhance temporal consistency in generated videos. The second stage introduces a vision-friendly adapter to improve visual quality. Additionally, we identify critical shortcomings in existing benchmarks, including limited category diversity, imbalanced object distribution, and inconsistent frame counts. To mitigate these issues, we curate a large dataset benchmark comprising 232 videos with rich annotations and 6 editing prompts, enabling objective and comprehensive evaluation of advanced methods. Extensive experiments on existing datasets (BalanceCC, LOVEU-TGVE, RAVE) and our proposed benchmark demonstrate that DAPE significantly improves temporal coherence and text-video alignment while outperforming previous state-of-the-art approaches.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 36 of its 59 references that are in the map. First posted on arXiv 11 May 2025.

Builds on

36 of 59 references.

Closest ancestors · 12

Same direction, newest first

  1. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  2. 2024Diffusion Model-Based Video Editing: A Survey26 Jun
  3. 2024ExVideo: Extending Video Diffusion Models via Parameter-Efficient Post-Tuning20 Jun
  4. 2023VidToMe: Video Token Merging for Zero-Shot Video Editing17 Dec
  5. 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Models7 Dec
  6. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  7. 2023A Survey on Video Diffusion Models16 Oct
  8. 2023CCEdit: Creative and Controllable Video Editing via Diffusion Models28 Sep
  9. 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation13 Jun
  10. 2023ControlVideo: Training-free Controllable Text-to-Video Generation22 May
  11. 2023Latent-Shift: Latent Diffusion with Temporal Shift for Efficient Text-to-Video Generation17 Apr
  12. 2022Imagen Video: High Definition Video Generation with Diffusion Models5 Oct

Other references · 24

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 2020Denoising Diffusion Implicit Modelscited by 9,781
  3. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  5. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  6. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  7. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  8. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  9. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  10. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  11. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
  12. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
12 more
  1. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,177
  2. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 647
  3. 2019VATEX: A Large-Scale, High-Quality Multilingual Dataset for Video-and-Language Researchcited by 414
  4. 2017Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolationcited by 326
  5. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
  6. 2018Learning Blind Video Temporal Consistencycited by 253
  7. 2023Swap Attention in Spatiotemporal Diffusions for Text-to-Video Generationcited by 154
  8. 2023SimDA: Simple Diffusion Adapter for Efficient Video Generationcited by 101
  9. 2023Edit-A-Video: Single Video Editing with Object-Aware Consistencycited by 67
  10. 2024EgoVid-5M: A Large-Scale Video-Action Dataset for Egocentric Video Generationcited by 41
  11. 2023Strong Baselines for Parameter Efficient Few-Shot Fine-tuningcited by 37
  12. 20245%>100%: Breaking Performance Shackles of Full Fine-Tuning on Visual Recognition Taskscited by 34

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025FiVE: A Fine-grained Video Editing Benchmark for Evaluating Emerging Diffusion and Rectified Flow Models
  2. 2025Efficient Temporal Consistency in Diffusion-Based Video Editing with Adaptor Modules: A Theoretical Framework
  3. 2024I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Models
  4. 2024Temporally Consistent Object Editing in Videos using Extended Attention
  5. 2024EffiVED:Efficient Video Editing via Text-instruction Diffusion Models
  6. 2023LOVECon: Text-driven Training-Free Long Video Editing with ControlNet
  7. 2024FastVideoEdit: Leveraging Consistency Models for Efficient Text-to-Video Editing
  8. 2025Temporal In-Context Fine-Tuning with Temporal Reasoning for Versatile Control of Video Diffusion Models