FFP-300K: Scaling First-Frame Propagation for Generalizable Video Editing
Not on the map. Why?
Abstract (arXiv)
First-Frame Propagation (FFP) offers a promising paradigm for controllable video editing, but existing methods are hampered by a reliance on cumbersome run-time guidance. We identify the root cause of this limitation as the inadequacy of current training datasets, which are often too short, low-resolution, and lack the task diversity required to teach robust temporal priors. To address this foundational data gap, we first introduce FFP-300K, a new large-scale dataset comprising 300K high-fidelity video pairs at 720p resolution and 81 frames in length, constructed via a principled two-track pipeline for diverse local and global edits. Building on this dataset, we propose a novel framework designed for true guidance-free FFP that resolves the critical tension between maintaining first-frame appearance and preserving source video motion. Architecturally, we introduce Adaptive Spatio-Temporal RoPE (AST-RoPE), which dynamically remaps positional encodings to disentangle appearance and motion references. At the objective level, we employ a self-distillation strategy where an identity propagation task acts as a powerful regularizer, ensuring long-term temporal stability and preventing semantic drift. Comprehensive experiments on the EditVerseBench benchmark demonstrate that our method significantly outperforming existing academic and commercial models by receiving about 0.2 PickScore and 0.3 VLM score improvement against these competitors.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 31 of its 37 references that are in the map. First posted on arXiv 5 Jan 2026.
Builds on
31 of 37 references.
References · 31
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2024GPT-4o System Cardcited by 4,588
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2024Depth Anything V2cited by 1,422
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2025Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsitycited by 217
- 2024TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generationcited by 202
19 more
- 2024Koala-36M: A Large-scale Video Dataset Improving Consistency between Fine-grained Conditions and Video Contentcited by 135
- 2023Space-Time Diffusion Features for Zero-Shot Text-Driven Motion Transfercited by 124
- 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Modelscited by 98
- 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 84
- 2023Consistent Video-to-Video Transfer Using Synthetic Datasetcited by 81
- 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
- 2023VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondencecited by 69
- 2025InsViE-1M: Effective Instruction-based Video Editing with Elaborate Dataset Constructioncited by 62
- 2025Se~norita-2M: A High-Quality Instruction-based Dataset for General Video Editing by Video Specialistscited by 61
- 2024I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Modelscited by 55
- 2025EditVerse: Unifying Image and Video Editing and Generation with In-Context Learningcited by 54
- 2024VideoDirector: Precise Video Editing via Text-to-Video Modelscited by 36
- 2024Generative Video Propagationcited by 36
- 2025OmniStyle: Filtering High Quality Style Transfer Data at Scalecited by 30
- 2025IVEBench: Modern Benchmark Suite for Instruction-Guided Video Editing Assessmentcited by 28
- 2024Videoshop: Localized Semantic Video Editing with Noise-Extrapolated Diffusion Inversioncited by 27
- 2024StableV2V: Stablizing Shape Consistency in Video-to-Video Editingcited by 26
- 2024VIVID-10M: A Dataset and Baseline for Versatile and Interactive Video Local Editingcited by 25
- 2024EffiVED:Efficient Video Editing via Text-instruction Diffusion Modelscited by 21
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026SAMA: Factorized Semantic Anchoring and Motion Alignment for Instruction-Guided Video Editingcited by 8
- 2026SparkVSR: Interactive Video Super-Resolution via Sparse Keyframe Propagationcited by 5
- 2026JAVEDIT: Joint Audio-Visual Instruction-Guided Video Editing with Agentic Data Curationcited by 2
- 2026RefVideo-6M: A Reliable Reference-Based Dataset for Instructional Video Editingcited by 0
- 2026EditaLive! Unified Character Video Editing for Live Streamingcited by 0
- 2026EditaLive! Unified Character Video Editing for Live Streaming27 Aug 2026
- 2026RefVideo-6M: A Reliable Reference-Based Dataset for Instructional Video Editing26 Aug 2026
- 2026JAVEDIT: Joint Audio-Visual Instruction-Guided Video Editing with Agentic Data Curation2 Jun 2026
- 2026SAMA: Factorized Semantic Anchoring and Motion Alignment for Instruction-Guided Video Editing19 Mar 2026
- 2026SparkVSR: Interactive Video Super-Resolution via Sparse Keyframe Propagation17 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025LoRA-Edit: Controllable First-Frame-Guided Video Editing via Mask-Aware LoRA Fine-Tuning
- 2026PropFly: Learning to Propagate via On-the-Fly Supervision from Pre-trained Video Diffusion Models
- 2026Transforming Image Editors into Video Editors
- 2026OSVE: One Step Video Editing with One Step Diffusion Models
- 2026VINCIE-NExT: Unlocking Video Editing from Images via In-Context Modeling
- 2025Edit as You See: Image-guided Video Editing via Masked Motion Modeling
- 2025FramePainter: Endowing Interactive Image Editing with Video Diffusion Priors
- 2026Occlusion-Aware Physics-Semantic Keyframe Selection for Robust Video Editing