VideoCoF: Unified Video Editing with Temporal Reasoner
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Existing video editing methods face a critical trade-off: expert models offer precision but rely on task-specific priors like masks, hindering unification; conversely, unified temporal in-context learning models are mask-free but lack explicit spatial cues, leading to weak instruction-to-region mapping and imprecise localization. To resolve this conflict, we propose VideoCoF, a novel Chain-of-Frames approach inspired by Chain-of-Thought reasoning. VideoCoF enforces a ``see, reason, then edit" procedure by compelling the video diffusion model to first predict reasoning tokens (edit-region latents) before generating the target video tokens. This explicit reasoning step removes the need for user-provided masks while achieving precise instruction-to-region alignment and fine-grained video editing. Furthermore, we introduce a RoPE alignment strategy that leverages these reasoning tokens to ensure motion alignment and enable length extrapolation beyond the training duration. We demonstrate that with a minimal data cost of only 50k video pairs, VideoCoF achieves state-of-the-art performance on VideoCoF-Bench, validating the efficiency and effectiveness of our approach. Our code, weight, data are available at https://github.com/knightyxp/VideoCoF.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 63 of its 69 references that are in the map. First posted on arXiv 8 Dec 2025.
Builds on
63 of 69 references.
Closest ancestors · 2
Same direction, newest first
- 2025Video models are zero-shot learners and reasoners24 Sep
- 2025VEGGIE: Instructional Editing and Reasoning Video Concepts with Grounded Generation18 Mar
Other references · 61
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
38 more
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
- 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 464
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
- 2024OmniGen: Unified Image Generationcited by 394
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 320
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 204
- 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 201
- 2023MotionDirector: Motion Customization of Text-to-Video Diffusion Modelscited by 173
- 2024In-Context LoRA for Diffusion Transformerscited by 158
- 2023Space-Time Diffusion Features for Zero-Shot Text-Driven Motion Transfercited by 124
- 2023VidToMe: Video Token Merging for Zero-Shot Video Editingcited by 113
- 2023SimDA: Simple Diffusion Adapter for Efficient Video Generationcited by 101
- 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 87
- 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 84
- 2023Consistent Video-to-Video Transfer Using Synthetic Datasetcited by 81
- 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
- 2025DiffuEraser: A Diffusion Model for Video Inpaintingcited by 72
- 2023VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondencecited by 69
- 2025RIFLEx: A Free Lunch for Length Extrapolation in Video Diffusion Transformerscited by 66
- 2025Se~norita-2M: A High-Quality Instruction-based Dataset for General Video Editing by Video Specialistscited by 61
- 2023CVPR 2023 Text Guided Video Editing Competitioncited by 55
- 2025UNIC: Unified In-Context Video Editingcited by 55
- 2025EditVerse: Unifying Image and Video Editing and Generation with In-Context Learningcited by 54
- 2025VideoGrain: Modulating Space-Time Attention for Multi-grained Video Editingcited by 50
- 2024Large-Scale Text-to-Image Model with Inpainting is a Zero-Shot Subject-Driven Image Generatorcited by 48
- 2024StyleMaster: Stylize Your Video with Artistic Generation and Translationcited by 47
- 2025FullDiT: Multi-Task Video Generative Foundation Model with Full Attentioncited by 47
- 2025MiniMax-Remover: Taming Bad Noise Helps Video Object Removalcited by 45
- 2024Diffusion Model-Based Video Editing: A Surveycited by 44
- 2025VideoAnydoor: High-fidelity Video Object Insertion with Precise Motion Controlcited by 42
- 2024Video Editing via Factorized Diffusion Distillationcited by 41
- 2023Fairy: Fast Parallelized Instruction-Guided Video-to-Video Synthesiscited by 39
- 2024Generative Video Propagationcited by 36
- 2025In-Context Learning with Unpaired Clips for Instruction-based Video Editingcited by 35
50 most cited of 61 All 61 (JSON)
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026Aurora: Unified Video Editing with a Tool-Using Agentcited by 9
- 2026VideoArgus: Agentic Rubric-Grounded Unified Evaluation for Video Generation and Editingcited by 5
- 2026MiVE: Multiscale Vision-language features for reference-guided video Editingcited by 1
- 2026OmniTryOn: Video Try-On Anything at Once!cited by 1
- 2026ContextMaster: Interactive Multi-Shot Video Creation via Fixed-Budget Sparse Context Routingcited by 0
- 2026One Editor, Many Edits: A Unified Training-Free Framework for Diverse Video Editingcited by 0
- 2026ManiVid: Unified and Explainable Forensic Analysis of Manipulated Videoscited by 0
- 2026LongLive-Plug: Once-for-All Distillation for Video Generationcited by 0
- 2026LongLive-Plug: Once-for-All Distillation for Video Generation29 Sep 2026
- 2026ManiVid: Unified and Explainable Forensic Analysis of Manipulated Videos25 Sep 2026
- 2026One Editor, Many Edits: A Unified Training-Free Framework for Diverse Video Editing3 Sep 2026
- 2026VideoArgus: Agentic Rubric-Grounded Unified Evaluation for Video Generation and Editing6 Aug 2026
- 2026ContextMaster: Interactive Multi-Shot Video Creation via Fixed-Budget Sparse Context Routing5 Aug 2026
- 2026OmniTryOn: Video Try-On Anything at Once!7 Jun 2026
- 2026Aurora: Unified Video Editing with a Tool-Using Agent18 May 2026
- 2026MiVE: Multiscale Vision-language features for reference-guided video Editing14 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026ThinkV2V: Unleashing the Reasoning Capability of MLLMs for Instruction-Guided Video Editing
- 2025Towards Reason-Informed Video Editing in Unified Models with Self-Reflective Learning
- 2025Are Image-to-Video Models Good Zero-Shot Image Editors?
- 2026Reasoning to Align: Implicit Reasoning in Diffusion Transformers for Video Editing
- 2026SAMA: Factorized Semantic Anchoring and Motion Alignment for Instruction-Guided Video Editing
- 2026Edit2Interp: Adapting Image Foundation Models from Spatial Editing to Video Frame Interpolation with Few-Shot Learning
- 2026OpenCoF: Learning to Reason Through Video Generation
- 2026LIVE: Leveraging Image Manipulation Priors for Instruction-based Video Editing