mlsanityData to 14 Oct 2026

VideoCoF: Unified Video Editing with Temporal Reasoner

arXiv 2512.07469 ↗First posted 8 Dec 2025cs.CVcited by 8

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Existing video editing methods face a critical trade-off: expert models offer precision but rely on task-specific priors like masks, hindering unification; conversely, unified temporal in-context learning models are mask-free but lack explicit spatial cues, leading to weak instruction-to-region mapping and imprecise localization. To resolve this conflict, we propose VideoCoF, a novel Chain-of-Frames approach inspired by Chain-of-Thought reasoning. VideoCoF enforces a ``see, reason, then edit" procedure by compelling the video diffusion model to first predict reasoning tokens (edit-region latents) before generating the target video tokens. This explicit reasoning step removes the need for user-provided masks while achieving precise instruction-to-region alignment and fine-grained video editing. Furthermore, we introduce a RoPE alignment strategy that leverages these reasoning tokens to ensure motion alignment and enable length extrapolation beyond the training duration. We demonstrate that with a minimal data cost of only 50k video pairs, VideoCoF achieves state-of-the-art performance on VideoCoF-Bench, validating the efficiency and effectiveness of our approach. Our code, weight, data are available at https://github.com/knightyxp/VideoCoF.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 63 of its 69 references that are in the map. First posted on arXiv 8 Dec 2025.

Builds on

63 of 69 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Video models are zero-shot learners and reasoners24 Sep
  2. 2025VEGGIE: Instructional Editing and Reasoning Video Concepts with Grounded Generation18 Mar

Other references · 61

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  4. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  5. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  6. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  7. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  8. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  9. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  10. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  11. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  12. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
38 more
  1. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  2. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
  3. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
  4. 2025VACE: All-in-One Video Creation and Editingcited by 479
  5. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
  6. 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 464
  7. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
  8. 2024OmniGen: Unified Image Generationcited by 394
  9. 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 320
  10. 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 204
  11. 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 201
  12. 2023MotionDirector: Motion Customization of Text-to-Video Diffusion Modelscited by 173
  13. 2024In-Context LoRA for Diffusion Transformerscited by 158
  14. 2023Space-Time Diffusion Features for Zero-Shot Text-Driven Motion Transfercited by 124
  15. 2023VidToMe: Video Token Merging for Zero-Shot Video Editingcited by 113
  16. 2023SimDA: Simple Diffusion Adapter for Efficient Video Generationcited by 101
  17. 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 87
  18. 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 84
  19. 2023Consistent Video-to-Video Transfer Using Synthetic Datasetcited by 81
  20. 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
  21. 2025DiffuEraser: A Diffusion Model for Video Inpaintingcited by 72
  22. 2023VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondencecited by 69
  23. 2025RIFLEx: A Free Lunch for Length Extrapolation in Video Diffusion Transformerscited by 66
  24. 2025Se~norita-2M: A High-Quality Instruction-based Dataset for General Video Editing by Video Specialistscited by 61
  25. 2023CVPR 2023 Text Guided Video Editing Competitioncited by 55
  26. 2025UNIC: Unified In-Context Video Editingcited by 55
  27. 2025EditVerse: Unifying Image and Video Editing and Generation with In-Context Learningcited by 54
  28. 2025VideoGrain: Modulating Space-Time Attention for Multi-grained Video Editingcited by 50
  29. 2024Large-Scale Text-to-Image Model with Inpainting is a Zero-Shot Subject-Driven Image Generatorcited by 48
  30. 2024StyleMaster: Stylize Your Video with Artistic Generation and Translationcited by 47
  31. 2025FullDiT: Multi-Task Video Generative Foundation Model with Full Attentioncited by 47
  32. 2025MiniMax-Remover: Taming Bad Noise Helps Video Object Removalcited by 45
  33. 2024Diffusion Model-Based Video Editing: A Surveycited by 44
  34. 2025VideoAnydoor: High-fidelity Video Object Insertion with Precise Motion Controlcited by 42
  35. 2024Video Editing via Factorized Diffusion Distillationcited by 41
  36. 2023Fairy: Fast Parallelized Instruction-Guided Video-to-Video Synthesiscited by 39
  37. 2024Generative Video Propagationcited by 36
  38. 2025In-Context Learning with Unpaired Clips for Instruction-based Video Editingcited by 35

50 most cited of 61 All 61 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026ThinkV2V: Unleashing the Reasoning Capability of MLLMs for Instruction-Guided Video Editing
  2. 2025Towards Reason-Informed Video Editing in Unified Models with Self-Reflective Learning
  3. 2025Are Image-to-Video Models Good Zero-Shot Image Editors?
  4. 2026Reasoning to Align: Implicit Reasoning in Diffusion Transformers for Video Editing
  5. 2026SAMA: Factorized Semantic Anchoring and Motion Alignment for Instruction-Guided Video Editing
  6. 2026Edit2Interp: Adapting Image Foundation Models from Spatial Editing to Video Frame Interpolation with Few-Shot Learning
  7. 2026OpenCoF: Learning to Reason Through Video Generation
  8. 2026LIVE: Leveraging Image Manipulation Priors for Instruction-based Video Editing