mlsanityData to 14 Oct 2026

Towards Reason-Informed Video Editing in Unified Models with Self-Reflective Learning

arXiv 2512.09924 ↗First posted 10 Dec 2025cs.CVcited by 7

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Unified video models exhibit strong capabilities in understanding and generation, yet they struggle with reason-informed visual editing even when equipped with powerful internal vision-language models (VLMs). We attribute this gap to two factors: (1) existing datasets are inadequate for training and evaluating reasoning-aware video editing, and (2) an inherent disconnect between the models' reasoning and editing capabilities, which prevents understanding from guiding the editing process. To address this, we introduce the Reason-Informed Video Editing (RVE) task, which requires reasoning about physical plausibility and causal dynamics during editing. To support systematic evaluation, we construct RVE-Bench, a comprehensive benchmark with two complementary subsets: Reasoning-Aware Video Editing (RAVE) and In-Context Video-to-Video Generation (ICVG), spanning diverse reasoning dimensions across both editing and generation scenarios. Building upon this foundation, we propose ReViSE, a self-reflective learning framework that harnesses the model's internal VLM to evaluate and refine its own generation during training. Unlike prior reward-based approaches that rely on external critics, ReViSE leverages the model's internal VLM as a self-reflective evaluator, providing differentiable feedback that directly refines the generator's reasoning behavior during training. Extensive experiments on RVE-Bench demonstrate that ReViSE enhances editing accuracy and visual fidelity, outperforming the finetuned counterpart by 10% in Overall score on the RAVE subset, demonstrating the effectiveness of self-reflective differentiable reward.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 74 of its 79 references that are in the map. First posted on arXiv 10 Dec 2025.

Builds on

74 of 79 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Video models are zero-shot learners and reasoners24 Sep
  2. 2025VEGGIE: Instructional Editing and Reasoning Video Concepts with Grounded Generation18 Mar

Other references · 72

  1. 2022Scalable Diffusion Models with Transformerscited by 6,054
  2. 2025Qwen2.5-VL Technical Reportcited by 5,587
  3. 2024GPT-4o System Cardcited by 4,588
  4. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  5. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  6. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  7. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
  8. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
  9. 2023Training Diffusion Models with Reinforcement Learningcited by 982
  10. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
  11. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  12. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
38 more
  1. 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 658
  2. 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 590
  3. 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 497
  4. 2025VACE: All-in-One Video Creation and Editingcited by 479
  5. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
  6. 2023Generative Multimodal Models are In-Context Learnerscited by 446
  7. 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 413
  8. 2023Pix2Video: Video Editing using Image Diffusioncited by 320
  9. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
  10. 2023DreamLLM: Synergistic Multimodal Comprehension and Creationcited by 297
  11. 2024VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationcited by 295
  12. 2025Improving Video Generation with Human Feedbackcited by 284
  13. 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 253
  14. 2025Transfer between Modalities with MetaQueriescited by 236
  15. 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 204
  16. 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 201
  17. 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 188
  18. 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editingcited by 183
  19. 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 154
  20. 2024Video Diffusion Alignment via Reward Gradientscited by 107
  21. 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editingcited by 99
  22. 2025Masked Autoencoders Are Effective Tokenizers for Diffusion Modelscited by 96
  23. 2023InstructVideo: Instructing Video Diffusion Models with Human Feedbackcited by 86
  24. 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 84
  25. 2023Consistent Video-to-Video Transfer Using Synthetic Datasetcited by 81
  26. 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 79
  27. 2022VIDM: Video Implicit Diffusion Modelscited by 78
  28. 2024Calibrated Self-Rewarding Vision Language Modelscited by 78
  29. 2025RewardDance: Reward Scaling in Visual Generationcited by 68
  30. 2025InsViE-1M: Effective Instruction-based Video Editing with Elaborate Dataset Constructioncited by 62
  31. 2025Se~norita-2M: A High-Quality Instruction-based Dataset for General Video Editing by Video Specialistscited by 61
  32. 2024I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Modelscited by 55
  33. 2025UNIC: Unified In-Context Video Editingcited by 55
  34. 2024CoCoCo: Improving Text-Guided Video Inpainting for Better Consistency, Controllability and Compatibilitycited by 50
  35. 2025VideoGrain: Modulating Space-Time Attention for Multi-grained Video Editingcited by 50
  36. 2024LAVE: LLM-Powered Agent Assistance and Language Augmentation for Video Editingcited by 47
  37. 2023InstructVid2Vid: Controllable Video Editing with Natural Language Instructionscited by 44
  38. 2024DreamVideo-2: Zero-Shot Subject-Driven Video Customization with Precise Motion Controlcited by 43

50 most cited of 72 All 72 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024EVLM: Self-Reflective Multimodal Reasoning for Cross-Dimensional Visual Editing
  2. 2025Are Image-to-Video Models Good Zero-Shot Image Editors?
  3. 2026From Evaluation to Enhancement: Benchmarking and Improving Think-with-Video Reasoning for Video Generative Models
  4. 2025Reasoning to Edit: Hypothetical Instruction-Based Image Editing with Visual Reasoning
  5. 2026Reasoning to Align: Implicit Reasoning in Diffusion Transformers for Video Editing
  6. 2025TiViBench: Benchmarking Think-in-Video Reasoning for Video Generative Models
  7. 2025V-ReasonBench: Toward Unified Reasoning Benchmark Suite for Video Generation Models
  8. 2026VEBench:Benchmarking Large Multimodal Models for Real-World Video Editing