Towards Reason-Informed Video Editing in Unified Models with Self-Reflective Learning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Unified video models exhibit strong capabilities in understanding and generation, yet they struggle with reason-informed visual editing even when equipped with powerful internal vision-language models (VLMs). We attribute this gap to two factors: (1) existing datasets are inadequate for training and evaluating reasoning-aware video editing, and (2) an inherent disconnect between the models' reasoning and editing capabilities, which prevents understanding from guiding the editing process. To address this, we introduce the Reason-Informed Video Editing (RVE) task, which requires reasoning about physical plausibility and causal dynamics during editing. To support systematic evaluation, we construct RVE-Bench, a comprehensive benchmark with two complementary subsets: Reasoning-Aware Video Editing (RAVE) and In-Context Video-to-Video Generation (ICVG), spanning diverse reasoning dimensions across both editing and generation scenarios. Building upon this foundation, we propose ReViSE, a self-reflective learning framework that harnesses the model's internal VLM to evaluate and refine its own generation during training. Unlike prior reward-based approaches that rely on external critics, ReViSE leverages the model's internal VLM as a self-reflective evaluator, providing differentiable feedback that directly refines the generator's reasoning behavior during training. Extensive experiments on RVE-Bench demonstrate that ReViSE enhances editing accuracy and visual fidelity, outperforming the finetuned counterpart by 10% in Overall score on the RAVE subset, demonstrating the effectiveness of self-reflective differentiable reward.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 74 of its 79 references that are in the map. First posted on arXiv 10 Dec 2025.
Builds on
74 of 79 references.
Closest ancestors · 2
Same direction, newest first
- 2025Video models are zero-shot learners and reasoners24 Sep
- 2025VEGGIE: Instructional Editing and Reasoning Video Concepts with Grounded Generation18 Mar
Other references · 72
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
- 2023Training Diffusion Models with Reinforcement Learningcited by 982
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
38 more
- 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 658
- 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 590
- 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 497
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
- 2023Generative Multimodal Models are In-Context Learnerscited by 446
- 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 413
- 2023Pix2Video: Video Editing using Image Diffusioncited by 320
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
- 2023DreamLLM: Synergistic Multimodal Comprehension and Creationcited by 297
- 2024VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationcited by 295
- 2025Improving Video Generation with Human Feedbackcited by 284
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 253
- 2025Transfer between Modalities with MetaQueriescited by 236
- 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 204
- 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 201
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 188
- 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editingcited by 183
- 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 154
- 2024Video Diffusion Alignment via Reward Gradientscited by 107
- 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editingcited by 99
- 2025Masked Autoencoders Are Effective Tokenizers for Diffusion Modelscited by 96
- 2023InstructVideo: Instructing Video Diffusion Models with Human Feedbackcited by 86
- 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 84
- 2023Consistent Video-to-Video Transfer Using Synthetic Datasetcited by 81
- 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 79
- 2022VIDM: Video Implicit Diffusion Modelscited by 78
- 2024Calibrated Self-Rewarding Vision Language Modelscited by 78
- 2025RewardDance: Reward Scaling in Visual Generationcited by 68
- 2025InsViE-1M: Effective Instruction-based Video Editing with Elaborate Dataset Constructioncited by 62
- 2025Se~norita-2M: A High-Quality Instruction-based Dataset for General Video Editing by Video Specialistscited by 61
- 2024I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Modelscited by 55
- 2025UNIC: Unified In-Context Video Editingcited by 55
- 2024CoCoCo: Improving Text-Guided Video Inpainting for Better Consistency, Controllability and Compatibilitycited by 50
- 2025VideoGrain: Modulating Space-Time Attention for Multi-grained Video Editingcited by 50
- 2024LAVE: LLM-Powered Agent Assistance and Language Augmentation for Video Editingcited by 47
- 2023InstructVid2Vid: Controllable Video Editing with Natural Language Instructionscited by 44
- 2024DreamVideo-2: Zero-Shot Subject-Driven Video Customization with Precise Motion Controlcited by 43
50 most cited of 72 All 72 (JSON)
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026AesRM: Improving Video Aesthetics with Expert-Level Feedbackcited by 3
- 2026ReBind: Multi-Reference Video Editing via Structured Instructions with Explicit Reference Relationshipscited by 3
- 2026Advances in GRPO for Generation Models: A Surveycited by 2
- 2026OmniEdit-Bench: A Comprehensive Benchmark for Instruction-based Video Editingcited by 1
- 2026ContextMaster: Interactive Multi-Shot Video Creation via Fixed-Budget Sparse Context Routingcited by 0
- 2026RefVideo-6M: A Reliable Reference-Based Dataset for Instructional Video Editingcited by 0
- 2026ThinkV2V: Unleashing the Reasoning Capability of MLLMs for Instruction-Guided Video Editingcited by 0
- 2026ThinkV2V: Unleashing the Reasoning Capability of MLLMs for Instruction-Guided Video Editing29 Sep 2026
- 2026RefVideo-6M: A Reliable Reference-Based Dataset for Instructional Video Editing26 Aug 2026
- 2026OmniEdit-Bench: A Comprehensive Benchmark for Instruction-based Video Editing5 Aug 2026
- 2026ContextMaster: Interactive Multi-Shot Video Creation via Fixed-Budget Sparse Context Routing5 Aug 2026
- 2026ReBind: Multi-Reference Video Editing via Structured Instructions with Explicit Reference Relationships16 Jul 2026
- 2026AesRM: Improving Video Aesthetics with Expert-Level Feedback30 Apr 2026
- 2026Advances in GRPO for Generation Models: A Survey21 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2024EVLM: Self-Reflective Multimodal Reasoning for Cross-Dimensional Visual Editing
- 2025Are Image-to-Video Models Good Zero-Shot Image Editors?
- 2026From Evaluation to Enhancement: Benchmarking and Improving Think-with-Video Reasoning for Video Generative Models
- 2025Reasoning to Edit: Hypothetical Instruction-Based Image Editing with Visual Reasoning
- 2026Reasoning to Align: Implicit Reasoning in Diffusion Transformers for Video Editing
- 2025TiViBench: Benchmarking Think-in-Video Reasoning for Video Generative Models
- 2025V-ReasonBench: Toward Unified Reasoning Benchmark Suite for Video Generation Models
- 2026VEBench:Benchmarking Large Multimodal Models for Real-World Video Editing