Plans You Can Check: Verifier-Grounded Learning of an Open-Weight Planner for Executable Video-Editing
Not on the map. Why?
Abstract (arXiv)
Practical video editing is not only pixel generation: an editor must turn a brief, a clip pool, music metadata, and hard constraints into an executable timeline. We study this decision layer as executable video-editing planning and introduce RefineCut, which, unlike workflow systems that wrap a prompted frontier model, trains a compact open-weight planner for it. The planner edits a typed timeline through structured patches covering clip selection, trimming, ordering, transitions, and duration and music alignment; a deterministic verifier applies each patch and checks it against an explicit constraint ledger. Because editing has no single ground-truth repair, we do not imitate teachers directly: RefineCut replays every multi-teacher branch through the verifier and keeps verifier-best repairs as supervision. A second stage, RefineCut-Evo, lets the student score its own repairs with the verifier and a task rubric and trains on high-margin preference pairs, so the final 8B planner runs in a closed verifier loop with no teacher calls at inference. On RefineCut-Bench (3,578 tasks, 7,971 captioned clips, 499 music tracks, explicit ledgers), verifier-replayed distillation lifts the planner from 0.620 to 0.858 on the protocol-specific Video-Editing Score and RefineCut-Evo reaches 0.924; the gain transfers to Llama-3.1-8B and GLM-4-9B, and in the same closed loop the 8B planner matches or exceeds its frontier teachers. Code and RefineCut-Bench are publicly released; see the Data Availability statement.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 36 of its 53 references that are in the map. First posted on arXiv 26 Aug 2026.
Builds on
36 of 53 references.
References · 36
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2017Deep reinforcement learning from human preferencescited by 3,846
- 2023Let's Verify Step by Stepcited by 3,598
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2020Learning to summarize from human feedbackcited by 2,562
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
24 more
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 988
- 2024SimPO: Simple Preference Optimization with a Reference-Free Rewardcited by 951
- 2023A General Theoretical Paradigm to Understand Learning from Human Preferencescited by 906
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
- 2017Dense-Captioning Events in Videoscited by 789
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
- 2024ORPO: Monolithic Preference Optimization without Reference Modelcited by 556
- 2022Socratic Models: Composing Zero-Shot Multimodal Reasoning with Languagecited by 513
- 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 332
- 2024KTO: Model Alignment as Prospect Theoretic Optimizationcited by 256
- 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 151
- 2024Watch Every Step! LLM Agent Learning via Iterative Step-Level Process Refinementcited by 86
- 2023Consistent Video-to-Video Transfer Using Synthetic Datasetcited by 79
- 2024Vlogger: Make Your Dream A Vlogcited by 70
- 2024VideoStudio: Generating Consistent-Content and Multi-Scene Videoscited by 62
- 2024AgentBank: Towards Generalized LLM Agents via Fine-Tuning on 50000+ Interaction Trajectoriescited by 56
- 2024Beyond Answers: Transferring Reasoning Capabilities to Smaller LLMs Using Multi-Teacher Knowledge Distillationcited by 46
- 2025UniVA: Universal Video Agent towards Open-Source Next-Generation Video Generalistcited by 15
- 2026EvoLM: Self-Evolving Language Models through Co-Evolved Discriminative Rubricscited by 12
- 2026DIRECT: Video Mashup Creation via Hierarchical Multi-Agent Planning and Intent-Guided Editingcited by 7
- 2026Uniform-Correct Policy Optimization: Breaking RLVR's Indifference to Diversitycited by 6
- 2026Rubric-Grounded RL: Structured Judge Rewards for Generalizable Reasoningcited by 3
- 2026GLANCE: A Global-Local Coordination Multi-Agent Framework for Music-Grounded Non-Linear Video Editingcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.