FlowDirector: Training-Free Flow Steering for Precise Text-to-Video Editing
Not on the map. Why?
Abstract (arXiv)
Text-driven video editing aims to modify video content based on natural language instructions. While recent training-free methods have leveraged pretrained diffusion models, they often rely on an inversion-editing paradigm. This paradigm maps the video to a latent space before editing. However, the inversion process is not perfectly accurate, often compromising appearance fidelity and motion consistency. To address this, we introduce FlowDirector, a novel training-free and inversion-free video editing framework. Our framework models the editing process as a direct evolution in the data space. It guides the video to transition smoothly along its inherent spatio-temporal manifold using an ordinary differential equation (ODE), thereby avoiding the inaccurate inversion step. From this foundation, we introduce three flow correction strategies for appearance, motion, and stability: 1) Direction-aware flow correction amplifies components that oppose the source direction and removes irrelevant terms, breaking conservative streamlines and enabling stronger structural and textural changes. 2) Motion-appearance decoupling optimizes motion agreement as an energy term at each timestep, significantly improving consistency and motion transfer. 3) Differential averaging guidance strategy leverages differences among multiple candidate flows to approximate a low variance regime at low cost, suppressing artifacts and stabilizing the trajectory. Extensive experiments across various editing tasks and benchmarks demonstrate that FlowDirector achieves state-of-the-art performance in instruction following, temporal consistency, and background preservation, establishing an efficient new paradigm for coherent video editing without inversion.
Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Builds on 50 of its 54 references that are in the map. First posted on arXiv 5 Jun 2025.
Builds on
50 of 54 references.
References · 50
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
38 more
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2022Video Diffusion Modelscited by 2,280
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
- 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,209
- 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 666
- 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 640
- 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 530
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 462
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 312
- 2024Guiding a Diffusion Model with a Bad Version of Itselfcited by 286
- 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 214
- 2023FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editingcited by 165
- 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Modelscited by 113
- 2023Inversion-Free Image Editing with Natural Languagecited by 106
- 2023VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondencecited by 69
- 2023Edit-A-Video: Single Video Editing with Object-Aware Consistencycited by 65
- 2023Ground-A-Video: Zero-shot Grounded Video Editing using Text-to-image Diffusion Modelscited by 58
- 2024MagicVideo-V2: Multi-Stage High-Aesthetic Video Generationcited by 48
- 2024VideoDirector: Precise Video Editing via Text-to-Video Modelscited by 36
- 2024TurboEdit: Instant text-based image editingcited by 26
- 2024StableV2V: Stablizing Shape Consistency in Video-to-Video Editingcited by 25
- 2024Re-Attentional Controllable Video Diffusion Editingcited by 5
- 2025AdaFlow: Efficient Long Video Editing via Adaptive Attention Slimming And Keyframe Selectioncited by 5
Built on by
Citing papers per year: 2025: 7; 2026: 17.
24 papers.
Sort:
By area:
- 2025In-Context Learning with Unpaired Clips for Instruction-based Video Editingcited by 34
- 2025Region-Constraint In-Context Generation for Instructional Video Editingcited by 22
- 2025Lynx: Towards High-Fidelity Personalized Video Generationcited by 8
- 2025FIA-Edit: Frequency-Interactive Attention for Efficient and High-Fidelity Inversion-Free Text-Guided Image Editingcited by 8
- 2025Zo3T: Zero-Shot 3D-Aware Trajectory-Guided Image-to-Video Generation via Test-Time Trainingcited by 7
- 2025Counterfactual World Models via Digital Twin-conditioned Video Diffusioncited by 4
- 2025Text-Driven Reasoning Video Editing via Reinforcement Learning on Digital Twin Representationscited by 3
- 2026Versatile Editing of Video Content, Actions, and Dynamics without Trainingcited by 3
- 2026Free Lunch for Stabilizing Rectified Flow Inversioncited by 2
- 2026ConceptWeaver: Weaving Disentangled Concepts with Flowcited by 2
- 2026StreamEdit: Training-Free Video Editing via Few-Step Streaming Video Generationcited by 2
- 2026LIVE: Leveraging Image Manipulation Priors for Instruction-based Video Editingcited by 1
12 more
- 2026SyncEdit: Rethinking Lip Synchronization as Editing with Audio-Driven Diffusion Modelscited by 0
- 2026When to Lock Attention: Training-Free KV Control in Video Diffusioncited by 0
- 2026UniEditBench: A Unified and Cost-Effective Benchmark for Image and Video Editing via Distilled MLLMscited by 0
- 2026FlowAnchor: Stabilizing the Editing Signal for Inversion-Free Video Editingcited by 0
- 2026ProxyUp: Training-Free Proxy-Conditioned Video Generation for Controllable Dynamicscited by 0
- 2026From Open Loop to Closed Loop: A Test-Time Iterative Optimization Framework for Reference-Consistent Image Generationcited by 0
- 2026Explicit Layer Modeling for Video Object Insertion and Video Layer Decompositioncited by 0
- 2026ChordVideo: One-Step, Training-Free, Temporally Consistent Video Editing via Low-Energy Transportcited by 0
- 2026EmoWorld: A Decoupled Affective Field for Controllable Emotional Video Generationcited by 0
- 2026One Editor, Many Edits: A Unified Training-Free Framework for Diverse Video Editingcited by 0
- 2026Edit-VAR: Taming Visual Autoregressive Model for Precise Video Editingcited by 0
- 2026TripleFlow: Training-Free Video Object Removal by Bridging Residual Editing and Native Generationcited by 0
- 2026TripleFlow: Training-Free Video Object Removal by Bridging Residual Editing and Native Generation30 Sep 2026
- 2026Edit-VAR: Taming Visual Autoregressive Model for Precise Video Editing18 Sep 2026
- 2026One Editor, Many Edits: A Unified Training-Free Framework for Diverse Video Editing3 Sep 2026
- 2026EmoWorld: A Decoupled Affective Field for Controllable Emotional Video Generation6 Aug 2026
- 2026ChordVideo: One-Step, Training-Free, Temporally Consistent Video Editing via Low-Energy Transport1 Aug 2026
- 2026Explicit Layer Modeling for Video Object Insertion and Video Layer Decomposition28 Jul 2026
- 2026From Open Loop to Closed Loop: A Test-Time Iterative Optimization Framework for Reference-Consistent Image Generation6 Jul 2026
- 2026ProxyUp: Training-Free Proxy-Conditioned Video Generation for Controllable Dynamics4 Jul 2026
- 2026StreamEdit: Training-Free Video Editing via Few-Step Streaming Video Generation20 May 2026
- 2026FlowAnchor: Stabilizing the Editing Signal for Inversion-Free Video Editing24 Apr 2026
- 2026LIVE: Leveraging Image Manipulation Priors for Instruction-based Video Editing18 Apr 2026
- 2026UniEditBench: A Unified and Cost-Effective Benchmark for Image and Video Editing via Distilled MLLMs17 Apr 2026
12 more
- 2026ConceptWeaver: Weaving Disentangled Concepts with Flow30 Mar 2026
- 2026Versatile Editing of Video Content, Actions, and Dynamics without Training18 Mar 2026
- 2026When to Lock Attention: Training-Free KV Control in Video Diffusion10 Mar 2026
- 2026SyncEdit: Rethinking Lip Synchronization as Editing with Audio-Driven Diffusion Models10 Mar 2026
- 2026Free Lunch for Stabilizing Rectified Flow Inversion12 Feb 2026
- 2025Region-Constraint In-Context Generation for Instructional Video Editing19 Dec 2025
- 2025Counterfactual World Models via Digital Twin-conditioned Video Diffusion21 Nov 2025
- 2025Text-Driven Reasoning Video Editing via Reinforcement Learning on Digital Twin Representations18 Nov 2025
- 2025FIA-Edit: Frequency-Interactive Attention for Efficient and High-Fidelity Inversion-Free Text-Guided Image Editing15 Nov 2025
- 2025In-Context Learning with Unpaired Clips for Instruction-based Video Editing16 Oct 2025
- 2025Lynx: Towards High-Fidelity Personalized Video Generation19 Sep 2025
- 2025Zo3T: Zero-Shot 3D-Aware Trajectory-Guided Image-to-Video Generation via Test-Time Training8 Sep 2025
- 2025FIA-Edit: Frequency-Interactive Attention for Efficient and High-Fidelity Inversion-Free Text-Guided Image Editingcited by 8
- 2026Free Lunch for Stabilizing Rectified Flow Inversioncited by 2
- 2026When to Lock Attention: Training-Free KV Control in Video Diffusioncited by 0
- 2026EmoWorld: A Decoupled Affective Field for Controllable Emotional Video Generationcited by 0
- 2026EmoWorld: A Decoupled Affective Field for Controllable Emotional Video Generation6 Aug 2026
- 2026When to Lock Attention: Training-Free KV Control in Video Diffusion10 Mar 2026
- 2026Free Lunch for Stabilizing Rectified Flow Inversion12 Feb 2026
- 2025FIA-Edit: Frequency-Interactive Attention for Efficient and High-Fidelity Inversion-Free Text-Guided Image Editing15 Nov 2025
- 2025In-Context Learning with Unpaired Clips for Instruction-based Video Editingcited by 34
- 2025Region-Constraint In-Context Generation for Instructional Video Editingcited by 22
- 2025Lynx: Towards High-Fidelity Personalized Video Generationcited by 8
- 2025Zo3T: Zero-Shot 3D-Aware Trajectory-Guided Image-to-Video Generation via Test-Time Trainingcited by 7
- 2026Versatile Editing of Video Content, Actions, and Dynamics without Trainingcited by 3
- 2026ConceptWeaver: Weaving Disentangled Concepts with Flowcited by 2
- 2026StreamEdit: Training-Free Video Editing via Few-Step Streaming Video Generationcited by 2
- 2026LIVE: Leveraging Image Manipulation Priors for Instruction-based Video Editingcited by 1
- 2026SyncEdit: Rethinking Lip Synchronization as Editing with Audio-Driven Diffusion Modelscited by 0
- 2026UniEditBench: A Unified and Cost-Effective Benchmark for Image and Video Editing via Distilled MLLMscited by 0
- 2026FlowAnchor: Stabilizing the Editing Signal for Inversion-Free Video Editingcited by 0
- 2026ProxyUp: Training-Free Proxy-Conditioned Video Generation for Controllable Dynamicscited by 0
12 most cited of 18 All 18 (JSON)
- 2026TripleFlow: Training-Free Video Object Removal by Bridging Residual Editing and Native Generation30 Sep 2026
- 2026Edit-VAR: Taming Visual Autoregressive Model for Precise Video Editing18 Sep 2026
- 2026One Editor, Many Edits: A Unified Training-Free Framework for Diverse Video Editing3 Sep 2026
- 2026ChordVideo: One-Step, Training-Free, Temporally Consistent Video Editing via Low-Energy Transport1 Aug 2026
- 2026Explicit Layer Modeling for Video Object Insertion and Video Layer Decomposition28 Jul 2026
- 2026From Open Loop to Closed Loop: A Test-Time Iterative Optimization Framework for Reference-Consistent Image Generation6 Jul 2026
- 2026ProxyUp: Training-Free Proxy-Conditioned Video Generation for Controllable Dynamics4 Jul 2026
- 2026StreamEdit: Training-Free Video Editing via Few-Step Streaming Video Generation20 May 2026
- 2026FlowAnchor: Stabilizing the Editing Signal for Inversion-Free Video Editing24 Apr 2026
- 2026LIVE: Leveraging Image Manipulation Priors for Instruction-based Video Editing18 Apr 2026
- 2026UniEditBench: A Unified and Cost-Effective Benchmark for Image and Video Editing via Distilled MLLMs17 Apr 2026
- 2026ConceptWeaver: Weaving Disentangled Concepts with Flow30 Mar 2026
12 newest of 18 All 18 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025FlowAlign: Trajectory-Regularized, Inversion-Free Flow-based Image Editing
- 2026FlowBypass: Rectified Flow Trajectory Bypass for Training-Free Image Editing
- 2026SteerFlow: Steering Rectified Flows for Faithful Inversion-Based Image Editing
- 2026AdaEdit: Adaptive Temporal and Channel Modulation for Flow-Based Image Editing
- 2026FlowSlider: Training-Free Continuous Image Editing via Fidelity-Steering Decomposition
- 2025SplitFlow: Flow Decomposition for Inversion-Free Text-to-Image Editing
- 2026VeloEdit: Training-Free Consistent and Continuous Instruction-Based Image Editing via Velocity Field Decomposition
- 2024Unveil Inversion and Invariance in Flow Transformer for Versatile Image Editing