mlsanityData to 7 Oct 2026

FlowDirector: Training-Free Flow Steering for Precise Text-to-Video Editing

arXiv 2506.05046 ↗First posted 5 Jun 2025cs.CVcited by 24

Not on the map. Why?

Abstract (arXiv)

Text-driven video editing aims to modify video content based on natural language instructions. While recent training-free methods have leveraged pretrained diffusion models, they often rely on an inversion-editing paradigm. This paradigm maps the video to a latent space before editing. However, the inversion process is not perfectly accurate, often compromising appearance fidelity and motion consistency. To address this, we introduce FlowDirector, a novel training-free and inversion-free video editing framework. Our framework models the editing process as a direct evolution in the data space. It guides the video to transition smoothly along its inherent spatio-temporal manifold using an ordinary differential equation (ODE), thereby avoiding the inaccurate inversion step. From this foundation, we introduce three flow correction strategies for appearance, motion, and stability: 1) Direction-aware flow correction amplifies components that oppose the source direction and removes irrelevant terms, breaking conservative streamlines and enabling stronger structural and textural changes. 2) Motion-appearance decoupling optimizes motion agreement as an energy term at each timestep, significantly improving consistency and motion transfer. 3) Differential averaging guidance strategy leverages differences among multiple candidate flows to approximate a low variance regime at low cost, suppressing artifacts and stabilizing the trajectory. Extensive experiments across various editing tasks and benchmarks demonstrate that FlowDirector achieves state-of-the-art performance in instruction following, temporal consistency, and background preservation, establishing an efficient new paradigm for coherent video editing without inversion.

Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Builds on 50 of its 54 references that are in the map. First posted on arXiv 5 Jun 2025.

Builds on

50 of 54 references.

References · 50

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  7. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  8. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  9. 2022Flow Matching for Generative Modelingcited by 5,426
  10. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  11. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  12. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
38 more
  1. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  2. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  3. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  4. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  5. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  6. 2022Video Diffusion Modelscited by 2,280
  7. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  8. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  9. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  10. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  11. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  12. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
  13. 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,209
  14. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
  15. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
  16. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
  17. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
  18. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
  19. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 666
  20. 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 640
  21. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 530
  22. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 462
  23. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
  24. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 312
  25. 2024Guiding a Diffusion Model with a Bad Version of Itselfcited by 286
  26. 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 214
  27. 2023FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editingcited by 165
  28. 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Modelscited by 113
  29. 2023Inversion-Free Image Editing with Natural Languagecited by 106
  30. 2023VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondencecited by 69
  31. 2023Edit-A-Video: Single Video Editing with Object-Aware Consistencycited by 65
  32. 2023Ground-A-Video: Zero-shot Grounded Video Editing using Text-to-image Diffusion Modelscited by 58
  33. 2024MagicVideo-V2: Multi-Stage High-Aesthetic Video Generationcited by 48
  34. 2024VideoDirector: Precise Video Editing via Text-to-Video Modelscited by 36
  35. 2024TurboEdit: Instant text-based image editingcited by 26
  36. 2024StableV2V: Stablizing Shape Consistency in Video-to-Video Editingcited by 25
  37. 2024Re-Attentional Controllable Video Diffusion Editingcited by 5
  38. 2025AdaFlow: Efficient Long Video Editing via Adaptive Attention Slimming And Keyframe Selectioncited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 7; 2026: 17.

24 papers.

Sort:

By area:

  1. 2025In-Context Learning with Unpaired Clips for Instruction-based Video Editingcited by 34
  2. 2025Region-Constraint In-Context Generation for Instructional Video Editingcited by 22
  3. 2025Lynx: Towards High-Fidelity Personalized Video Generationcited by 8
  4. 2025FIA-Edit: Frequency-Interactive Attention for Efficient and High-Fidelity Inversion-Free Text-Guided Image Editingcited by 8
  5. 2025Zo3T: Zero-Shot 3D-Aware Trajectory-Guided Image-to-Video Generation via Test-Time Trainingcited by 7
  6. 2025Counterfactual World Models via Digital Twin-conditioned Video Diffusioncited by 4
  7. 2025Text-Driven Reasoning Video Editing via Reinforcement Learning on Digital Twin Representationscited by 3
  8. 2026Versatile Editing of Video Content, Actions, and Dynamics without Trainingcited by 3
  9. 2026Free Lunch for Stabilizing Rectified Flow Inversioncited by 2
  10. 2026ConceptWeaver: Weaving Disentangled Concepts with Flowcited by 2
  11. 2026StreamEdit: Training-Free Video Editing via Few-Step Streaming Video Generationcited by 2
  12. 2026LIVE: Leveraging Image Manipulation Priors for Instruction-based Video Editingcited by 1
12 more
  1. 2026SyncEdit: Rethinking Lip Synchronization as Editing with Audio-Driven Diffusion Modelscited by 0
  2. 2026When to Lock Attention: Training-Free KV Control in Video Diffusioncited by 0
  3. 2026UniEditBench: A Unified and Cost-Effective Benchmark for Image and Video Editing via Distilled MLLMscited by 0
  4. 2026FlowAnchor: Stabilizing the Editing Signal for Inversion-Free Video Editingcited by 0
  5. 2026ProxyUp: Training-Free Proxy-Conditioned Video Generation for Controllable Dynamicscited by 0
  6. 2026From Open Loop to Closed Loop: A Test-Time Iterative Optimization Framework for Reference-Consistent Image Generationcited by 0
  7. 2026Explicit Layer Modeling for Video Object Insertion and Video Layer Decompositioncited by 0
  8. 2026ChordVideo: One-Step, Training-Free, Temporally Consistent Video Editing via Low-Energy Transportcited by 0
  9. 2026EmoWorld: A Decoupled Affective Field for Controllable Emotional Video Generationcited by 0
  10. 2026One Editor, Many Edits: A Unified Training-Free Framework for Diverse Video Editingcited by 0
  11. 2026Edit-VAR: Taming Visual Autoregressive Model for Precise Video Editingcited by 0
  12. 2026TripleFlow: Training-Free Video Object Removal by Bridging Residual Editing and Native Generationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025FlowAlign: Trajectory-Regularized, Inversion-Free Flow-based Image Editing
  2. 2026FlowBypass: Rectified Flow Trajectory Bypass for Training-Free Image Editing
  3. 2026SteerFlow: Steering Rectified Flows for Faithful Inversion-Based Image Editing
  4. 2026AdaEdit: Adaptive Temporal and Channel Modulation for Flow-Based Image Editing
  5. 2026FlowSlider: Training-Free Continuous Image Editing via Fidelity-Steering Decomposition
  6. 2025SplitFlow: Flow Decomposition for Inversion-Free Text-to-Image Editing
  7. 2026VeloEdit: Training-Free Consistent and Continuous Instruction-Based Image Editing via Velocity Field Decomposition
  8. 2024Unveil Inversion and Invariance in Flow Transformer for Versatile Image Editing