mlsanityData to 7 Oct 2026

Taming Rectified Flow for Inversion and Editing

arXiv 2411.04746 ↗First posted 7 Nov 2024cs.CVcited by 200

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Rectified-flow-based diffusion transformers like FLUX and OpenSora have demonstrated outstanding performance in the field of image and video generation. Despite their robust generative capabilities, these models often struggle with inversion inaccuracies, which could further limit their effectiveness in downstream tasks such as image and video editing. To address this issue, we propose RF-Solver, a novel training-free sampler that effectively enhances inversion precision by mitigating the errors in the ODE-solving process of rectified flow. Specifically, we derive the exact formulation of the rectified flow ODE and apply the high-order Taylor expansion to estimate its nonlinear components, significantly enhancing the precision of ODE solutions at each timestep. Building upon RF-Solver, we further propose RF-Edit, a general feature-sharing-based framework for image and video editing. By incorporating self-attention features from the inversion process into the editing process, RF-Edit effectively preserves the structural information of the source image or video while achieving high-quality editing results. Our approach is compatible with any pre-trained rectified-flow-based models for image and video tasks, requiring no additional training or optimization. Extensive experiments across generation, inversion, and editing tasks in both image and video modalities demonstrate the superiority and versatility of our method. The source code is available at https://github.com/wangjiangshan0725/RF-Solver-Edit.

Key facts. Cited by 200 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 74 of its 95 references that are in the map. First posted on arXiv 7 Nov 2024.

Builds on

74 of 95 references.

Closest ancestors · 14

Same direction, newest first

  1. 2024HART: Efficient Visual Generation with Hybrid Autoregressive Transformer14 Oct
  2. 2024Semantic Image Inversion and Editing using Rectified Stochastic Differential Equations14 Oct
  3. 2024Diffusion Model-Based Image Editing: A Survey27 Feb
  4. 2023ZONE: Zero-Shot Instruction-Guided Local Editing28 Dec
  5. 2023Tuning-Free Inversion-Enhanced Control for Consistent Image Editing22 Dec
  6. 2023InstructEdit: Improving Automatic Masks for Diffusion-based Image Editing With User Instructions29 May
  7. 2023Negative-prompt Inversion: Fast Image Inversion for Editing with Text-guided Diffusion Models26 May
  8. 2023An Edit Friendly DDPM Noise Space: Inversion and Manipulations12 Apr
  9. 2023Region-Aware Diffusion for Zero-shot Text-driven Image Editing23 Feb
  10. 2023PRedItOR: Text Guided Image Editing with Diffusion Prior15 Feb
  11. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
  12. 2022Direct Inversion: Optimization-Free Text-Driven Real Image Editing with Diffusion Models15 Nov
2 more
  1. 2022DiffEdit: Diffusion-based semantic image editing with mask guidance20 Oct
  2. 2022Blended Latent Diffusion6 Jun

Other references · 60

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  6. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  7. 2020Denoising Diffusion Implicit Modelscited by 9,655
  8. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  9. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  10. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  11. 2022Scalable Diffusion Models with Transformerscited by 5,931
  12. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
38 more
  1. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  2. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  3. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  4. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  5. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
  6. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 924
  7. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
  8. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
  9. 2023Zero-shot Image-to-Image Translationcited by 503
  10. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 462
  11. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
  12. 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 331
  13. 2023ControlVideo: Training-free Controllable Text-to-Video Generationcited by 324
  14. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 312
  15. 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 312
  16. 2022Rectified Flow: A Marginal Preserving Approach to Optimal Transportcited by 277
  17. 2022EDICT: Exact Diffusion Inversion via Coupled Transformationscited by 256
  18. 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translationcited by 253
  19. 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editingcited by 182
  20. 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 177
  21. 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 172
  22. 2023FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editingcited by 165
  23. 2021Layered Neural Atlases for Consistent Video Editingcited by 137
  24. 2023Zero-Shot Video Editing Using Off-The-Shelf Image Diffusion Modelscited by 135
  25. 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Modelscited by 113
  26. 2023CoDeF: Content Deformation Fields for Temporally Consistent Video Processingcited by 108
  27. 2024Improving the Training of Rectified Flowscited by 106
  28. 2023Beyond First-Order Tweedie: Solving Inverse Problems using Latent Diffusioncited by 78
  29. 2023Reti-Diff: Illumination Degradation Image Restoration with Retinex-based Latent Diffusion Modelcited by 69
  30. 2023Edit-A-Video: Single Video Editing with Object-Aware Consistencycited by 65
  31. 2024COVE: Unleashing the Diffusion Feature Correspondence for Consistent Video Editingcited by 59
  32. 2024Rectified Diffusion: Straightness Is Not Your Need in Rectified Flowcited by 59
  33. 2023Shape-aware Text-driven Layered Video Editingcited by 54
  34. 2023Smooth Diffusion: Crafting Smooth Latent Spaces in Diffusion Modelscited by 48
  35. 2024FRESCO: Spatial-Temporal Correspondence for Zero-Shot Video Translationcited by 48
  36. 2023On Exact Inversion of DPM-Solverscited by 47
  37. 2024MultiBooth: Towards Generating All Your Concepts in an Image from Textcited by 45
  38. 2024Diffusion Model-Based Video Editing: A Surveycited by 44

50 most cited of 60 All 60 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 99; 2026: 98.

200 papers.

Sort:

By area:

  1. 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 214
  2. 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 199
  3. 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
  4. 2024FireFlow: Fast Inversion of Rectified Flow for Image Semantic Editingcited by 66
  5. 2025Insert Anything: Image Insertion via In-Context Editing in DiTcited by 61
  6. 2025Follow-Your-Creation: Empowering 4D Creation through Video Inpaintingcited by 61
  7. 2025KV-Edit: Training-Free Image Editing for Precise Background Preservationcited by 47
  8. 2025EEdit: Rethinking the Spatial and Temporal Redundancy for Efficient Image Editingcited by 45
  9. 2025VoxHammer: Training-Free Precise and Coherent 3D Editing in Native 3D Spacecited by 40
  10. 2025UniEdit-Flow: Unleashing Inversion and Editing in the Era of Flow Modelscited by 38
  11. 2025Stochastic Self-Guidance for Training-Free Enhancement of Diffusion Modelscited by 35
  12. 2024Unveil Inversion and Invariance in Flow Transformer for Versatile Image Editingcited by 34
38 more
  1. 2025Sparse-vDiT: Unleashing the Power of Sparse Attention to Accelerate Video Diffusion Transformerscited by 34
  2. 2025MindOmni: Unleashing Reasoning Generation in Vision Language Models with RGPOcited by 30
  3. 2025DragFlow: Unleashing DiT Priors with Region Based Supervision for Drag Editingcited by 29
  4. 2025NANO3D: A Training-Free Approach for Efficient 3D Editing Without Maskscited by 29
  5. 2025Follow-Your-Shape: Shape-Aware Image Editing via Trajectory-Guided Region Controlcited by 27
  6. 2025ContextFlow: Training-Free Video Object Editing via Adaptive Context Enrichmentcited by 27
  7. 2025RelationAdapter: Learning and Transferring Visual Relation with Diffusion Transformerscited by 26
  8. 2025Edit Transfer: Learning Image Editing via Vision In-Context Relationscited by 23
  9. 2025Personalize Anything for Free with Diffusion Transformercited by 22
  10. 2025DNAEdit: Direct Noise Alignment for Text-Guided Rectified Flow Editingcited by 22
  11. 2025FreeFlux: Understanding and Exploiting Layer-Specific Roles in RoPE-Based MMDiT for Versatile Image Editingcited by 21
  12. 2025Training-Free Text-Guided Image Editing with Visual Autoregressive Modelcited by 21
  13. 2025Taming Preference Mode Collapse via Directional Decoupling Alignment in Diffusion Reinforcement Learningcited by 18
  14. 2025Exploring Multimodal Diffusion Transformers for Enhanced Prompt-based Image Editingcited by 16
  15. 2025FiVE: A Fine-grained Video Editing Benchmark for Evaluating Emerging Diffusion and Rectified Flow Modelscited by 15
  16. 2025ReFlex: Text-Guided Editing of Real Images in Rectified Flow via Mid-Step Feature Extraction and Attention Adaptationcited by 15
  17. 2025Query-Kontext: An Unified Multimodal Model for Image Generation and Editingcited by 15
  18. 2025SplitFlow: Flow Decomposition for Inversion-Free Text-to-Image Editingcited by 15
  19. 2026LiveEdit: Towards Real-Time Diffusion-Based Streaming Video Editingcited by 15
  20. 2025Integrating Extra Modality Helps Segmentor Find Camouflaged Objects Wellcited by 14
  21. 2025MVPortrait: Text-Guided Motion and Emotion Control for Multi-view Vivid Portrait Animationcited by 14
  22. 2025DanceTogether! Identity-Preserving Multi-Person Interactive Video Generationcited by 12
  23. 2025LoRAShop: Training-Free Multi-Concept Image Generation and Editing with Rectified Flow Transformerscited by 12
  24. 2025Object-AVEdit: An Object-level Audio-Visual Editing Modelcited by 12
  25. 2025SliderEdit: Continuous Image Editing with Fine-Grained Instruction Controlcited by 12
  26. 2025EditMGT: Unleashing Potentials of Masked Generative Transformers in Image Editingcited by 12
  27. 2025SkipVAR: Accelerating Visual Autoregressive Modeling via Adaptive Frequency-Aware Skippingcited by 11
  28. 2026Group Editing: Edit Multiple Images in One Gocited by 11
  29. 2025Adams Bashforth Moulton Solver for Inversion and Editing in Rectified Flowcited by 10
  30. 2025Follow-Your-Color: Multi-Instance Sketch Colorizationcited by 10
  31. 2025Follow-Your-Instruction: A Comprehensive MLLM Agent for World Data Synthesiscited by 10
  32. 2025DreamVE: Unified Instruction-based Image and Video Editingcited by 9
  33. 2025Tinker: Diffusion's Gift to 3D--Multi-View Consistent Editing From Sparse Inputs without Per-Scene Optimizationcited by 9
  34. 2025LayerPeeler: Autoregressive Peeling for Layer-wise Image Vectorizationcited by 8
  35. 2025PairEdit: Learning Semantic Variations for Exemplar-based Image Editingcited by 8
  36. 2025Group Relative Attention Guidance for Image Editingcited by 8
  37. 2025FIA-Edit: Frequency-Interactive Attention for Efficient and High-Fidelity Inversion-Free Text-Guided Image Editingcited by 8
  38. 2025Enhancing Image Generation Fidelity via Progressive Promptscited by 7

50 most cited of 200 All 200 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024Steering Rectified Flow Models in the Vector Field for Controlled Image Generation
  2. 2025Runge-Kutta Approximation and Decoupled Attention for Rectified Flow Inversion and Semantic Editing
  3. 2024TurboEdit: Instant text-based image editing
  4. 2023High-Fidelity Diffusion-based Image Editing
  5. 2024Eta Inversion: Designing an Optimal Eta Function for Diffusion-based Real Image Editing
  6. 2026Stable and Near-Reversible Diffusion ODE Solvers for Image Editing
  7. 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Code
  8. 2024Stable Flow: Vital Layers for Training-Free Image Editing