mlsanityData to 7 Oct 2026

COT Flow: Learning Optimal-Transport Image Sampling and Editing by Contrastive Pairs

arXiv 2406.12140 ↗First posted 17 Jun 2024cs.CV cs.AI cs.LGcited by 1

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Diffusion models have demonstrated strong performance in sampling and editing multi-modal data with high generation quality, yet they suffer from the iterative generation process which is computationally expensive and slow. In addition, most methods are constrained to generate data from Gaussian noise, which limits their sampling and editing flexibility. To overcome both disadvantages, we present Contrastive Optimal Transport Flow (COT Flow), a new method that achieves fast and high-quality generation with improved zero-shot editing flexibility compared to previous diffusion models. Benefiting from optimal transport (OT), our method has no limitation on the prior distribution, enabling unpaired image-to-image (I2I) translation and doubling the editable space (at both the start and end of the trajectory) compared to other zero-shot editing methods. In terms of quality, COT Flow can generate competitive results in merely one step compared to previous state-of-the-art unpaired image-to-image (I2I) translation methods. To highlight the advantages of COT Flow through the introduction of OT, we introduce the COT Editor to perform user-guided editing with excellent flexibility and quality. The code will be released at https://github.com/zuxinrui/cot_flow.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 34 of its 46 references that are in the map. First posted on arXiv 17 Jun 2024.

Builds on

34 of 46 references.

Closest ancestors · 3

Same direction, newest first

  1. 2023UFOGen: You Forward Once Large Scale Text-to-Image Generation via Diffusion GANs14 Nov
  2. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
  3. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec

Other references · 31

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  8. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  9. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  10. 2022Generative Adversarial Networkscited by 5,603
  11. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  12. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
19 more
  1. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  2. 2018Neural Ordinary Differential Equationscited by 3,733
  3. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  4. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  5. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  6. 2020Exploring Simple Siamese Representation Learningcited by 2,853
  7. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  8. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  9. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
  10. 2022Planning with Diffusion for Flexible Behavior Synthesiscited by 1,023
  11. 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 835
  12. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
  13. 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 637
  14. 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANscited by 515
  15. 2020Neural Controlled Differential Equations for Irregular Time Seriescited by 501
  16. 2023Common Diffusion Noise Schedules and Sample Steps are Flawedcited by 308
  17. 2023Understanding Diffusion Objectives as the ELBO with Simple Data Augmentationcited by 293
  18. 2022Diffusion Models for Medical Image Analysis: A Comprehensive Surveycited by 269
  19. 2021Generative Modeling with Optimal Transport Mapscited by 80

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Models
  2. 2025Optimal Transport for Rectified Flow Image Editing: Unifying Inversion-Based and Direct Methods
  3. 2025On Exact Editing of Flow-Based Diffusion Models
  4. 2025UniEdit-Flow: Unleashing Inversion and Editing in the Era of Flow Models
  5. 2026BiFM: Bidirectional Flow Matching for Few-Step Image Editing and Generation
  6. 2023Filter-Guided Diffusion for Controllable Image Generation
  7. 2026CAB: Accelerating Flow and Diffusion Sampling via Rectification and Corrected Adams-Bashforth
  8. 2025FlowOpt: Fast Optimization Through Whole Flow Processes for Training-Free Editing