mlsanityData to 14 Oct 2026

One-Step Image Translation with Text-to-Image Models

arXiv 2403.12036 ↗First posted 18 Mar 2024cs.CV cs.GR cs.LGcited by 116

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

In this work, we address two limitations of existing conditional diffusion models: their slow inference speed due to the iterative denoising process and their reliance on paired data for model fine-tuning. To tackle these issues, we introduce a general method for adapting a single-step diffusion model to new tasks and domains through adversarial learning objectives. Specifically, we consolidate various modules of the vanilla latent diffusion model into a single end-to-end generator network with small trainable weights, enhancing its ability to preserve the input image structure while reducing overfitting. We demonstrate that, for unpaired settings, our model CycleGAN-Turbo outperforms existing GAN-based and diffusion-based methods for various scene translation tasks, such as day-to-night conversion and adding/removing weather effects like fog, snow, and rain. We extend our method to paired settings, where our model pix2pix-Turbo is on par with recent works like Control-Net for Sketch2Photo and Edge2Image, but with a single-step inference. This work suggests that single-step diffusion models can serve as strong backbones for a range of GAN learning objectives. Our code and models are available at https://github.com/GaParmar/img2img-turbo.

Key facts. Cited by 116 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 68 of its 79 references that are in the map. First posted on arXiv 18 Mar 2024.

Builds on

68 of 79 references.

Closest ancestors · 17

Same direction, newest first

  1. 2023UFOGen: You Forward Once Large Scale Text-to-Image Generation via Diffusion GANs14 Nov
  2. 2023Localizing Object-level Shape Variations with Text-to-Image Diffusion Models20 Mar
  3. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Models16 Feb
  4. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
  5. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Models31 Jan
  6. 2023GLIGEN: Open-Set Grounded Text-to-Image Generation17 Jan
  7. 2022SpaText: Spatio-Textual Representation for Controllable Image Generation25 Nov
  8. 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
  9. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
  10. 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoisers2 Nov
  11. 2022Imagic: Text-Based Real Image Editing with Diffusion Models17 Oct
  12. 2022Pretraining is All You Need for Image-to-Image Translation25 May
5 more
  1. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
  2. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
  3. 2022Dual Diffusion Implicit Bridges for Image-to-Image Translation16 Mar
  4. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec
  5. 2021Palette: Image-to-Image Diffusion Models10 Nov

Other references · 51

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  6. 2020Denoising Diffusion Implicit Modelscited by 9,781
  7. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  8. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  9. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  10. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
  11. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
  12. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
38 more
  1. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
  2. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  3. 2023Consistency Modelscited by 1,822
  4. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,299
  5. 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
  6. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  7. 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,179
  8. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  9. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
  10. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
  11. 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
  12. 2023Adversarial Diffusion Distillationcited by 759
  13. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
  14. 2022On Distillation of Guided Diffusion Modelscited by 725
  15. 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 639
  16. 2017Unsupervised Image-to-Image Translation Networkscited by 603
  17. 2015Holistically-Nested Edge Detectioncited by 592
  18. 2023Zero-shot Image-to-Image Translationcited by 505
  19. 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
  20. 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
  21. 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 395
  22. 2021Knowledge Distillation in Iterative Generative Models for Improved Sampling Speedcited by 348
  23. 2017DualGAN: Unsupervised Dual Learning for Image-to-Image Translationcited by 310
  24. 2017Toward Multimodal Image-to-Image Translationcited by 296
  25. 2018Diverse Image-to-Image Translation via Disentangled Representationscited by 296
  26. 2016Learning from Simulated and Unsupervised Images through Adversarial Trainingcited by 288
  27. 2017Learning to Discover Cross-Domain Relations with Generative Adversarial Networkscited by 278
  28. 2022EDICT: Exact Diffusion Inversion via Coupled Transformationscited by 258
  29. 2019SEAN: Image Synthesis with Semantic Region-Adaptive Normalizationcited by 253
  30. 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 220
  31. 2023StyleGAN-T: Unlocking the Power of GANs for Fast Large-Scale Text-to-Image Synthesiscited by 212
  32. 2022Splicing ViT Features for Semantic Appearance Transfercited by 209
  33. 2022Fast Sampling of Diffusion Models via Operator Learningcited by 175
  34. 2021UNIT-DDPM: UNpaired Image Translation with Denoising Diffusion Probabilistic Modelscited by 133
  35. 2016Unsupervised Cross-Domain Image Generationcited by 125
  36. 2023Expressive Text-to-Image Generation with Rich Textcited by 89
  37. 2021Ensembling Off-the-shelf Models for GAN Trainingcited by 86
  38. 2016Scribbler: Controlling Deep Image Synthesis with Sketch and Colorcited by 78

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 22; 2025: 49; 2026: 45.

116 papers.

Sort:

By area:

  1. 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolutioncited by 246
  2. 2024SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Modelscited by 170
  3. 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 161
  4. 2024Robust Watermarking Using Generative Priors Against Image Editing: From Benchmarking to Advancescited by 110
  5. 2024Degradation-Guided One-Step Image Super-Resolution with Diffusion Priorscited by 69
  6. 2024SCube: Instant Large-Scale Scene Reconstruction using VoxSplatscited by 60
  7. 2025DiT4SR: Taming Diffusion Transformer for Real-World Image Super-Resolutioncited by 53
  8. 2025JarvisIR: Elevating Autonomous Driving Perception with Intelligent Image Restorationcited by 34
  9. 2025StableCodec: Taming One-Step Diffusion for Extreme Image Compressioncited by 33
  10. 2024Diff-Instruct++: Training One-step Text-to-image Generator Model to Align with Human Preferencescited by 31
  11. 2025R3D2: Realistic 3D Asset Insertion via Diffusion for Autonomous Driving Simulationcited by 18
  12. 2024PID: Physics-Informed Diffusion Model for Infrared Image Generationcited by 17
38 more
  1. 2025DiffV2IR: Visible-to-Infrared Diffusion Model via Vision-Language Understandingcited by 16
  2. 2025SketchVideo: Sketch-based Video Generation and Editingcited by 16
  3. 2025WeatherEdit: Controllable Weather Editing with 4D Gaussian Fieldcited by 12
  4. 2024Leveraging BEV Paradigm for Ground-to-Aerial Image Synthesiscited by 11
  5. 2025Controllable Weather Synthesis and Removal with Video Diffusion Modelscited by 11
  6. 2024VIMs: Virtual Immunohistochemistry Multiplex staining via Text-to-Stain Diffusion Trained on Uniplex Stainscited by 10
  7. 2025RGB-to-Polarization Estimation: A New Task and Benchmark Studycited by 8
  8. 2025BokehDiff: Neural Lens Blur with One-Step Diffusioncited by 8
  9. 2024High-Precision Dichotomous Image Segmentation via Probing Diffusion Capacitycited by 7
  10. 2025Generative AI for Autonomous Driving: Frontiers and Opportunitiescited by 7
  11. 20263D Smoke Scene Reconstruction Guided by Vision Priors from Multimodal Large Language Modelscited by 7
  12. 2024YOLO-TS: Real-Time Traffic Sign Detection with Enhanced Accuracy Using Optimized Receptive Fields and Anchor-Free Fusioncited by 6
  13. 2025A Critical Assessment of Modern Generative Models' Ability to Replicate Artistic Stylescited by 6
  14. 2025Always Clear Depth: Robust Monocular Depth Estimation under Adverse Weathercited by 6
  15. 2024Hero-SR: One-Step Diffusion for Super-Resolution with Human Perception Priorscited by 5
  16. 2025Error Propagation Mechanisms and Compensation Strategies for Quantized Diffusioncited by 5
  17. 2026Driving with DINO: Vision Foundation Features as a Unified Bridge for Sim-to-Real Generation in Autonomous Drivingcited by 5
  18. 2025Seeing Beyond Haze: Generative Nighttime Image Dehazingcited by 4
  19. 2025Single-Step Bidirectional Unpaired Image Translation Using Implicit Bridge Consistency Distillationcited by 4
  20. 2025Aligning Generative Denoising with Discriminative Objectives Unleashes Diffusion for Visual Perceptioncited by 4
  21. 2025ProSplat: Improved Feed-Forward 3D Gaussian Splatting for Wide-Baseline Sparse Viewscited by 4
  22. 2025Mixture of Global and Local Experts with Diffusion Transformer for Controllable Face Generationcited by 4
  23. 2026LightCity: An Urban Dataset for Outdoor Inverse Rendering and Reconstruction under Multi-illumination Conditionscited by 4
  24. 2026TherA: Thermal-Aware Visual-Language Prompting for Controllable RGB-to-Thermal Infrared Translationcited by 4
  25. 2024Generative Photomontagecited by 3
  26. 2024UIR-LoRA: Achieving Universal Image Restoration through Multiple Low-Rank Adaptationcited by 3
  27. 2024ControLRM: Fast and Controllable 3D Generation via Large Reconstruction Modelcited by 3
  28. 2024ControlSR: Taming Diffusion Models for Consistent Real-World Image Super Resolutioncited by 3
  29. 2024Mapping the Mind of an Instruction-based Image Editing using SMILEcited by 3
  30. 2025GuideSR: Rethinking Guidance for One-Step High-Fidelity Diffusion-Based Super-Resolutioncited by 3
  31. 2025From Enhancement to Understanding: Build a Generalized Bridge for Low-light Vision via Semantically Consistent Unsupervised Fine-tuningcited by 3
  32. 2025Elastic3D: Controllable Stereo Video Conversion with Guided Latent Decodingcited by 3
  33. 2025Mirage: One-Step Video Diffusion for Photorealistic and Coherent Asset Editing in Driving Scenescited by 3
  34. 2026HorizonForge: Driving Scene Editing with Any Trajectories and Any Vehiclescited by 3
  35. 2026Adaptive Weighted h-Transform Sampling for Coarse-Guided Visual Generationcited by 3
  36. 2024Seed-to-Seed: Unpaired Image Translation in Diffusion Seed Spacecited by 2
  37. 2024I2I-Galip: Unsupervised Medical Image Translation Using Generative Adversarial CLIPcited by 2
  38. 2025CSHNet: A Novel Information Asymmetric Image Translation Methodcited by 2

50 most cited of 116 All 116 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024Distilling Diffusion Models into Conditional GANs
  2. 2024You Only Sample Once: Taming One-Step Text-to-Image Synthesis by Self-Cooperative Diffusion GANs
  3. 2025CycleDiff: Cycle Diffusion Models for Unpaired Image-to-image Translation
  4. 2022Blended Latent Diffusion
  5. 2024E2GAN: Efficient Training of Efficient GANs for Image-to-Image Translation
  6. 2025d-Sketch: Improving Visual Fidelity of Sketch-to-Image Translation with Pretrained Latent Diffusion Models without Retraining
  7. 2024Latent Denoising Diffusion GAN: Faster sampling, Higher image quality
  8. 2023Conditional Image Generation with Pretrained Generative Model