mlsanityData to 7 Oct 2026

Image-to-Image Translation with Conditional Adversarial Networks

arXiv 1611.07004 ↗First posted 21 Nov 2016cs.CVcited by 4,510

Not on the map. Why?

Cited by 575 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We investigate conditional adversarial networks as a general-purpose solution to image-to-image translation problems. These networks not only learn the mapping from input image to output image, but also learn a loss function to train this mapping. This makes it possible to apply the same generic approach to problems that traditionally would require very different loss formulations. We demonstrate that this approach is effective at synthesizing photos from label maps, reconstructing objects from edge maps, and colorizing images, among other tasks. Indeed, since the release of the pix2pix software associated with this paper, a large number of internet users (many of them artists) have posted their own experiments with our system, further demonstrating its wide applicability and ease of adoption without the need for parameter tweaking. As a community, we no longer hand-engineer our mapping functions, and this work suggests we can achieve reasonable results without hand-engineering our loss functions either.

Key facts. Cited by 4,510 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Nov 2016.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2019: 3; 2020: 1; 2021: 1030; 2022: 903; 2023: 859; 2024: 731; 2025: 568; 2026: 415.

4,510 papers.

Sort:

By area:

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2022Scalable Diffusion Models with Transformerscited by 5,931
  3. 2022Generative Adversarial Networkscited by 5,603
  4. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  5. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  6. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  7. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  8. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  9. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  10. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
  11. 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
  12. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
38 more
  1. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
  2. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  3. 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 921
  4. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
  5. 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 760
  6. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
  7. 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
  8. 2022Autoregressive Image Generation using Residual Quantizationcited by 706
  9. 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 659
  10. 2021Vector-quantized Image Modeling with Improved VQGANcited by 656
  11. 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 640
  12. 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
  13. 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 592
  14. 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 589
  15. 2021Neural Fields in Visual Computing and Beyondcited by 539
  16. 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 524
  17. 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANscited by 515
  18. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  19. 2023Zero-shot Image-to-Image Translationcited by 503
  20. 2022Improving Diffusion Models for Inverse Problems using Manifold Constraintscited by 501
  21. 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
  22. 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
  23. 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
  24. 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
  25. 2021SRDiff: Single Image Super-Resolution with Diffusion Probabilistic Modelscited by 415
  26. 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 380
  27. 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 369
  28. 2021GAN Inversion: A Surveycited by 366
  29. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
  30. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 332
  31. 2021Neural RGB-D Surface Reconstructioncited by 312
  32. 2021Skillful Precipitation Nowcasting using Deep Generative Models of Radarcited by 308
  33. 2022Perception Prioritized Training of Diffusion Modelscited by 301
  34. 2023Your Diffusion Model is Secretly a Zero-Shot Classifiercited by 301
  35. 2023DreamLLM: Synergistic Multimodal Comprehension and Creationcited by 296
  36. 2021Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representationcited by 288
  37. 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
  38. 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 258

50 most cited of 4,510 All 4,510 (JSON)