mlsanityData to 14 Oct 2026

Cascading Modular Network (CAM-Net) for Multimodal Image Synthesis

arXiv 2106.09015 ↗First posted 16 Jun 2021cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Deep generative models such as GANs have driven impressive advances in conditional image synthesis in recent years. A persistent challenge has been to generate diverse versions of output images from the same input image, due to the problem of mode collapse: because only one ground truth output image is given per input image, only one mode of the conditional distribution is modelled. In this paper, we focus on this problem of multimodal conditional image synthesis and build on the recently proposed technique of Implicit Maximum Likelihood Estimation (IMLE). Prior IMLE-based methods required different architectures for different tasks, which limit their applicability, and were lacking in fine details in the generated images. We propose CAM-Net, a unified architecture that can be applied to a broad range of tasks. Additionally, it is capable of generating convincing high frequency details, achieving a reduction of the Frechet Inception Distance (FID) by up to 45.3% compared to the baseline.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 70 of its 103 references that are in the map. First posted on arXiv 16 Jun 2021.

Builds on

70 of 103 references.

References · 70

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  5. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  6. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  7. 2013Auto-Encoding Variational Bayescited by 4,053
  8. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  9. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
  10. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
  11. 2014Conditional Generative Adversarial Netscited by 2,162
  12. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
38 more
  1. 2016Density estimation using Real NVPcited by 2,042
  2. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,908
  3. 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,545
  4. 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
  5. 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,358
  6. 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,254
  7. 2016Colorful Image Colorizationcited by 1,114
  8. 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,039
  9. 2016Stacked Hourglass Networks for Human Pose Estimationcited by 915
  10. 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 903
  11. 2016Conditional Image Generation with PixelCNN Decoderscited by 862
  12. 2016InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Netscited by 860
  13. 2016Playing for Data: Ground Truth from Computer Gamescited by 818
  14. 2016Pixel Recurrent Neural Networkscited by 816
  15. 2018Residual Dense Network for Image Super-Resolutioncited by 799
  16. 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
  17. 2020NVAE: A Deep Hierarchical Variational Autoencodercited by 637
  18. 2017Unsupervised Image-to-Image Translation Networkscited by 603
  19. 2016Conditional Image Synthesis With Auxiliary Classifier GANscited by 565
  20. 2016Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networkscited by 543
  21. 2017FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoisingcited by 510
  22. 2017Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolutioncited by 453
  23. 2017PixelCNN++: Improving the PixelCNN with Discretized Logistic Mixture Likelihood and Other Modificationscited by 417
  24. 2019Deep Learning for Image Super-resolution: A Surveycited by 369
  25. 2016Adversarial Feature Learningcited by 350
  26. 2018Image Generation from Scene Graphscited by 324
  27. 2017DualGAN: Unsupervised Dual Learning for Image-to-Image Translationcited by 310
  28. 2016Unsupervised Pixel-Level Domain Adaptation with Generative Adversarial Networkscited by 308
  29. 2017Toward Multimodal Image-to-Image Translationcited by 296
  30. 2020Very Deep VAEs Generalize Autoregressive Models and Can Outperform Them on Imagescited by 264
  31. 2016Learning Representations for Automatic Colorizationcited by 251
  32. 2017Learning a Single Convolutional Super-Resolution Network for Multiple Degradationscited by 228
  33. 2018Deep Back-Projection Networks For Super-Resolutioncited by 225
  34. 2017Photographic Image Synthesis with Cascaded Refinement Networkscited by 223
  35. 2018Generative Adversarial Networks for Extreme Learned Image Compressioncited by 219
  36. 2021Gotta Go Fast When Generating Data with Score-Based Modelscited by 219
  37. 2016Adversarially Learned Inferencecited by 216
  38. 2016Coupled Generative Adversarial Networkscited by 216

50 most cited of 70 All 70 (JSON)

Built on by

Not cited yet.