mlsanityData to 7 Oct 2026

RoNet: Rotation-oriented Continuous Image Translation

arXiv 2404.04474 ↗First posted 6 Apr 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

The generation of smooth and continuous images between domains has recently drawn much attention in image-to-image (I2I) translation. Linear relationship acts as the basic assumption in most existing approaches, while applied to different aspects including features, models or labels. However, the linear assumption is hard to conform with the element dimension increases and suffers from the limit that having to obtain both ends of the line. In this paper, we propose a novel rotation-oriented solution and model the continuous generation with an in-plane rotation over the style representation of an image, achieving a network named RoNet. A rotation module is implanted in the generation network to automatically learn the proper plane while disentangling the content and the style of an image. To encourage realistic texture, we also design a patch-based semantic style loss that learns the different styles of the similar object in different domains. We conduct experiments on forest scenes (where the complex texture makes the generation very challenging), faces, streetscapes and the iphone2dslr task. The results validate the superiority of our method in terms of visual quality and continuity.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 65 of its 83 references that are in the map. First posted on arXiv 6 Apr 2024.

Builds on

65 of 83 references.

References · 65

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  6. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  7. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  8. 2022Generative Adversarial Networkscited by 5,603
  9. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  10. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  11. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
  12. 2021Alias-Free Generative Adversarial Networkscited by 1,181
38 more
  1. 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
  2. 2017CyCADA: Cycle-Consistent Adversarial Domain Adaptationcited by 1,079
  3. 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
  4. 2019Learning Imbalanced Datasets with Label-Distribution-Aware Margin Losscited by 987
  5. 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
  6. 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 691
  7. 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 637
  8. 2013Domain Generalization via Invariant Feature Representationcited by 622
  9. 2020GANSpace: Discovering Interpretable GAN Controlscited by 612
  10. 2020In-Domain GAN Inversion for Real Image Editingcited by 420
  11. 2020Closed-Form Factorization of Latent Semantics in GANscited by 407
  12. 2017Universal Style Transfer via Feature Transformscited by 352
  13. 2014Recurrent Models of Visual Attentioncited by 344
  14. 2016A Learned Representation For Artistic Stylecited by 340
  15. 2019Bidirectional Learning for Domain Adaptation of Semantic Segmentationcited by 308
  16. 2018Diverse Image-to-Image Translation via Disentangled Representationscited by 296
  17. 2020Unsupervised Discovery of Interpretable Directions in the GAN Latent Spacecited by 288
  18. 2018Pros and Cons of GAN Evaluation Measurescited by 224
  19. 2019Few-Shot Unsupervised Image-to-Image Translationcited by 222
  20. 2017Improved Texture Networks: Maximizing Quality and Diversity in Feed-forward Stylization and Texture Synthesiscited by 215
  21. 2020Swapping Autoencoder for Deep Image Manipulationcited by 215
  22. 2018Arbitrary Style Transfer with Style-Attentional Networkscited by 197
  23. 2016Precomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networkscited by 192
  24. 2021StyTr2: Image Style Transfer with Transformerscited by 186
  25. 2021AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style Transfercited by 178
  26. 2018DLOW: Domain Flow for Adaptation and Generalizationcited by 176
  27. 2017Image to Image Translation for Domain Adaptationcited by 171
  28. 2017Deep Photo Style Transfercited by 168
  29. 2018GANimation: Anatomically-aware Facial Animation from a Single Imagecited by 160
  30. 2017Demystifying Neural Style Transfercited by 152
  31. 2022Diffusion-based Image Translation using Disentangled Style and Content Representationcited by 148
  32. 2018A Closed-form Solution to Photorealistic Image Stylizationcited by 133
  33. 2018Avatar-Net: Multi-scale Zero-shot Style Transfer by Feature Decorationcited by 115
  34. 2017StyleBank: An Explicit Representation for Neural Image Style Transfercited by 89
  35. 2018Understanding and Improving Interpolation in Autoencoders via an Adversarial Regularizercited by 87
  36. 2019Dynamic Instance Normalization for Arbitrary Style Transfercited by 83
  37. 2017Stable and Controllable Neural Texture Synthesis and Style Transfer Using Histogram Lossescited by 69
  38. 2020TSIT: A Simple and Versatile Framework for Image-to-Image Translationcited by 64

50 most cited of 65 All 65 (JSON)

Built on by

Not cited yet.