mlsanityData to 7 Oct 2026

The Contextual Loss for Image Transformation with Non-Aligned Data

arXiv 1803.02077 ↗First posted 6 Mar 2018cs.CV cs.LGcited by 135

Not on the map. Why?

Abstract (arXiv)

Feed-forward CNNs trained for image transformation problems rely on loss functions that measure the similarity between the generated image and a target image. Most of the common loss functions assume that these images are spatially aligned and compare pixels at corresponding locations. However, for many tasks, aligned training pairs of images will not be available. We present an alternative loss function that does not require alignment, thus providing an effective and simple solution for a new space of problems. Our loss is based on both context and semantics -- it compares regions with similar semantic meaning, while considering the context of the entire image. Hence, for example, when transferring the style of one face to another, it will translate eyes-to-eyes and mouth-to-mouth. Our code can be found at https://www.github.com/roimehrez/contextualLoss

Key facts. Cited by 135 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Mar 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 34; 2022: 38; 2023: 31; 2024: 20; 2025: 7; 2026: 5.

135 papers.

Sort:

By area:

  1. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 341
  2. 2021Deep ViT Features as Dense Visual Descriptorscited by 327
  3. 2021Deblurring via Stochastic Refinementcited by 248
  4. 2022Splicing ViT Features for Semantic Appearance Transfercited by 209
  5. 2021Point-Based Neural Rendering with Per-View Optimizationcited by 188
  6. 2023Inversion by Direct Iteration: An Alternative to Denoising Diffusion for Image Restorationcited by 164
  7. 2023DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Priorcited by 157
  8. 2022ARF: Artistic Radiance Fieldscited by 147
  9. 2021MASA-SR: Matching Acceleration and Spatial Adaptation for Reference-Based Image Super-Resolutioncited by 79
  10. 2022Multiscale Structure Guided Diffusion for Image Deblurringcited by 76
  11. 2021The Spatially-Correlative Loss for Various Image Translation Taskscited by 66
  12. 2022Pastiche Master: Exemplar-Based High-Resolution Portrait Style Transfercited by 66
38 more
  1. 2021Real-World Single Image Super-Resolution: A Brief Reviewcited by 65
  2. 2021StyleMesh: Style Transfer for Indoor 3D Scene Reconstructionscited by 58
  3. 2021Semantic Image Mattingcited by 55
  4. 2021Towards Vivid and Diverse Image Colorization with Generative Color Priorcited by 55
  5. 2021Rethinking and Improving the Robustness of Image Style Transfercited by 48
  6. 2022Cross Attention Based Style Distribution for Controllable Person Image Synthesiscited by 45
  7. 2021Unbalanced Feature Transport for Exemplar-based Image Translationcited by 41
  8. 2021Domain-Aware Universal Style Transfercited by 40
  9. 2022QS-Attn: Query-Selected Attention for Contrastive Learning in I2I Translationcited by 39
  10. 20223D GAN Inversion with Facial Symmetry Priorcited by 39
  11. 2024Cycle3D: High-quality and Consistent Image-to-3D Generation via Generation-Reconstruction Cyclecited by 36
  12. 2022Learning Degradation Representations for Image Deblurringcited by 35
  13. 2023AesPA-Net: Aesthetic Pattern-Aware Style Transfer Networkscited by 34
  14. 2023HiFi-123: Towards High-fidelity One Image to 3D Content Generationcited by 34
  15. 2021Dual-Camera Super-Resolution with Aligned Attention Modulescited by 33
  16. 2021Reference-guided Pseudo-Label Generation for Medical Semantic Segmentationcited by 33
  17. 2023DiffFashion: Reference-based Fashion Design with Structure-aware Transfer by Diffusion Modelscited by 33
  18. 2025Attention Distillation: A Unified Approach to Visual Characteristics Transfercited by 32
  19. 2022AligNeRF: High-Fidelity Neural Radiance Fields via Alignment-Aware Trainingcited by 31
  20. 2022Learning Graph Neural Networks for Image Style Transfercited by 29
  21. 2021In the light of feature distributions: moment matching for Neural Style Transfercited by 26
  22. 2022Generating natural images with direct Patch Distributions Matchingcited by 26
  23. 2023Bidirectionally Deformable Motion Modulation For Video-based Human Pose Transfercited by 25
  24. 2023Sparse3D: Distilling Multiview-Consistent Diffusion for Object Reconstruction from Sparse Viewscited by 25
  25. 2023DreamSpace: Dreaming Your Room Space with Text-Driven Panoramic Texture Propagationcited by 25
  26. 2023Repaint123: Fast and High-quality One Image to 3D Generation with Progressive Controllable 2D Repaintingcited by 25
  27. 2022Modulated Contrast for Versatile Image Synthesiscited by 23
  28. 2022Neural Neighbor Style Transfercited by 23
  29. 2023HumanRef: Single Image to 3D Human Generation via Reference-Guided Diffusioncited by 23
  30. 2021Beyond Joint Demosaicking and Denoising: An Image Processing Pipeline for a Pixel-bin Image Sensorcited by 22
  31. 2022MIDMs: Matching Interleaved Diffusion Models for Exemplar-based Image Translationcited by 22
  32. 2021LTT-GAN: Looking Through Turbulence by Inverting GANscited by 21
  33. 2021Bi-level Feature Alignment for Versatile Image Translation and Manipulationcited by 20
  34. 2021Internal Video Inpainting by Implicit Long-range Propagationcited by 19
  35. 2022Reference-based Video Super-Resolution Using Multi-Camera Video Tripletscited by 19
  36. 2022Marginal Contrastive Correspondence for Guided Image Generationcited by 19
  37. 2022Perception-Distortion Balanced ADMM Optimization for Single-Image Super-Resolutioncited by 19
  38. 2023ZeroAvatar: Zero-shot 3D Avatar Generation from a Single Imagecited by 18

50 most cited of 135 All 135 (JSON)