mlsanityData to 7 Oct 2026

WarpI2I: Image Warping for Image-to-Image Translation

arXiv 2606.31018 ↗First posted 30 Jun 2026cs.CVcited by 0

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Image-to-image (I2I) translation has achieved strong results in tasks like human relighting and driving scene translation using latent diffusion models (LDMs). However, compact LDMs often struggle to preserve fine-grained structures because the encoder compresses high-resolution inputs into a spatially downsampled latent space. To address this issue, we propose a simple saliency-guided warp-unwarp framework that reallocates spatial representation toward salient regions before encoding, enabling better preservation of structural details without increasing latent resolution. The warped image is processed by the original diffusion model and then mapped back via an inverse warp. In addition, we propose a simple and efficient outpainting-based synthetic data generation pipeline to produce high-quality paired data for image relighting. Our method is model-agnostic, requires no architectural modification, and introduces negligible computational overhead. Experiments on human relighting, driving scene relighting, and translation demonstrate improved structural preservation, lighting faithfulness, and image quality, with our framework extending naturally to video via frame-by-frame application with good temporal stability. Project Webpage: https://shenzheng2000.github.io/WarpI2I.github.io

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 47 of its 62 references that are in the map. First posted on arXiv 30 Jun 2026.

Builds on

47 of 62 references.

References · 47

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  7. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
  8. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  9. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  10. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  11. 2015Spatial Transformer Networkscited by 1,423
  12. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
35 more
  1. 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,282
  2. 2018Demystifying MMD GANscited by 1,268
  3. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
  4. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  5. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
  6. 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
  7. 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 637
  8. 2017Unsupervised Image-to-Image Translation Networkscited by 602
  9. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 529
  10. 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 498
  11. 2017DualGAN: Unsupervised Dual Learning for Image-to-Image Translationcited by 310
  12. 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondencecited by 297
  13. 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
  14. 2022Dual Diffusion Implicit Bridges for Image-to-Image Translationcited by 212
  15. 2022Splicing ViT Features for Semantic Appearance Transfercited by 209
  16. 2022Understanding The Robustness in Vision Transformerscited by 144
  17. 2018Unsupervised Image Super-Resolution using Cycle-in-Cycle Generative Adversarial Networkscited by 133
  18. 2021UNIT-DDPM: UNpaired Image Translation with Denoising Diffusion Probabilistic Modelscited by 133
  19. 2024One-Step Image Translation with Text-to-Image Modelscited by 111
  20. 2018Learning to Zoom: a Saliency-Based Sampling Layer for Neural Networkscited by 56
  21. 2023Street TryOn: Learning In-the-Wild Virtual Try-On from Unpaired Person Imagescited by 34
  22. 2021FOVEA: Foveated Image Magnification for Autonomous Navigationcited by 31
  23. 2022Modulated Contrast for Versatile Image Synthesiscited by 23
  24. 2024ROADWork: A Dataset and Benchmark for Learning to Recognize, Observe, Analyze and Drive Through Work Zonescited by 20
  25. 2025Test-time Prompt Refinement for Text-to-Image Modelscited by 16
  26. 2025Constructive Distortion: Improving MLLMs with Attention-Guided Image Warpingcited by 13
  27. 2023Learning to Zoom and Unzoomcited by 11
  28. 2025DreamLight: Towards Harmonious and Consistent Image Relightingcited by 8
  29. 2024Instance-Warp: Saliency Guided Image Warping for Unsupervised Domain Adaptationcited by 7
  30. 2024Text2Relight: Creative Portrait Relighting with Text Guidancecited by 7
  31. 2025MODEM: A Morton-Order Degradation Estimation Mechanism for Adverse Weather Image Recoverycited by 6
  32. 2023TPSeNCE: Towards Artifact-Free Realistic Rain Generation for Deraining and Object Detection in Raincited by 5
  33. 2022AS-IntroVAE: Adversarial Similarity Distance Makes Robust IntroVAEcited by 4
  34. 2023Learned Two-Plane Perspective Prior based Image Resampling for Efficient Object Detectioncited by 3
  35. 2024CycleGAN with Better Cyclescited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Zero-Shot Video Translation via Token Warping
  2. 2025WAVE: Warp-Based View Guidance for Consistent Novel View Synthesis Using a Single Image
  3. 2023LatentWarp: Consistent Diffusion Latents for Zero-Shot Video-to-Video Translation
  4. 2025UniRelight: Learning Joint Decomposition and Synthesis for Video Relighting
  5. 2024Diffusion-Based Attention Warping for Consistent 3D Scene Editing
  6. 2026LightCrafter: PBR-Conditioned Video Diffusion Refinement for Controllable and Consistent Relighting
  7. 2025A Diffusion Model Translator for Efficient Image-to-Image Translation
  8. 2023DreamDrone: Text-to-Image Diffusion Models are Zero-shot Perpetual View Generators