mlsanityData to 7 Oct 2026

IntrinsicEdit: Precise generative image manipulation in intrinsic space

arXiv 2505.08889 ↗First posted 13 May 2025cs.GR cs.CVcited by 17

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Generative diffusion models have advanced image editing with high-quality results and intuitive interfaces such as prompts and semantic drawing. However, these interfaces lack precise control, and the associated methods typically specialize on a single editing task. We introduce a versatile, generative workflow that operates in an intrinsic-image latent space, enabling semantic, local manipulation with pixel precision for a range of editing operations. Building atop the RGB-X diffusion framework, we address key challenges of identity preservation and intrinsic-channel entanglement. By incorporating exact diffusion inversion and disentangled channel manipulation, we enable precise, efficient editing with automatic resolution of global illumination effects -- all without additional data collection or model fine-tuning. We demonstrate state-of-the-art performance across a variety of tasks on complex images, including color and texture adjustments, object insertion and removal, global relighting, and their combinations.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 50 of its 83 references that are in the map. First posted on arXiv 13 May 2025.

Builds on

50 of 83 references.

Closest ancestors · 10

Same direction, newest first

  1. 2024Training-Free Sketch-Guided Diffusion with Latent Optimization31 Aug
  2. 2024TurboEdit: Text-Based Image Editing Using Few-Step Diffusion Models1 Aug
  3. 2024ReNoise: Real Image Inversion Through Iterative Noising21 Mar
  4. 2023Effective Real Image Editing with Accelerated Iterative Diffusion Inversion10 Sep
  5. 2023DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editing26 Jun
  6. 2023Negative-prompt Inversion: Fast Image Inversion for Editing with Text-guided Diffusion Models26 May
  7. 2023An Edit Friendly DDPM Noise Space: Inversion and Manipulations12 Apr
  8. 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
  9. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
  10. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec

Other references · 40

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  5. 2013Auto-Encoding Variational Bayescited by 3,980
  6. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  7. 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 691
  8. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
  9. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 593
  10. 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 411
  11. 2016Generative Visual Manipulation on the Natural Image Manifoldcited by 348
  12. 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 321
28 more
  1. 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 271
  2. 2023Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifoldcited by 218
  3. 2020Editing in Style: Uncovering the Local Semantics of GANscited by 183
  4. 2024RGBleftrightarrowX: Image decomposition and synthesis using material- and lighting-aware diffusion modelscited by 159
  5. 2019Single Image Portrait Relightingcited by 152
  6. 2017Deep Image Harmonizationcited by 120
  7. 2024DiLightNet: Fine-grained Lighting Control for Diffusion-based Image Generationcited by 93
  8. 2024Neural Gaffer: Relighting Any Object via Diffusioncited by 91
  9. 2019Learning Physics-guided Face Relighting under Directional Lightcited by 90
  10. 2022Learning-based Inverse Rendering of Complex Indoor Scenes with Differentiable Monte Carlo Raytracingcited by 78
  11. 2023Intrinsic Image Diffusion for Indoor Single-view Material Estimationcited by 73
  12. 2024ObjectDrop: Bootstrapping Counterfactuals for Photorealistic Object Removal and Insertioncited by 71
  13. 2023Prompt-tuning latent diffusion models for inverse problemscited by 70
  14. 2024IntrinsicAnything: Learning Diffusion Priors for Inverse Rendering Under Unknown Illuminationcited by 67
  15. 2022Physically-Based Editing of Indoor Scene Lighting from a Single Imagecited by 62
  16. 2023Diffusion Handles: Enabling 3D Edits for Diffusion Models by Lifting Activations to 3Dcited by 59
  17. 2024LightIt: Illumination Modeling and Control for Diffusion Modelscited by 56
  18. 2021Self-supervised Outdoor Scene Relightingcited by 48
  19. 2023On Exact Inversion of DPM-Solverscited by 47
  20. 2019A Dataset of Multi-Illumination Images in the Wildcited by 45
  21. 2023Alchemist: Parametric Control of Material Properties with Diffusion Modelscited by 38
  22. 2024Magic Fixup: Streamlining Photo Editing by Watching Dynamic Videoscited by 38
  23. 2022OutCast: Outdoor Single-image Relighting with Cast Shadowscited by 30
  24. 2022User-Controllable Latent Transformer for StyleGAN Image Layout Editingcited by 28
  25. 2024Photorealistic Object Insertion with Diffusion-Guided Inverse Renderingcited by 27
  26. 2024ZeST: Zero-Shot Material Transfer from a Single Imagecited by 24
  27. 2024Latent Intrinsics Emerge from Training to Relightcited by 17
  28. 2024ZeroComp: Zero-shot Object Compositing from Image Intrinsics via Diffusioncited by 16

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 4; 2026: 13.

17 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2024Latent Space Disentanglement in Diffusion Transformers Enables Precise Zero-shot Semantic Editing
  2. 2026Editing on the Generative Manifold: A Theoretical and Empirical Study of General Diffusion-Based Image Editing Trade-offs
  3. 2026On the Controllability-Fidelity Frontier in Diffusion Editing
  4. 2025Edit2Perceive: Image Editing Diffusion Models Are Strong Dense Perceivers
  5. 2024ByteEdit: Boost, Comply and Accelerate Generative Image Editing
  6. 2025ReMix: Towards a Unified View of Consistent Character Generation and Editing
  7. 2026Edge-Aware Image Manipulation via Diffusion Models with a Novel Structure-Preservation Loss
  8. 2025OmniPaint: Mastering Object-Oriented Editing via Disentangled Insertion-Removal Inpainting