IntrinsicEdit: Precise generative image manipulation in intrinsic space
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Generative diffusion models have advanced image editing with high-quality results and intuitive interfaces such as prompts and semantic drawing. However, these interfaces lack precise control, and the associated methods typically specialize on a single editing task. We introduce a versatile, generative workflow that operates in an intrinsic-image latent space, enabling semantic, local manipulation with pixel precision for a range of editing operations. Building atop the RGB-X diffusion framework, we address key challenges of identity preservation and intrinsic-channel entanglement. By incorporating exact diffusion inversion and disentangled channel manipulation, we enable precise, efficient editing with automatic resolution of global illumination effects -- all without additional data collection or model fine-tuning. We demonstrate state-of-the-art performance across a variety of tasks on complex images, including color and texture adjustments, object insertion and removal, global relighting, and their combinations.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 50 of its 83 references that are in the map. First posted on arXiv 13 May 2025.
Builds on
50 of 83 references.
Closest ancestors · 10
Same direction, newest first
- 2024Training-Free Sketch-Guided Diffusion with Latent Optimization31 Aug
- 2024TurboEdit: Text-Based Image Editing Using Few-Step Diffusion Models1 Aug
- 2024ReNoise: Real Image Inversion Through Iterative Noising21 Mar
- 2023Effective Real Image Editing with Accelerated Iterative Diffusion Inversion10 Sep
- 2023DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editing26 Jun
- 2023Negative-prompt Inversion: Fast Image Inversion for Editing with Text-guided Diffusion Models26 May
- 2023An Edit Friendly DDPM Noise Space: Inversion and Manipulations12 Apr
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec
Other references · 40
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 691
- 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
- 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 593
- 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 411
- 2016Generative Visual Manipulation on the Natural Image Manifoldcited by 348
- 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 321
28 more
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 271
- 2023Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifoldcited by 218
- 2020Editing in Style: Uncovering the Local Semantics of GANscited by 183
- 2024RGBleftrightarrowX: Image decomposition and synthesis using material- and lighting-aware diffusion modelscited by 159
- 2019Single Image Portrait Relightingcited by 152
- 2017Deep Image Harmonizationcited by 120
- 2024DiLightNet: Fine-grained Lighting Control for Diffusion-based Image Generationcited by 93
- 2024Neural Gaffer: Relighting Any Object via Diffusioncited by 91
- 2019Learning Physics-guided Face Relighting under Directional Lightcited by 90
- 2022Learning-based Inverse Rendering of Complex Indoor Scenes with Differentiable Monte Carlo Raytracingcited by 78
- 2023Intrinsic Image Diffusion for Indoor Single-view Material Estimationcited by 73
- 2024ObjectDrop: Bootstrapping Counterfactuals for Photorealistic Object Removal and Insertioncited by 71
- 2023Prompt-tuning latent diffusion models for inverse problemscited by 70
- 2024IntrinsicAnything: Learning Diffusion Priors for Inverse Rendering Under Unknown Illuminationcited by 67
- 2022Physically-Based Editing of Indoor Scene Lighting from a Single Imagecited by 62
- 2023Diffusion Handles: Enabling 3D Edits for Diffusion Models by Lifting Activations to 3Dcited by 59
- 2024LightIt: Illumination Modeling and Control for Diffusion Modelscited by 56
- 2021Self-supervised Outdoor Scene Relightingcited by 48
- 2023On Exact Inversion of DPM-Solverscited by 47
- 2019A Dataset of Multi-Illumination Images in the Wildcited by 45
- 2023Alchemist: Parametric Control of Material Properties with Diffusion Modelscited by 38
- 2024Magic Fixup: Streamlining Photo Editing by Watching Dynamic Videoscited by 38
- 2022OutCast: Outdoor Single-image Relighting with Cast Shadowscited by 30
- 2022User-Controllable Latent Transformer for StyleGAN Image Layout Editingcited by 28
- 2024Photorealistic Object Insertion with Diffusion-Guided Inverse Renderingcited by 27
- 2024ZeST: Zero-Shot Material Transfer from a Single Imagecited by 24
- 2024Latent Intrinsics Emerge from Training to Relightcited by 17
- 2024ZeroComp: Zero-shot Object Compositing from Image Intrinsics via Diffusioncited by 16
Built on by
Citing papers per year: 2025: 4; 2026: 13.
17 papers.
Sort:
By area:
- 2025V-RGBX: Video Editing with Accurate Controls over Intrinsic Propertiescited by 4
- 2025UniLight: A Unified Representation for Lightingcited by 3
- 2025IntrinsicWeather: Controllable Weather Editing in Intrinsic Spacecited by 1
- 2026TokenLight: Precise Lighting Control in Images using Attribute Tokenscited by 1
- 2026GOR-IS: 3D Gaussian Object Removal in the Intrinsic Spacecited by 1
- 2026Decoupled Illumination Priors for Spatially Controllable Multi-View Indoor Scene Relightingcited by 1
- 2025FROMAT: Multiview Material Appearance Transfer via Few-Shot Self-Attention Adaptationcited by 0
- 2026SyncLight: Single-Edit Multi-View Relightingcited by 0
- 2026Relighting as a Probe of Visual Priors via Augmented Latent Intrinsicscited by 0
- 2026GeRM: A Generative Rendering Model From Physically Realistic to Photorealisticcited by 0
- 2026AlbedoEdit: Unified Instance-Level Video Editing with Albedo Guidancecited by 0
- 2026TRON: Tracing Rays to Orchestrate a Neural Renderer for 3D Gaussian Reconstructionscited by 0
5 more
- 2026ResEdit: Residual embeddings for precise generative image editingcited by 0
- 2026Lighting-Consistent Object Transfer Across Radiance Fieldscited by 0
- 2026Controllable Texture Tiling with Transformed RoPE-Enhanced Diffusion Modelscited by 0
- 2026Consistent Feature Transport for Image Relightingcited by 0
- 2026Physically Based Rendering in the Latent Spacecited by 0
- 2026Physically Based Rendering in the Latent Space17 Sep 2026
- 2026Consistent Feature Transport for Image Relighting20 Jul 2026
- 2026Decoupled Illumination Priors for Spatially Controllable Multi-View Indoor Scene Relighting9 Jul 2026
- 2026Controllable Texture Tiling with Transformed RoPE-Enhanced Diffusion Models22 Jun 2026
- 2026Lighting-Consistent Object Transfer Across Radiance Fields21 Jun 2026
- 2026ResEdit: Residual embeddings for precise generative image editing15 Jun 2026
- 2026TRON: Tracing Rays to Orchestrate a Neural Renderer for 3D Gaussian Reconstructions9 Jun 2026
- 2026AlbedoEdit: Unified Instance-Level Video Editing with Albedo Guidance31 May 2026
- 2026GOR-IS: 3D Gaussian Object Removal in the Intrinsic Space1 May 2026
- 2026TokenLight: Precise Lighting Control in Images using Attribute Tokens16 Apr 2026
- 2026GeRM: A Generative Rendering Model From Physically Realistic to Photorealistic10 Apr 2026
- 2026Relighting as a Probe of Visual Priors via Augmented Latent Intrinsics1 Feb 2026
5 more
- 2026SyncLight: Single-Edit Multi-View Relighting23 Jan 2026
- 2025V-RGBX: Video Editing with Accurate Controls over Intrinsic Properties12 Dec 2025
- 2025FROMAT: Multiview Material Appearance Transfer via Few-Shot Self-Attention Adaptation10 Dec 2025
- 2025UniLight: A Unified Representation for Lighting3 Dec 2025
- 2025IntrinsicWeather: Controllable Weather Editing in Intrinsic Space9 Aug 2025
- 2026Decoupled Illumination Priors for Spatially Controllable Multi-View Indoor Scene Relightingcited by 1
- 2025FROMAT: Multiview Material Appearance Transfer via Few-Shot Self-Attention Adaptationcited by 0
- 2026Lighting-Consistent Object Transfer Across Radiance Fieldscited by 0
- 2026Controllable Texture Tiling with Transformed RoPE-Enhanced Diffusion Modelscited by 0
- 2026Physically Based Rendering in the Latent Spacecited by 0
- 2026Physically Based Rendering in the Latent Space17 Sep 2026
- 2026Decoupled Illumination Priors for Spatially Controllable Multi-View Indoor Scene Relighting9 Jul 2026
- 2026Controllable Texture Tiling with Transformed RoPE-Enhanced Diffusion Models22 Jun 2026
- 2026Lighting-Consistent Object Transfer Across Radiance Fields21 Jun 2026
- 2025FROMAT: Multiview Material Appearance Transfer via Few-Shot Self-Attention Adaptation10 Dec 2025
- 2025V-RGBX: Video Editing with Accurate Controls over Intrinsic Propertiescited by 4
- 2025UniLight: A Unified Representation for Lightingcited by 3
- 2025IntrinsicWeather: Controllable Weather Editing in Intrinsic Spacecited by 1
- 2026TokenLight: Precise Lighting Control in Images using Attribute Tokenscited by 1
- 2026GOR-IS: 3D Gaussian Object Removal in the Intrinsic Spacecited by 1
- 2026SyncLight: Single-Edit Multi-View Relightingcited by 0
- 2026Relighting as a Probe of Visual Priors via Augmented Latent Intrinsicscited by 0
- 2026GeRM: A Generative Rendering Model From Physically Realistic to Photorealisticcited by 0
- 2026AlbedoEdit: Unified Instance-Level Video Editing with Albedo Guidancecited by 0
- 2026TRON: Tracing Rays to Orchestrate a Neural Renderer for 3D Gaussian Reconstructionscited by 0
- 2026ResEdit: Residual embeddings for precise generative image editingcited by 0
- 2026Consistent Feature Transport for Image Relightingcited by 0
- 2026Consistent Feature Transport for Image Relighting20 Jul 2026
- 2026ResEdit: Residual embeddings for precise generative image editing15 Jun 2026
- 2026TRON: Tracing Rays to Orchestrate a Neural Renderer for 3D Gaussian Reconstructions9 Jun 2026
- 2026AlbedoEdit: Unified Instance-Level Video Editing with Albedo Guidance31 May 2026
- 2026GOR-IS: 3D Gaussian Object Removal in the Intrinsic Space1 May 2026
- 2026TokenLight: Precise Lighting Control in Images using Attribute Tokens16 Apr 2026
- 2026GeRM: A Generative Rendering Model From Physically Realistic to Photorealistic10 Apr 2026
- 2026Relighting as a Probe of Visual Priors via Augmented Latent Intrinsics1 Feb 2026
- 2026SyncLight: Single-Edit Multi-View Relighting23 Jan 2026
- 2025V-RGBX: Video Editing with Accurate Controls over Intrinsic Properties12 Dec 2025
- 2025UniLight: A Unified Representation for Lighting3 Dec 2025
- 2025IntrinsicWeather: Controllable Weather Editing in Intrinsic Space9 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2024Latent Space Disentanglement in Diffusion Transformers Enables Precise Zero-shot Semantic Editing
- 2026Editing on the Generative Manifold: A Theoretical and Empirical Study of General Diffusion-Based Image Editing Trade-offs
- 2026On the Controllability-Fidelity Frontier in Diffusion Editing
- 2025Edit2Perceive: Image Editing Diffusion Models Are Strong Dense Perceivers
- 2024ByteEdit: Boost, Comply and Accelerate Generative Image Editing
- 2025ReMix: Towards a Unified View of Consistent Character Generation and Editing
- 2026Edge-Aware Image Manipulation via Diffusion Models with a Novel Structure-Preservation Loss
- 2025OmniPaint: Mastering Object-Oriented Editing via Disentangled Insertion-Removal Inpainting