mlsanityData to 14 Oct 2026

Structure-Preserving Zero-Shot Image Editing via Stage-Wise Latent Injection in Diffusion Models

arXiv 2504.15723 ↗First posted 22 Apr 2025cs.CVcited by 2

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

We propose a diffusion-based framework for zero-shot image editing that unifies text-guided and reference-guided approaches without requiring fine-tuning. Our method leverages diffusion inversion and timestep-specific null-text embeddings to preserve the structural integrity of the source image. By introducing a stage-wise latent injection strategy-shape injection in early steps and attribute injection in later steps-we enable precise, fine-grained modifications while maintaining global consistency. Cross-attention with reference latents facilitates semantic alignment between the source and reference. Extensive experiments across expression transfer, texture transformation, and style infusion demonstrate state-of-the-art performance, confirming the method's scalability and adaptability to diverse image editing scenarios.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 32 of its 36 references that are in the map. First posted on arXiv 22 Apr 2025.

Builds on

32 of 36 references.

Closest ancestors · 13

Same direction, newest first

  1. 2023DiffI2I: Efficient Diffusion Model for Image-to-Image Translation26 Aug
  2. 2023Improving Tuning-Free Real Image Editing with Proximal Guidance8 Jun
  3. 2023Real-World Image Variation by Aligning Diffusion Inversion Chain30 May
  4. 2023Negative-prompt Inversion: Fast Image Inversion for Editing with Text-guided Diffusion Models26 May
  5. 2023Training-free Content Injection using h-space in Diffusion Models27 Mar
  6. 2022Multi-Concept Customization of Text-to-Image Diffusion8 Dec
  7. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
  8. 2022Direct Inversion: Optimization-Free Text-Driven Real Image Editing with Diffusion Models15 Nov
  9. 2022Diffusion-based Image Translation using Disentangled Style and Content Representation30 Sep
  10. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
  11. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec
  12. 2021Blended Diffusion for Text-driven Editing of Natural Images29 Nov
1 more
  1. 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulation6 Oct

Other references · 19

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  6. 2020Denoising Diffusion Implicit Modelscited by 9,781
  7. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  8. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  9. 2022Classifier-Free Diffusion Guidancecited by 5,847
  10. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  11. 2014Deep Learning Face Attributes in the Wildcited by 3,693
  12. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
7 more
  1. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  2. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  3. 2021Image Super-Resolution via Iterative Refinementcited by 1,511
  4. 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,462
  5. 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,098
  6. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
  7. 20223DDesigner: Towards Photorealistic 3D Object Generation and Editing with Text-guided Diffusion Modelscited by 57

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Latent Space Disentanglement in Diffusion Transformers Enables Zero-shot Fine-grained Semantic Editing
  2. 2023Zero-Shot Contrastive Loss for Text-Guided Diffusion Image Style Transfer
  3. 2026Edge-Aware Image Manipulation via Diffusion Models with a Novel Structure-Preservation Loss
  4. 2024Task-Oriented Diffusion Inversion for High-Fidelity Text-based Editing
  5. 2024Latent Space Disentanglement in Diffusion Transformers Enables Precise Zero-shot Semantic Editing
  6. 2023Textual and Visual Prompt Fusion for Image Editing via Step-Wise Alignment
  7. 2024Latent Inversion with Timestep-aware Sampling for Training-free Non-rigid Editing
  8. 2026ResetEdit: Precise Text-guided Editing of Generated Image via Resettable Starting Latent