mlsanityData to 7 Oct 2026

Noise Map Guidance: Inversion with Spatial Context for Real Image Editing

arXiv 2402.04625 ↗First posted 7 Feb 2024cs.CVcited by 25

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Text-guided diffusion models have become a popular tool in image synthesis, known for producing high-quality and diverse images. However, their application to editing real images often encounters hurdles primarily due to the text condition deteriorating the reconstruction quality and subsequently affecting editing fidelity. Null-text Inversion (NTI) has made strides in this area, but it fails to capture spatial context and requires computationally intensive per-timestep optimization. Addressing these challenges, we present Noise Map Guidance (NMG), an inversion method rich in a spatial context, tailored for real-image editing. Significantly, NMG achieves this without necessitating optimization, yet preserves the editing quality. Our empirical investigations highlight NMG's adaptability across various editing techniques and its robustness to variants of DDIM inversions.

Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 37 of its 40 references that are in the map. First posted on arXiv 7 Feb 2024.

Builds on

37 of 40 references.

Closest ancestors · 12

Same direction, newest first

  1. 2023Negative-prompt Inversion: Fast Image Inversion for Editing with Text-guided Diffusion Models26 May
  2. 2023An Edit Friendly DDPM Noise Space: Inversion and Manipulations12 Apr
  3. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
  4. 2022UniTune: Text-Driven Image Editing by Fine Tuning a Diffusion Model on a Single Image17 Oct
  5. 2022Imagic: Text-Based Real Image Editing with Diffusion Models17 Oct
  6. 2022Diffusion-based Image Translation using Disentangled Style and Content Representation30 Sep
  7. 2022Blended Latent Diffusion6 Jun
  8. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
  9. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
  10. 2022Complex Scene Image Editing by Scene Graph Comprehension24 Mar
  11. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec
  12. 2021Blended Diffusion for Text-driven Editing of Natural Images29 Nov

Other references · 25

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  8. 2022Classifier-Free Diffusion Guidancecited by 5,717
  9. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  10. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  11. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  12. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
13 more
  1. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
  2. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
  3. 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 640
  4. 2023Zero-shot Image-to-Image Translationcited by 503
  5. 2022Improving Diffusion Models for Inverse Problems using Manifold Constraintscited by 501
  6. 2023Universal Guidance for Diffusion Modelscited by 426
  7. 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 416
  8. 2022Text2LIVE: Text-Driven Layered Image and Video Editingcited by 312
  9. 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
  10. 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 290
  11. 2022EDICT: Exact Diffusion Inversion via Coupled Transformationscited by 256
  12. 2022EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equationscited by 172
  13. 2018NSML: Meet the MLaaS platform with a real-world case studycited by 70

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 9; 2025: 13; 2026: 3.

25 papers.

Sort:

By area:

  1. 2024FireFlow: Fast Inversion of Rectified Flow for Image Semantic Editingcited by 66
  2. 2024Schedule Your Edit: A Simple yet Effective Diffusion Noise Schedule for Image Editingcited by 38
  3. 2024BELM: Bidirectional Explicit Linear Multi-step Sampler for Exact Inversion in Diffusion Modelscited by 29
  4. 2024Source Prompt Disentangled Inversion for Boosting Image Editability with Diffusion Modelscited by 21
  5. 2024FastDrag: Manipulate Anything in One Stepcited by 20
  6. 2025h-Edit: Effective and Flexible Diffusion-Based Editing via Doob's h-Transformcited by 18
  7. 2025Hierarchical Reasoning Models: Perspectives and Misconceptionscited by 13
  8. 2025FDS: Frequency-Aware Denoising Score for Text-Guided Latent Diffusion Image Editingcited by 12
  9. 2025Adams Bashforth Moulton Solver for Inversion and Editing in Rectified Flowcited by 10
  10. 2024PostEdit: Posterior Sampling for Efficient Zero-Shot Image Editingcited by 9
  11. 2024Text-to-Image Synthesis: A Decade Surveycited by 9
  12. 2024Dual-Schedule Inversion: Training- and Tuning-Free Inversion for Real Image Editingcited by 8
13 more
  1. 2025POLARIS: Projection-Orthogonal Least Squares for Robust and Adaptive Inversion in Diffusion Modelscited by 8
  2. 2025DCI: Dual-Conditional Inversion for Boosting Diffusion-Based Image Editingcited by 5
  3. 2025Dragging with Geometry: From Pixels to Geometry-Guided Image Editingcited by 4
  4. 2024Task-Oriented Diffusion Inversion for High-Fidelity Text-based Editingcited by 2
  5. 2025PT-Mark: Invisible Watermarking for Text-to-image Diffusion Models via Semantic-aware Pivotal Tuningcited by 2
  6. 2026Free Lunch for Stabilizing Rectified Flow Inversioncited by 2
  7. 2025An Empirical Study of Validating Synthetic Data for Text-Based Person Retrievalcited by 1
  8. 2025Tuning-Free Image Editing with Fidelity and Editability via Unified Latent Diffusion Modelcited by 1
  9. 2025AttentionDrag: Exploiting Latent Correlation Knowledge in Pre-trained Diffusion Models for Image Editingcited by 1
  10. 2025Improving Diffusion-Based Image Editing Faithfulness via Guidance and Schedulingcited by 1
  11. 2025Editable Noise Map Inversion: Encoding Target-image into Noise For High-Fidelity Image Manipulationcited by 1
  12. 2026SSI-DM: Singularity Skipping Inversion of Diffusion Modelscited by 0
  13. 2026Drag as Evidence: Motion-Grounded Latent Recomposition for Drag-Based Editingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Eta Inversion: Designing an Optimal Eta Function for Diffusion-based Real Image Editing
  2. 2023Inversion-Free Image Editing with Natural Language
  3. 2024TurboEdit: Text-Based Image Editing Using Few-Step Diffusion Models
  4. 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Code
  5. 2026Consistent-Inversion: Reverse Consistency Guidance for Structure-Preserving Visual Editing
  6. 2023Improving Tuning-Free Real Image Editing with Proximal Guidance
  7. 2024Wavelet-Guided Acceleration of Text Inversion in Diffusion-Based Image Editing
  8. 2025Tight Inversion: Image-Conditioned Inversion for Real Image Editing