RemEdit: Efficient Diffusion Editing with Riemannian Geometry
Not on the map. Why?
Abstract (arXiv)
Controllable image generation is fundamental to the success of modern generative AI, yet it faces a critical trade-off between semantic fidelity and inference speed. The RemEdit diffusion-based framework addresses this trade-off with two synergistic innovations. First, for editing fidelity, we navigate the latent space as a Riemannian manifold. A mamba-based module efficiently learns the manifold's structure, enabling direct and accurate geodesic path computation for smooth semantic edits. This control is further refined by a dual-SLERP blending technique and a goal-aware prompt enrichment pass from a Vision-Language Model. Second, for additional acceleration, we introduce a novel task-specific attention pruning mechanism. A lightweight pruning head learns to retain tokens essential to the edit, enabling effective optimization without the semantic degradation common in content-agnostic approaches. RemEdit surpasses prior state-of-the-art editing frameworks while maintaining real-time performance under 50% pruning. Consequently, RemEdit establishes a new benchmark for practical and powerful image editing. Source code: https://www.github.com/eashanadhikarla/RemEdit.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 44 of its 55 references that are in the map. First posted on arXiv 25 Jan 2026.
Builds on
44 of 55 references.
References · 44
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
- 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,098
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
32 more
- 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 642
- 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 628
- 2020GANSpace: Discovering Interpretable GAN Controlscited by 614
- 2021Diffusion Autoencoders: Toward a Meaningful and Decodable Representationcited by 449
- 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 394
- 2022Diffusion Models already have a Semantic Latent Spacecited by 328
- 2023Structural Pruning for Diffusion Modelscited by 195
- 2023Negative-prompt Inversion: Fast Image Inversion for Editing with Text-guided Diffusion Modelscited by 174
- 2021StyleGAN-NADA: CLIP-Guided Domain Adaptation of Image Generatorscited by 164
- 2023LEDITS++: Limitless Image Editing using Text-to-Image Modelscited by 148
- 2023Understanding the Latent Space of Diffusion Models through the Lens of Riemannian Geometrycited by 125
- 2023Token Fusion: Bridging the Gap between Token Pruning and Token Mergingcited by 125
- 2023Inversion-Free Image Editing with Natural Languagecited by 106
- 2024LD-Pruner: Efficient Pruning of Latent Diffusion Models using Task-Agnostic Insightscited by 65
- 2024Dynamic Diffusion Transformercited by 62
- 2023Discovering Interpretable Directions in the Semantic Latent Space of Diffusion Modelscited by 60
- 2024Attention-Driven Training-Free Efficiency Enhancement of Diffusion Modelscited by 38
- 2023Training-free Content Injection using h-space in Diffusion Modelscited by 36
- 2023Lightning-Fast Image Inversion and Editing for Text-to-Image Diffusion Modelscited by 35
- 2024Token Pruning for Caching Better: 9 Times Acceleration on Stable Diffusion for Freecited by 30
- 2023Boundary Guided Learning-Free Semantic Control with Diffusion Modelscited by 23
- 2023Iterative Multi-granular Image Editing using Diffusion Modelscited by 20
- 2025h-Edit: Effective and Flexible Diffusion-Based Editing via Doob's h-Transformcited by 19
- 2023Hierarchical Diffusion Autoencoders and Disentangled Image Manipulationcited by 18
- 2025CAT Pruning: Cluster-Aware Token Pruning For Text-to-Image Diffusion Modelscited by 16
- 2024NoiseDiffusion: Correcting Noise for Image Interpolation with Diffusion Models beyond Spherical Linear Interpolationcited by 13
- 2025Unleashing the Potential of the Semantic Latent Space in Diffusion Models for Image Dehazingcited by 8
- 2023Towards Real-time Text-driven Image Manipulation with Unconditional Diffusion Modelscited by 7
- 2023POP: Prompt Of Prompts for Continual Learningcited by 7
- 2023Unsupervised Discovery of Interpretable Directions in h-space of Pre-trained Diffusion Modelscited by 6
- 2025What's Inside Your Diffusion Model? A Score-Based Riemannian Metric to Explore the Data Manifoldcited by 6
- 2025Image Interpolation with Score-based Riemannian Metrics of Diffusion Modelscited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Editing on the Generative Manifold: A Theoretical and Empirical Study of General Diffusion-Based Image Editing Trade-offs
- 2025Edit2Perceive: Image Editing Diffusion Models Are Strong Dense Perceivers
- 2026GeoEdit: Local Frames for Fast, Training-Free On-Manifold Editing in Diffusion Models
- 2025Training-free Geometric Image Editing on Diffusion Models
- 20253D-LATTE: Latent Space 3D Editing from Textual Instructions
- 2025IntrinsicEdit: Precise generative image manipulation in intrinsic space
- 2025Self-Attention Decomposition For Training Free Diffusion Editing
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidance