mlsanityData to 7 Oct 2026

ACE-LoRA: Adaptive Orthogonal Decoupling for Continual Image Editing

arXiv 2605.14948 ↗First posted 14 May 2026cs.CVcited by 0

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

State-of-the-art diffusion models often rely on parameter-efficient fine-tuning to perform specialized image editing tasks. However, real-world applications require continual adaptation to new tasks while preserving previously learned knowledge. Despite the practical necessity, continual learning for image editing remains largely underexplored. We propose ACE-LoRA, a dynamic regularization framework for continual image editing that effectively mitigates catastrophic forgetting. ACE-LoRA leverages Adaptive Orthogonal Decoupling to identify and orthogonalize task interference, and introduces a Rank-Invariant Historical Information Compression strategy to address scalability issues in continual updates. To facilitate continual learning in image editing and provide a standardized evaluation protocol, we introduce CIE-Bench, the first comprehensive benchmark in this domain. CIE-Bench encompasses diverse and practically relevant image editing scenarios with a balanced level of difficulty to effectively expose limitations of existing models while remaining compatible with parameter-efficient fine-tuning. Extensive experiments demonstrate that our method consistently outperforms existing baselines in terms of instruction fidelity, visual realism, and robustness to forgetting, establishing a strong foundation for continual learning in image editing.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 47 of its 54 references that are in the map. First posted on arXiv 14 May 2026.

Builds on

47 of 54 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Space17 Jun
  2. 2025T2I-ConBench: Text-to-Image Benchmark for Continual Post-training22 May
  3. 2022Multi-Concept Customization of Text-to-Image Diffusion8 Dec
  4. 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
  5. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
  6. 2022DiffEdit: Diffusion-based semantic image editing with mask guidance20 Oct

Other references · 41

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  5. 2022Scalable Diffusion Models with Transformerscited by 5,931
  6. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  7. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  8. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  9. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  10. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
  11. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  12. 2016Learning without Forgettingcited by 2,465
29 more
  1. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  2. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  3. 2022Visual Prompt Tuningcited by 1,674
  4. 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
  5. 2018Experience Replay for Continual Learningcited by 1,074
  6. 2021Learning to Prompt for Continual Learningcited by 938
  7. 2023TIES-Merging: Resolving Interference When Merging Modelscited by 795
  8. 2022AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognitioncited by 714
  9. 2023Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunchcited by 679
  10. 2022CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learningcited by 446
  11. 2024LoRA+: Efficient Low Rank Adaptation of Large Modelscited by 365
  12. 2019Orthogonal Gradient Descent for Continual Learningcited by 361
  13. 2019On Tiny Episodic Memories in Continual Learningcited by 299
  14. 2023Orthogonal Subspace Learning for Language Model Continual Learningcited by 296
  15. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
  16. 2024Boosting Continual Learning of Vision-Language Models via Mixture-of-Experts Adapterscited by 199
  17. 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 196
  18. 2019Cyclical Annealing Schedule: A Simple Approach to Mitigating KL Vanishingcited by 191
  19. 2024HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuningcited by 118
  20. 2024Model merging with SVD to tie the Knotscited by 118
  21. 2019Lifelong GAN: Continual Learning for Conditional Image Generationcited by 78
  22. 2024CoIN: A Benchmark of Continual Instruction tuNing for Multimodel Large Language Modelcited by 60
  23. 2023PCR: Proxy-based Contrastive Replay for Online Class-Incremental Continual Learningcited by 50
  24. 2025CL-MoE: Enhancing Multimodal Large Language Model with Dual Momentum Mixture-of-Experts for Continual Visual Question Answeringcited by 36
  25. 2025HiDe-LLaVA: Hierarchical Decoupling for Continual Instruction Tuning of Multimodal Large Language Modelcited by 29
  26. 2024Adaptive Memory Replay for Continual Learningcited by 21
  27. 2024SMoLoRA: Exploring and Defying Dual Catastrophic Forgetting in Continual Visual Instruction Tuningcited by 19
  28. 2026KeepLoRA: Continual Learning with Residual Gradient Adaptationcited by 18
  29. 2023LFS-GAN: Lifelong Few-Shot Image Generationcited by 11

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026VeloEdit: Training-Free Consistent and Continuous Instruction-Based Image Editing via Velocity Field Decomposition
  2. 2026SeqLoRA: Bilevel Orthogonal Adaptation for Continual Multi-Concept Generation
  3. 2026Editing on the Generative Manifold: A Theoretical and Empirical Study of General Diffusion-Based Image Editing Trade-offs
  4. 2025Deep Generative Continual Learning using Functional LoRA: FunLoRA
  5. 2026Adaptive Inference-Time Scaling via Early-Step Latent Verification for Image Editing
  6. 2025ACE++: Instruction-Based Image Creation and Editing via Context-Aware Content Filling
  7. 2026Decomposing and Composing: Towards Efficient Vision-Language Continual Learning via Rank-1 Expert Pool in a Single LoRA
  8. 2023AdapEdit: Spatio-Temporal Guided Adaptive Editing Algorithm for Text-Based Continuity-Sensitive Image Editing