ACE-LoRA: Adaptive Orthogonal Decoupling for Continual Image Editing
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
State-of-the-art diffusion models often rely on parameter-efficient fine-tuning to perform specialized image editing tasks. However, real-world applications require continual adaptation to new tasks while preserving previously learned knowledge. Despite the practical necessity, continual learning for image editing remains largely underexplored. We propose ACE-LoRA, a dynamic regularization framework for continual image editing that effectively mitigates catastrophic forgetting. ACE-LoRA leverages Adaptive Orthogonal Decoupling to identify and orthogonalize task interference, and introduces a Rank-Invariant Historical Information Compression strategy to address scalability issues in continual updates. To facilitate continual learning in image editing and provide a standardized evaluation protocol, we introduce CIE-Bench, the first comprehensive benchmark in this domain. CIE-Bench encompasses diverse and practically relevant image editing scenarios with a balanced level of difficulty to effectively expose limitations of existing models while remaining compatible with parameter-efficient fine-tuning. Extensive experiments demonstrate that our method consistently outperforms existing baselines in terms of instruction fidelity, visual realism, and robustness to forgetting, establishing a strong foundation for continual learning in image editing.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 47 of its 54 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
47 of 54 references.
Closest ancestors · 6
Same direction, newest first
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Space17 Jun
- 2025T2I-ConBench: Text-to-Image Benchmark for Continual Post-training22 May
- 2022Multi-Concept Customization of Text-to-Image Diffusion8 Dec
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidance20 Oct
Other references · 41
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2025Qwen3 Technical Reportcited by 8,195
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2016Learning without Forgettingcited by 2,465
29 more
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2022Visual Prompt Tuningcited by 1,674
- 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
- 2018Experience Replay for Continual Learningcited by 1,074
- 2021Learning to Prompt for Continual Learningcited by 938
- 2023TIES-Merging: Resolving Interference When Merging Modelscited by 795
- 2022AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognitioncited by 714
- 2023Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunchcited by 679
- 2022CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learningcited by 446
- 2024LoRA+: Efficient Low Rank Adaptation of Large Modelscited by 365
- 2019Orthogonal Gradient Descent for Continual Learningcited by 361
- 2019On Tiny Episodic Memories in Continual Learningcited by 299
- 2023Orthogonal Subspace Learning for Language Model Continual Learningcited by 296
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
- 2024Boosting Continual Learning of Vision-Language Models via Mixture-of-Experts Adapterscited by 199
- 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 196
- 2019Cyclical Annealing Schedule: A Simple Approach to Mitigating KL Vanishingcited by 191
- 2024HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuningcited by 118
- 2024Model merging with SVD to tie the Knotscited by 118
- 2019Lifelong GAN: Continual Learning for Conditional Image Generationcited by 78
- 2024CoIN: A Benchmark of Continual Instruction tuNing for Multimodel Large Language Modelcited by 60
- 2023PCR: Proxy-based Contrastive Replay for Online Class-Incremental Continual Learningcited by 50
- 2025CL-MoE: Enhancing Multimodal Large Language Model with Dual Momentum Mixture-of-Experts for Continual Visual Question Answeringcited by 36
- 2025HiDe-LLaVA: Hierarchical Decoupling for Continual Instruction Tuning of Multimodal Large Language Modelcited by 29
- 2024Adaptive Memory Replay for Continual Learningcited by 21
- 2024SMoLoRA: Exploring and Defying Dual Catastrophic Forgetting in Continual Visual Instruction Tuningcited by 19
- 2026KeepLoRA: Continual Learning with Residual Gradient Adaptationcited by 18
- 2023LFS-GAN: Lifelong Few-Shot Image Generationcited by 11
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026VeloEdit: Training-Free Consistent and Continuous Instruction-Based Image Editing via Velocity Field Decomposition
- 2026SeqLoRA: Bilevel Orthogonal Adaptation for Continual Multi-Concept Generation
- 2026Editing on the Generative Manifold: A Theoretical and Empirical Study of General Diffusion-Based Image Editing Trade-offs
- 2025Deep Generative Continual Learning using Functional LoRA: FunLoRA
- 2026Adaptive Inference-Time Scaling via Early-Step Latent Verification for Image Editing
- 2025ACE++: Instruction-Based Image Creation and Editing via Context-Aware Content Filling
- 2026Decomposing and Composing: Towards Efficient Vision-Language Continual Learning via Rank-1 Expert Pool in a Single LoRA
- 2023AdapEdit: Spatio-Temporal Guided Adaptive Editing Algorithm for Text-Based Continuity-Sensitive Image Editing