MOLM: Mixture of LoRA Markers
On the map: LLM safety and security → Watermarking generated content and models
Abstract (arXiv)
Generative models can generate photorealistic images at scale. This raises urgent concerns about the ability to detect synthetically generated images and attribute these images to specific sources. While watermarking has emerged as a possible solution, existing methods remain fragile to realistic distortions, susceptible to adaptive removal, and expensive to update when the underlying watermarking key changes. We propose a general watermarking framework that formulates the encoding problem as key-dependent perturbation of the parameters of a generative model. Within this framework, we introduce Mixture of LoRA Markers (MOLM), a routing-based instantiation in which binary keys activate lightweight LoRA adapters inside residual and attention blocks. This design avoids key-specific re-training and achieves the desired properties such as imperceptibility, fidelity, verifiability, and robustness. Experiments on Stable Diffusion and FLUX show that MOLM preserves image quality while achieving robust key recovery against distortions, compression and regeneration, averaging attacks, and black-box adversarial attacks on the extractor.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 40 of its 49 references that are in the map. First posted on arXiv 30 Sep 2025.
Builds on
40 of 49 references.
Closest ancestors · 15
Same direction, newest first
- 2024SleeperMark: Towards Robust Watermark against Fine-Tuning Text-to-image Diffusion Models6 Dec
- 2024SoK: Watermarking for AI-Generated Content27 Nov
- 2024ROBIN: Robust and Invisible Watermarks for Diffusion Models with Adversarial Optimization6 Nov
- 2024Robust Watermarking Using Generative Priors Against Image Editing: From Benchmarking to Advances24 Oct
- 2024LaWa: Using Latent Space for In-Generation Image Watermarking11 Aug
- 2024AquaLoRA: Toward White-box Protection for Customized Stable Diffusion Models via Watermark LoRA18 May
- 2024Gaussian Shading: Provable Performance-Lossless Image Watermarking for Diffusion Models7 Apr
- 2024Latent Watermark: Inject and Detect Watermarks in Latent Diffusion Space30 Mar
- 2023Robustness of AI-Image Detectors: Fundamental Limits and Practical Attacks29 Sep
- 2023Invisible Image Watermarks Are Provably Removable Using Generative AI2 Jun
- 2023Tree-Ring Watermarks: Fingerprints for Diffusion Images that are Invisible and Robust31 May
- 2023Watermarking Diffusion Model21 May
3 more
Other references · 25
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2018Variational image compression with a scale hyperpriorcited by 910
- 2022Pseudo Numerical Methods for Diffusion Models on Manifoldscited by 695
13 more
- 2020Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modulescited by 570
- 2018HiDDeN: Hiding Data With Deep Networkscited by 384
- 2019Hidden Trigger Backdoor Attackscited by 359
- 2020Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Datacited by 200
- 2024Mixture of LoRA Expertscited by 179
- 2021Sleeper Agent: Scalable Hidden Trigger Backdoors for Neural Networks Trained from Scratchcited by 98
- 2023Text-to-Image Diffusion Models can be Easily Backdoored through Multimodal Data Poisoningcited by 91
- 2024WAVES: Benchmarking the Robustness of Image Watermarkscited by 89
- 2023WOUAF: Weight Modulation for User Attribution and Fingerprinting in Text-to-Image Diffusion Modelscited by 51
- 2023TrustMark: Universal Watermarking for Arbitrary Resolution Imagescited by 50
- 2022Supervised GAN Watermarking for Intellectual Property Protectioncited by 39
- 2023Security and Privacy on Generative Data in AIGC: A Surveycited by 34
- 2023Securing Deep Generative Models with Universal Adversarial Signaturecited by 13
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025AuthenLoRA: Entangling Stylization with Imperceptible Watermarks for Copyright-Secure LoRA Adapters
- 2026LoRA-Key: User-Centric LoRA Watermarking for Text-to-Image Diffusion Models
- 2025LoRAGuard: An Effective Black-box Watermarking Approach for LoRAs
- 2025SEAL: Entangled White-box Watermarks on Low-Rank Adaptation
- 2024An Efficient Watermarking Method for Latent Diffusion Models via Low-Rank Adaptation and Dynamic Loss Weighting
- 2026FeatMark: Feature-level Watermark Protection against Mimicry Attacks with Diffusion Models
- 2025BitMark: Watermarking Bitwise Autoregressive Image Generative Models
- 2025Image Watermarking of Generative Diffusion Models