IdentityGuard: Context-Aware Restriction and Provenance for Personalized Synthesis
On the map: LLM safety and security → Watermarking generated content and models
Abstract (arXiv)
The nature of personalized text-to-image models poses a unique safety challenge that generic context-blind methods are ill-equipped to handle. Such global filters create a dilemma: to prevent misuse, they are forced to damage the model's broader utility by erasing concepts entirely, causing unacceptable collateral damage.Our work presents a more precisely targeted approach, built on the principle that security should be as context-aware as the threat itself, intrinsically bound to the personalized concept. We present IDENTITYGUARD, which realizes this principle through a conditional restriction that blocks harmful content only when combined with the personalized identity, and a concept-specific watermark for precise traceability. Experiments show our approach prevents misuse while preserving the model's utility and enabling robust traceability. By moving beyond blunt, global filters, our work demonstrates a more effective and responsible path toward AI safety.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 17 of its 20 references that are in the map. First posted on arXiv 14 Mar 2026.
Builds on
17 of 20 references.
Closest ancestors · 3
Same direction, newest first
- 2023FT-Shield: A Watermark Against Unauthorized Fine-tuning in Text-to-Image Diffusion Models3 Oct
- 2023Catch You Everything Everywhere: Guarding Textual Inversion via Concept Watermarking12 Sep
- 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Models27 Mar
Other references · 14
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
- 2023Erasing Concepts from Diffusion Modelscited by 530
- 2022Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Modelscited by 501
- 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 411
- 2018HiDDeN: Hiding Data With Deep Networkscited by 384
- 2023Unified Concept Editing in Diffusion Modelscited by 377
- 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 230
- 2023Encoder-based Domain Tuning for Fast Personalization of Text-to-Image Modelscited by 203
- 2023Selective Amnesia: A Continual Learning Approach to Forgetting in Deep Generative Modelscited by 175
- 2024GuardT2I: Defending Text-to-Image Models from Adversarial Promptscited by 61
- 2024Universal Prompt Optimizer for Safe Text-to-Image Generationcited by 27
Built on by
Not cited yet.