SEAL: Semantic-aware Single-image Sticker Personalization with a Large-scale Sticker-tag Dataset
Not on the map. Why?
Abstract (arXiv)
Synthesizing a target concept from a single reference image is challenging in diffusion-based personalized text-to-image generation, particularly for sticker personalization where prompts often require explicit attribute edits. With only one reference, test-time fine-tuning (TTF) methods tend to overfit, producing textitvisual entanglement, where background artifacts are absorbed into the learned concept, and textitstructural rigidity, where the model memorizes reference-specific spatial configurations and loses contextual controllability. To address these issues, we introduce SEmantic-aware single-image sticker personALization (SEAL), a plug-and-play, architecture-agnostic adaptation module that integrates into existing personalization pipelines without modifying their U-Net-based diffusion backbones. SEAL applies three components during embedding adaptation: (1) a Semantic-guided Spatial Attention Loss, (2) a Split-merge Token Strategy, and (3) Structure-aware Layer Restriction. To support sticker-domain personalization with attribute-level control, we present StickerBench, a large-scale sticker image dataset with structured tags under a six-attribute schema (Appearance, Emotion, Action, Camera Composition, Style, Background). These annotations provide a consistent interface for varying context while keeping target identity fixed, enabling systematic evaluation of identity disentanglement and contextual controllability. Experiments show that SEAL consistently improves identity preservation while maintaining contextual controllability, highlighting the importance of explicit spatial and structural constraints during test-time adaptation. The code, StickerBench, and project page will be publicly released.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 32 references that are in the map. First posted on arXiv 29 Apr 2026.
Builds on
22 of 32 references.
References · 22
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
- 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 343
- 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 142
- 2024JeDi: Joint-Image Diffusion Models for Finetuning-Free Personalized Text-to-Image Generationcited by 52
- 2024λ-ECLIPSE: Multi-Concept Personalized Text-to-Image Diffusion Models by Leveraging CLIP Latent Spacecited by 51
- 2024UnZipLoRA: Separating Content and Style from a Single Imagecited by 24
10 more
- 2024ClassDiffusion: More Aligned Personalization Tuning with Explicit Class Guidancecited by 18
- 2024APISR: Anime Production Inspired Real-World Anime Super-Resolutioncited by 16
- 2024CoRe: Context-Regularized Text Embedding Learning for Text-to-Image Personalizationcited by 14
- 2021Towards Expressive Communication with Internet Memes: A New Multimodal Conversation Dataset and Benchmarkcited by 12
- 2024AttnDreamBooth: Towards Text-Aligned Personalized Text-to-Image Generationcited by 10
- 2024Bridging the Gap Between End-to-End and Two-Step Text Spottingcited by 9
- 2024A-SDM: Accelerating Stable Diffusion through Model Assembly and Feature Inheritance Strategiescited by 3
- 2024SerialGen: Personalized Image Generation by First Standardization Then Personalizationcited by 3
- 2025U-Sticker: A Large-Scale Multi-Domain User Sticker Dataset for Retrieval and Personalizationcited by 2
- 2025CHIMERA: Adaptive Cache Injection and Semantic Anchor Prompting for Zero-shot Image Morphing with Morphing-oriented Metricscited by 2
Built on by
Not cited yet.