GSE: Evaluating Sticker Visual Semantic Similarity via a General Sticker Encoder
Not on the map. Why?
Abstract (arXiv)
Stickers have become a popular form of visual communication, yet understanding their semantic relationships remains challenging due to their highly diverse and symbolic content. In this work, we formally {define the Sticker Semantic Similarity task} and introduce {Triple-S}, the first benchmark for this task, consisting of 905 human-annotated positive and negative sticker pairs. Through extensive evaluation, we show that existing pretrained vision and multimodal models struggle to capture nuanced sticker semantics. To address this, we propose the {General Sticker Encoder (GSE)}, a lightweight and versatile model that learns robust sticker embeddings using both Triple-S and additional datasets. GSE achieves superior performance on unseen stickers, and demonstrates strong results on downstream tasks such as emotion classification and sticker-to-sticker retrieval. By releasing both Triple-S and GSE, we provide standardized evaluation tools and robust embeddings, enabling future research in sticker understanding, retrieval, and multimodal content generation. The Triple-S benchmark and GSE have been publicly released and are available here.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 27 references that are in the map. First posted on arXiv 7 Nov 2025.
Builds on
15 of 27 references.
References · 15
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,121
- 2016TGIF: A New Dataset and Benchmark on Animated GIF Descriptioncited by 124
- 2024PMG : Personalized Multimodal Generation with Large Language Modelscited by 19
- 2020Learning to Respond with Stickers: A Framework of Unifying Multi-Modality in Multi-Turn Dialogcited by 13
- 2021Towards Expressive Communication with Internet Memes: A New Multimodal Conversation Dataset and Benchmarkcited by 12
- 2025DRC: Enhancing Personalized Image Generation via Disentangled Representation Compositioncited by 8
- 2023Sticker820K: Empowering Interactive Retrieval with Stickerscited by 6
- 2024VSD2M: A Large-scale Vision-language Sticker Dataset for Multi-frame Animated Sticker Generationcited by 4
- 2025MGHFT: Multi-Granularity Hierarchical Fusion Transformer for Cross-Modal Sticker Emotion Recognitioncited by 4
3 more
Built on by
Not cited yet.