Soft Contextualized Encoder For User Defined Text Classification
Not on the map. Why?
Abstract (arXiv)
User-Defined Text Classification (UDTC) considers the challenge of classifying input text to user-specified, previously unseen classes, a setting that arises frequently in real-world applications such as enterprise analytics, content moderation, and domain-specific information retrieval. We propose a soft-contextualized encoder architecture for UDTC which contextualizes each candidate label with the label set and a static soft prompt representation of the input query. Training on diverse, multi-source datasets enables the model to generalize effectively to zero-shot classification over entirely unseen topic sets drawn from arbitrary domains. We evaluate the proposed architecture both on held-out in-distribution test data and on multiple unseen UDTC benchmarks. Across datasets, the model achieves state-of-the-art performance, consistently outperforming or matching the baselines.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 30 references that are in the map. First posted on arXiv 6 Jan 2026.
Builds on
11 of 30 references.
References · 11
- 2017Attention Is All You Needcited by 59,932
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
- 2024jina-embeddings-v3: Multilingual Embeddings With Task LoRAcited by 138
- 2019Zero-shot Text Classification With Generative Language Modelscited by 55
- 2019Integrating Semantic Knowledge to Tackle Zero-shot Text Classificationcited by 28
- 2023An Exploration of Encoder-Decoder Approaches to Multi-Label Classification for Legal and Biomedical Textcited by 23
- 2018GILE: A Generalized Input-Label Embedding for Text Classificationcited by 22
- 2023Navigating Prompt Complexity for Zero-Shot Classification: A Study of Large Language Models in Computational Social Sciencecited by 18
- 2020Unsupervised Label Refinement Improves Dataless Text Classificationcited by 9
- 2021Text classification problems via BERT embedding method and graph convolutional neural networkcited by 2
Built on by
Not cited yet.