mlsanityData to 7 Oct 2026

Soft Contextualized Encoder For User Defined Text Classification

arXiv 2601.03450 ↗First posted 6 Jan 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

User-Defined Text Classification (UDTC) considers the challenge of classifying input text to user-specified, previously unseen classes, a setting that arises frequently in real-world applications such as enterprise analytics, content moderation, and domain-specific information retrieval. We propose a soft-contextualized encoder architecture for UDTC which contextualizes each candidate label with the label set and a static soft prompt representation of the input query. Training on diverse, multi-source datasets enables the model to generalize effectively to zero-shot classification over entirely unseen topic sets drawn from arbitrary domains. We evaluate the proposed architecture both on held-out in-distribution test data and on multiple unseen UDTC benchmarks. Across datasets, the model achieves state-of-the-art performance, consistently outperforming or matching the baselines.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 30 references that are in the map. First posted on arXiv 6 Jan 2026.

Builds on

11 of 30 references.

References · 11

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
  4. 2024jina-embeddings-v3: Multilingual Embeddings With Task LoRAcited by 138
  5. 2019Zero-shot Text Classification With Generative Language Modelscited by 55
  6. 2019Integrating Semantic Knowledge to Tackle Zero-shot Text Classificationcited by 28
  7. 2023An Exploration of Encoder-Decoder Approaches to Multi-Label Classification for Legal and Biomedical Textcited by 23
  8. 2018GILE: A Generalized Input-Label Embedding for Text Classificationcited by 22
  9. 2023Navigating Prompt Complexity for Zero-Shot Classification: A Study of Large Language Models in Computational Social Sciencecited by 18
  10. 2020Unsupervised Label Refinement Improves Dataless Text Classificationcited by 9
  11. 2021Text classification problems via BERT embedding method and graph convolutional neural networkcited by 2

Built on by

Not cited yet.