Zero-Shot Multi-Label Topic Inference with Sentence Encoders
Not on the map. Why?
Abstract (arXiv)
Sentence encoders have indeed been shown to achieve superior performances for many downstream text-mining tasks and, thus, claimed to be fairly general. Inspired by this, we performed a detailed study on how to leverage these sentence encoders for the "zero-shot topic inference" task, where the topics are defined/provided by the users in real-time. Extensive experiments on seven different datasets demonstrate that Sentence-BERT demonstrates superior generality compared to other encoders, while Universal Sentence Encoder can be preferred when efficiency is a top priority.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 25 of its 67 references that are in the map. First posted on arXiv 14 Apr 2023.
Builds on
25 of 67 references.
References · 25
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2018Universal Sentence Encodercited by 489
- 2018Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyondcited by 434
- 2020Efficient Intent Detection with Dual Sentence Encoderscited by 433
- 2017Supervised Learning of Universal Sentence Representations from Natural Language Inference Datacited by 432
- 2015Skip-Thought Vectorscited by 322
- 2019Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment Approachcited by 308
- 2016Fine-grained Analysis of Sentence Embeddings Using Auxiliary Prediction Taskscited by 216
- 2017Latent Dirichlet Allocation (LDA) and Topic modeling: models, applications, a surveycited by 91
- 2018Weakly-Supervised Neural Text Classificationcited by 66
- 2019Zero-shot Text Classification With Generative Language Modelscited by 55
- 2018Zero-shot User Intent Detection via Capsule Neural Networkscited by 54
13 more
- 2018BioSentVec: creating sentence embeddings for biomedical textscited by 47
- 2017Generative and Discriminative Text Classification with Recurrent Neural Networkscited by 31
- 2018Evaluation of sentence embeddings in downstream and linguistic probing taskscited by 28
- 2019Integrating Semantic Knowledge to Tackle Zero-shot Text Classificationcited by 28
- 2017Train Once, Test Anywhere: Zero-Shot Learning for Text Classificationcited by 22
- 2020Zero-Shot Audio Classification via Semantic Embeddingscited by 21
- 2017Multi-label Dataless Text Classification with Topic Modelingcited by 14
- 2020Zero-shot Relation Classification from Side Informationcited by 8
- 2019Towards Automated Sexual Violence Report Trackingcited by 7
- 2021Dual-View Distilled BERT for Sentence Embeddingcited by 7
- 2018Improving Multilingual Semantic Textual Similarity with Shared Sentence Encoder for Low-resource Languagescited by 5
- 2020Covid-Transformer: Detecting COVID-19 Trending Topics on Twitter Using Universal Sentence Encodercited by 5
- 2020A Transfer Learning Approach for Dialogue Act Classification of GitHub Issue Commentscited by 2
Built on by
Citing papers per year: 2024: 1; 2025: 4; 2026: 1.
6 papers.
- 2025Fundamental Limits of Perfect Concept Erasurecited by 6
- 2025Large Language Models for Healthcare Text Classification: A Systematic Reviewcited by 3
- 2025Zero-Shot Multi-Label Classification of Bangla Documents: Large Decoders Vs. Classic Encoderscited by 2
- 2025QUAD-LLM-MLTC: Large Language Models Ensemble Learning for Healthcare Text Multi-Label Classificationcited by 1
- 2024Leveraging Large Language Models for Fuzzy String Matching in Political Sciencecited by 0
- 2026Population-level measures of perceived food access reveal barriers beyond geographic proximitycited by 0
- 2026Population-level measures of perceived food access reveal barriers beyond geographic proximity10 Sep 2026
- 2025Fundamental Limits of Perfect Concept Erasure25 Mar 2025
- 2025Zero-Shot Multi-Label Classification of Bangla Documents: Large Decoders Vs. Classic Encoders4 Mar 2025
- 2025Large Language Models for Healthcare Text Classification: A Systematic Review3 Mar 2025
- 2025QUAD-LLM-MLTC: Large Language Models Ensemble Learning for Healthcare Text Multi-Label Classification20 Feb 2025
- 2024Leveraging Large Language Models for Fuzzy String Matching in Political Science27 Mar 2024