mlsanityData to 14 Oct 2026

Disentangled Learning of Stance and Aspect Topics for Vaccine Attitude Detection in Social Media

arXiv 2205.03296 ↗First posted 6 May 2022cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

Building models to detect vaccine attitudes on social media is challenging because of the composite, often intricate aspects involved, and the limited availability of annotated data. Existing approaches have relied heavily on supervised training that requires abundant annotations and pre-defined aspect categories. Instead, with the aim of leveraging the large amount of unannotated data now available on vaccination, we propose a novel semi-supervised approach for vaccine attitude detection, called VADet. A variational autoencoding architecture based on language models is employed to learn from unlabelled data the topical information of the domain. Then, the model is fine-tuned with a few manually annotated examples of user attitudes. We validate the effectiveness of VADet on our annotated data and also on an existing vaccination corpus annotated with opinions on vaccines. Our results show that VADet is able to learn disentangled stance and aspect topics, and outperforms existing aspect-based sentiment analysis models on both stance detection and tweet clustering.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 36 of its 61 references that are in the map. First posted on arXiv 6 May 2022.

Builds on

36 of 61 references.

References · 36

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  3. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  4. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
  5. 2015Character-level Convolutional Networks for Text Classificationcited by 2,330
  6. 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,203
  7. 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 941
  8. 2015Unsupervised Deep Embedding for Clustering Analysiscited by 767
  9. 2019Variational Autoencoders and Nonlinear ICA: A Unifying Frameworkcited by 503
  10. 2014Semi-Supervised Learning with Deep Generative Modelscited by 496
  11. 2018Understanding disentangling in β-VAEcited by 335
  12. 2018Nonlinear ICA Using Auxiliary Variables and Generalized Contrastive Learningcited by 282
24 more
  1. 2017Toward Controlled Generation of Textcited by 272
  2. 2020Weakly-Supervised Disentanglement Without Compromisescited by 239
  3. 2018Delete, Retrieve, Generate: A Simple Approach to Sentiment and Style Transfercited by 191
  4. 2018Disentangled Representation Learning for Non-Parallel Text Style Transfercited by 127
  5. 2019Knowing What, How and Why: A Near Complete Solution for Aspect-based Sentiment Analysiscited by 123
  6. 2020Optimus: Organizing Sentences via Pre-trained Modeling of a Latent Spacecited by 114
  7. 2017Multi-Level Variational Autoencoder: Learning Disentangled Representations from Grouped Observationscited by 100
  8. 2020On Disentangled Representations Learned From Correlated Datacited by 94
  9. 2020Position-Aware Tagging for Aspect Sentiment Triplet Extractioncited by 91
  10. 2021Supporting Clustering with Contrastive Learningcited by 90
  11. 2019Exploiting BERT for End-to-End Aspect-based Sentiment Analysiscited by 57
  12. 2021Topic-Driven and Knowledge-Aware Transformer for Dialogue Emotion Detectioncited by 56
  13. 2019An Interactive Multi-Task Learning Network for End-to-End Aspect-Based Sentiment Analysiscited by 52
  14. 2018Transformation Networks for Target-Oriented Sentiment Classificationcited by 47
  15. 2017Neural Models for Documents with Metadatacited by 46
  16. 2018Aspect Term Extraction with History Attention and Selective Transformationcited by 37
  17. 2020A large-scale COVID-19 Twitter chatter dataset for open scientific research -- an international collaborationcited by 33
  18. 2021Structured Sentiment Analysis as Dependency Graph Parsingcited by 28
  19. 2021Boosting Low-Resource Biomedical QA via Entity-Aware Masking Strategiescited by 21
  20. 2020A Disentangled Adversarial Neural Topic Model for Separating Opinions from Plots in User Reviewscited by 12
  21. 2019TDAM: a Topic-Dependent Attention Model for Sentiment Analysiscited by 7
  22. 2019Monitoring stance towards vaccination in Twitter messagescited by 4
  23. 2018Nested LSTMscited by 3
  24. 2021Evaluation of Thematic Coherence in Microblogscited by 3

Built on by

Cited by year

Citing papers per year: 2023: 3; 2024: 1.

4 papers.