# Efficient Twitter Sentiment Classification using Subjective Distant Supervision

arXiv: https://arxiv.org/abs/1701.03051 · HTML: https://mlsanity.com/paper/1701.03051/

## Key facts

- Cited by 9 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 11 Jan 2017.

## Built on by (most cited first, 9 of 9)

- [A Multi-Task Embedder For Retrieval Augmented LLMs](https://mlsanity.com/paper/2310.07554/) (2023)
- [FAN: Fourier Analysis Networks](https://mlsanity.com/paper/2410.02675/) (2024)
- [CSAFL: A Clustered Semi-Asynchronous Federated Learning Framework](https://mlsanity.com/paper/2104.08184/) (2021)
- [G2uardFL: Safeguarding Federated Learning Against Backdoor Attacks through Attributed Client Graph Clustering](https://mlsanity.com/paper/2306.04984/) (2023)
- [Federated Submodel Optimization for Hot and Cold Data Features](https://mlsanity.com/paper/2109.07704/) (2021)
- [Transfer Learning for Improving Results on Russian Sentiment Datasets](https://mlsanity.com/paper/2107.02499/) (2021)
- [A Fast Randomized Algorithm for Massive Text Normalization](https://mlsanity.com/paper/2110.03024/) (2021)
- [DeepTrust: A Reliable Financial Knowledge Retrieval Framework For Explaining Extreme Pricing Anomalies](https://mlsanity.com/paper/2203.08144/) (2022)
- [The University of Edinburgh's Submission to the WMT22 Code-Mixing Shared Task (MixMT)](https://mlsanity.com/paper/2210.11309/) (2022)

## Abstract (arXiv)

As microblogging services like Twitter are becoming more and more influential in today's globalised world, its facets like sentiment analysis are being extensively studied. We are no longer constrained by our own opinion. Others opinions and sentiments play a huge role in shaping our perspective. In this paper, we build on previous works on Twitter sentiment analysis using Distant Supervision. The existing approach requires huge computation resource for analysing large number of tweets. In this paper, we propose techniques to speed up the computation process for sentiment analysis. We use tweet subjectivity to select the right training samples. We also introduce the concept of EFWS (Effective Word Score) of a tweet that is derived from polarity scores of frequently used words, which is an additional heuristic that can be used to speed up the sentiment classification with standard machine learning algorithms. We performed our experiments using 1.6 million tweets. Experimental evaluations show that our proposed technique is more efficient and has higher accuracy compared to previously proposed methods. We achieve overall accuracies of around 80% (EFWS heuristic gives an accuracy around 85%) on a training dataset of 100K tweets, which is half the size of the dataset used for the baseline model. The accuracy of our proposed model is 2-3% higher than the baseline model, and the model effectively trains at twice the speed of the baseline model.
