# BB_twtr at SemEval-2017 Task 4: Twitter Sentiment Analysis with CNNs and LSTMs

arXiv: https://arxiv.org/abs/1704.06125 · HTML: https://mlsanity.com/paper/1704.06125/

## Key facts

- Cited by 16 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 20 Apr 2017.

## Built on by (most cited first, 16 of 16)

- [SentimentGPT: Exploiting GPT for Advanced Sentiment Analysis and its Departure from Current Machine Learning](https://mlsanity.com/paper/2307.10234/) (2023)
- [A Closer Look at Classification Evaluation Metrics and a Critical Reflection of Common Evaluation Practice](https://mlsanity.com/paper/2404.16958/) (2024)
- [Are the Multilingual Models Better? Improving Czech Sentiment with Transformers](https://mlsanity.com/paper/2108.10640/) (2021)
- [SentimentArcs: A Novel Method for Self-Supervised Sentiment Analysis of Time Series Shows SOTA Transformers Can Struggle Finding Narrative Arcs](https://mlsanity.com/paper/2110.09454/) (2021)
- [How Will Your Tweet Be Received? Predicting the Sentiment Polarity of Tweet Replies](https://mlsanity.com/paper/2104.10513/) (2021)
- [A Review of Hybrid and Ensemble in Deep Learning for Natural Language Processing](https://mlsanity.com/paper/2312.05589/) (2023)
- [A generalized quadratic loss for SVM and Deep Neural Networks](https://mlsanity.com/paper/2102.07606/) (2021)
- [M2SA: Multimodal and Multilingual Model for Sentiment Analysis of Tweets](https://mlsanity.com/paper/2404.01753/) (2024)
- [Retrieving Users' Opinions on Social Media with Multimodal Aspect-Based Sentiment Analysis](https://mlsanity.com/paper/2210.15377/) (2022)
- [Text Classification Based on Knowledge Graphs and Improved Attention Mechanism](https://mlsanity.com/paper/2401.03591/) (2024)
- [Utilizing Out-Domain Datasets to Enhance Multi-Task Citation Analysis](https://mlsanity.com/paper/2202.10884/) (2022)
- [XAI in Computational Linguistics: Understanding Political Leanings in the Slovenian Parliament](https://mlsanity.com/paper/2305.04631/) (2023)
- [Detection of depression on social networks using transformers and ensembles](https://mlsanity.com/paper/2305.05325/) (2023)
- [Vulgar Remarks Detection in Chittagonian Dialect of Bangla](https://mlsanity.com/paper/2308.15448/) (2023)
- [SemEval-2017 Task 4: Sentiment Analysis in Twitter using BERT](https://mlsanity.com/paper/2401.07944/) (2024)
- [Language-Independent Sentiment Labelling with Distant Supervision: A Case Study for English, Sepedi and Setswana](https://mlsanity.com/paper/2511.19818/) (2025)

## Abstract (arXiv)

In this paper we describe our attempt at producing a state-of-the-art Twitter sentiment classifier using Convolutional Neural Networks (CNNs) and Long Short Term Memory (LSTMs) networks. Our system leverages a large amount of unlabeled data to pre-train word embeddings. We then use a subset of the unlabeled data to fine tune the embeddings using distant supervision. The final CNNs and LSTMs are trained on the SemEval-2017 Twitter dataset where the embeddings are fined tuned again. To boost performances we ensemble several CNNs and LSTMs together. Our approach achieved first rank on all of the five English subtasks amongst 40 teams.