# NTUA-SLP at SemEval-2018 Task 1: Predicting Affective Content in Tweets with Deep Attentive RNNs and Transfer Learning

arXiv: https://arxiv.org/abs/1804.06658 · HTML: https://mlsanity.com/paper/1804.06658/

## Key facts

- Cited by 23 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 18 Apr 2018.

## Built on by (most cited first, 23 of 23)

- [SpanEmo: Casting Multi-label Emotion Classification as Span-prediction](https://mlsanity.com/paper/2101.10038/) (2021)
- [Leveraging Label Correlations in a Multi-label Setting: A Case Study in Emotion](https://mlsanity.com/paper/2210.15842/) (2022)
- [Using Knowledge-Embedded Attention to Augment Pre-trained Language Models for Fine-Grained Emotion Recognition](https://mlsanity.com/paper/2108.00194/) (2021)
- [An Effective Deployment of Contrastive Learning in Multi-label Text Classification](https://mlsanity.com/paper/2212.00552/) (2022)
- [Using Emotion Embeddings to Transfer Knowledge Between Emotions, Languages, and Annotation Formats](https://mlsanity.com/paper/2211.00171/) (2022)
- [Understanding the Role of Affect Dimensions in Detecting Emotions from Tweets: A Multi-task Approach](https://mlsanity.com/paper/2105.03983/) (2021)
- [Multilingual and Multilabel Emotion Recognition using Virtual Adversarial Training](https://mlsanity.com/paper/2111.06181/) (2021)
- [LiGCN: Label-interpretable Graph Convolutional Networks for Multi-label Text Classification](https://mlsanity.com/paper/2103.14620/) (2021)
- [Cross Domain Emotion Recognition using Few Shot Knowledge Transfer](https://mlsanity.com/paper/2110.05021/) (2021)
- [Evaluating the Effectiveness of Data Augmentation for Emotion Classification in Low-Resource Settings](https://mlsanity.com/paper/2406.05190/) (2024)
- [SINGA-Easy: An Easy-to-Use Framework for MultiModal Analysis](https://mlsanity.com/paper/2108.02572/) (2021)
- [VisualTextRank: Unsupervised Graph-based Content Extraction for Automating Ad Text to Image Search](https://mlsanity.com/paper/2108.02725/) (2021)
- [Text is NOT Enough: Integrating Visual Impressions into Open-domain Dialogue Generation](https://mlsanity.com/paper/2109.05778/) (2021)
- [CLUE: Contextualised Unified Explainable Learning of User Engagement in Video Lectures](https://mlsanity.com/paper/2201.05651/) (2022)
- [Discovering Personalized Semantics for Soft Attributes in Recommender Systems using Concept Activation Vectors](https://mlsanity.com/paper/2202.02830/) (2022)
- [Reinforced MOOCs Concept Recommendation in Heterogeneous Information Networks](https://mlsanity.com/paper/2203.11011/) (2022)
- [Explanation-Guided Fairness Testing through Genetic Algorithm](https://mlsanity.com/paper/2205.08335/) (2022)
- [Using Graph Neural Networks for Program Termination](https://mlsanity.com/paper/2207.14648/) (2022)
- [VAuLT: Augmenting the Vision-and-Language Transformer for Sentiment Classification on Social Media](https://mlsanity.com/paper/2208.09021/) (2022)
- [Tribe or Not? Critical Inspection of Group Differences Using TribalGram](https://mlsanity.com/paper/2303.09664/) (2023)
- [Sentiment Analysis in SemEval: A Review of Sentiment Identification Approaches](https://mlsanity.com/paper/2503.10457/) (2025)
- [SyntaxMind at BLP-2025 Task 1: Leveraging Attention Fusion of CNN and GRU for Hate Speech Detection](https://mlsanity.com/paper/2601.06306/) (2026)
- [NTDH: Complex Reasoning for Comprehensive Affective Analysis](https://mlsanity.com/paper/2608.06425/) (2026)

## Abstract (arXiv)

In this paper we present deep-learning models that submitted to the SemEval-2018 Task~1 competition: "Affect in Tweets". We participated in all subtasks for English tweets. We propose a Bi-LSTM architecture equipped with a multi-layer self attention mechanism. The attention mechanism improves the model performance and allows us to identify salient words in tweets, as well as gain insight into the models making them more interpretable. Our model utilizes a set of word2vec word embeddings trained on a large collection of 550 million Twitter messages, augmented by a set of word affective features. Due to the limited amount of task-specific training data, we opted for a transfer learning approach by pretraining the Bi-LSTMs on the dataset of Semeval 2017, Task 4A. The proposed approach ranked 1st in Subtask E "Multi-Label Emotion Classification", 2nd in Subtask A "Emotion Intensity Regression" and achieved competitive results in other subtasks.