Using millions of emoji occurrences to learn any-domain representations for detecting sentiment, emotion and sarcasm
Not on the map. Why?
Abstract (arXiv)
NLP tasks are often limited by scarcity of manually annotated data. In social media sentiment analysis and related tasks, researchers have therefore used binarized emoticons and specific hashtags as forms of distant supervision. Our paper shows that by extending the distant supervision to a more diverse set of noisy labels, the models can learn richer representations. Through emoji prediction on a dataset of 1246 million tweets containing one of 64 common emojis we obtain state-of-the-art performance on 8 benchmark datasets within sentiment, emotion and sarcasm detection using a single pretrained model. Our analyses confirm that the diversity of our emotional labels yield a performance improvement over previous distant supervision approaches.
Key facts. Cited by 117 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Aug 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 1; 2021: 38; 2022: 27; 2023: 21; 2024: 14; 2025: 11; 2026: 4.
117 papers.
Sort:
By area:
- 2019Way Off-Policy Batch Deep Reinforcement Learning of Implicit Human Preferences in Dialogcited by 283
- 2021IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoningcited by 262
- 2023emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representationcited by 196
- 2023Stop Uploading Test Data in Plain Text: Practical Strategies for Mitigating Data Contamination by Evaluation Benchmarkscited by 139
- 2020Human-centric Dialog Training via Offline Reinforcement Learningcited by 92
- 2021Hatemoji: A Test Suite and Adversarially-Generated Dataset for Benchmarking and Detecting Emoji-based Hatecited by 50
- 2021Diverse Adversaries for Mitigating Bias in Trainingcited by 48
- 2022Dimensional Modeling of Emotions in Text with Appraisal Theories: Corpus Creation, Annotation Reliability, and Predictioncited by 45
- 2021SpanEmo: Casting Multi-label Emotion Classification as Span-predictioncited by 37
- 2021Balancing out Bias: Achieving Fairness Through Balanced Trainingcited by 34
- 2021Contrastive Learning for Fair Representationscited by 34
- 2022Gold Doesn't Always Glitter: Spectral Removal of Linear and Nonlinear Guarded Attribute Informationcited by 33
38 more
- 2021Refining Language Models with Compositional Explanationscited by 27
- 2022Towards Multi-Modal Sarcasm Detection via Hierarchical Congruity Modeling with Knowledge Enhancementcited by 26
- 2021Nice perfume. How long did you marinate in it? Multimodal Sarcasm Explanationcited by 25
- 2023Shielded Representations: Protecting Sensitive Attributes Through Iterative Gradient-Based Projectioncited by 25
- 2021Self-Supervised Euphemism Detection and Identification for Content Moderationcited by 24
- 2022Optimising Equal Opportunity Fairness in Model Trainingcited by 22
- 2023Multi-source Semantic Graph-based Multimodal Sarcasm Explanation Generationcited by 19
- 2022Identifying Moments of Change from Longitudinal User Textcited by 17
- 2022Learning Fair Representations via Rate-Distortion Maximizationcited by 15
- 2021A Dual-Channel Framework for Sarcasm Recognition by Detecting Sentiment Conflictcited by 14
- 2022Empathetic Conversational Systems: A Review of Current Advances, Gaps, and Opportunitiescited by 14
- 2022Leveraging Label Correlations in a Multi-label Setting: A Case Study in Emotioncited by 14
- 2023ShuttleSet: A Human-Annotated Stroke-Level Singles Dataset for Badminton Tactical Analysiscited by 13
- 2021Exploring the Long Short-Term Dependencies to Infer Shot Influence in Badminton Matchescited by 10
- 2021A Little Pretraining Goes a Long Way: A Case Study on Dependency Parsing Task for Low-resource Morphologically Rich Languagescited by 9
- 2021Modulating Language Models with Emotionscited by 9
- 2022Fair NLP Models with Differentially Private Text Encoderscited by 9
- 2023StockEmotions: Discover Investor Emotions for Financial Sentiment Analysis and Multivariate Time Seriescited by 9
- 2022Towards Equal Opportunity Fairness through Adversarial Learningcited by 8
- 2022FairGrad: Fairness Aware Gradient Descentcited by 8
- 2021CheerBots: Chatbots toward Empathy and Emotionusing Reinforcement Learningcited by 7
- 2022Using Emotion Embeddings to Transfer Knowledge Between Emotions, Languages, and Annotation Formatscited by 7
- 2023A Comprehensive Survey on Affective Computing; Challenges, Trends, Applications, and Future Directionscited by 7
- 2023Where are We in Event-centric Emotion Analysis? Bridging Emotion Role Labeling and Appraisal-based Approachescited by 7
- 2024Emojis Decoded: Leveraging ChatGPT for Enhanced Understanding in Social Media Communicationscited by 7
- 2021Latent-Optimized Adversarial Neural Transfer for Sarcasm Detectioncited by 6
- 2021Offensive Language Identification in Low-resourced Code-mixed Dravidian languages using Pseudo-labelingcited by 6
- 2023Erasure of Unaligned Attributes from Neural Representationscited by 6
- 2024Sentiment-enhanced Graph-based Sarcasm Explanation in Dialoguecited by 6
- 2025Emergence of Hierarchical Emotion Organization in Large Language Modelscited by 6
- 2021On the Impact of Word Error Rate on Acoustic-Linguistic Speech Emotion Recognition: An Update for the Deep Learning Eracited by 5
- 2021Improving Social Meaning Detection with Pragmatic Masking and Surrogate Fine-Tuningcited by 5
- 2021From Theories on Styles to their Transfer in Text: Bridging the Gap with a Hierarchical Surveycited by 5
- 2022A Federated Approach to Predicting Emojis in Hindi Tweetscited by 5
- 2021Embodying Pre-Trained Word Embeddings Through Robot Actionscited by 4
- 2021Nora: The Well-Being Coachcited by 4
- 2021Transfer-based adaptive tree for multimodal sentiment analysis based on user latent aspectscited by 4
- 2021DYPLODOC: Dynamic Plots for Document Classificationcited by 4
50 most cited of 117 All 117 (JSON)
- 2026Unveiling the Limits of Large Language Models in Inferring Pragmatic Meaning from Non-Verbal Responses1 Jun 2026
- 2026A Hormone-inspired Emotion Layer for Transformer language models (HELT)13 Apr 2026
- 2026Toward Clinically Ready Foundation Models in Medical Image Analysis: Adaptation Mechanisms and Deployment Trade-offs15 Mar 2026
- 2026Obliviator Reveals the Cost of Nonlinear Guardedness in Concept Erasure8 Mar 2026
- 2025Classification of Hope in Textual Data using Transformer-Based Models17 Nov 2025
- 2025Adaptation of Foundation Models for Medical Image Analysis: Strategies, Challenges, and Future Directions3 Nov 2025
- 2025RedNote-Vibe: A Dataset for Capturing Temporal Dynamics of AI-Generated Text in Lifestyle Social Media26 Sep 2025
- 2025From Joy to Fear: A Benchmark of Emotion Estimation in Pop Song Lyrics6 Sep 2025
- 2025Nonlinear Concept Erasure: a Density Matching Approach16 Jul 2025
- 2025Emergence of Hierarchical Emotion Organization in Large Language Models12 Jul 2025
- 2025The Hidden Language of Harm: Examining the Role of Emojis in Harmful Online Communication and Content Moderation31 May 2025
- 2025Emotional Analysis of Fashion Trends Using Social Media and AI: Sentiment Analysis on Twitter for Fashion Trend Forecasting30 Apr 2025
38 more
- 2025Deep Fair Learning: Task-Aware Fair Representations via Joint Distance-Covariance Regularization8 Apr 2025
- 2025Fair Text Classification via Transferable Representations10 Mar 2025
- 2025Target-Augmented Shared Fusion-based Multimodal Sarcasm Explanation Generation11 Feb 2025
- 2024The Emotional Spectrum of LLMs: Leveraging Empathy and Emotion-Based Markers for Mental Health Support28 Dec 2024
- 2024Evaluating LLMs Capabilities Towards Understanding Social Dynamics20 Nov 2024
- 2024On-Device Emoji Classifier Trained with GPT-based Data Augmentation for a Mobile Keyboard6 Nov 2024
- 2024Unleashing the Power of Emojis in Texts via Self-supervised Graph Pre-Training22 Sep 2024
- 2024Semantics Preserving Emoji Recommendation with Large Language Models16 Sep 2024
- 2024Modelling Visual Semantics via Image Captioning to extract Enhanced Multi-Level Cross-Modal Semantic Incongruity Representation with Attention for Multimodal Sarcasm Detection5 Aug 2024
- 2024Balancing the Scales: Reinforcement Learning for Fair Classification15 Jul 2024
- 2024Evaluating the Effectiveness of the Foundational Models for Q&A Classification in Mental Health care23 Jun 2024
- 2024Posts of Peril: Detecting Information About Hazards in Text28 May 2024
- 2024SoftMCL: Soft Momentum Contrastive Learning for Fine-grained Sentiment-aware Pre-training3 May 2024
- 2024From Adoption to Adaption: Tracing the Diffusion of New Emojis on Twitter22 Feb 2024
- 2024Emoji Driven Crypto Assets Market Reactions16 Feb 2024
- 2024Sentiment-enhanced Graph-based Sarcasm Explanation in Dialogue6 Feb 2024
- 2024Emojis Decoded: Leveraging ChatGPT for Enhanced Understanding in Social Media Communications22 Jan 2024
- 2023emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representation23 Dec 2023
- 2023Deep Emotions Across Languages: A Novel Approach for Sentiment Propagation in Multilingual WordNets7 Dec 2023
- 2023A Survey on Online User Aggression: Content Detection and Behavioral Analysis on Social Media15 Nov 2023
- 2023ExpNote: Black-box Large Language Models are Better Task Solvers with Experience Notebook13 Nov 2023
- 2023Apollo: Zero-shot MultiModal Reasoning with Multiple Experts25 Oct 2023
- 2023The Skipped Beat: A Study of Sociopragmatic Understanding in LLMs for 64 Languages23 Oct 2023
- 2023Boosting Fair Classifier Generalization through Adaptive Priority Reweighing15 Sep 2023
- 2023Where are We in Event-centric Emotion Analysis? Bridging Emotion Role Labeling and Appraisal-based Approaches5 Sep 2023
- 2023Emotion Embeddings unicodex2014 Learning Stable and Homogeneous Abstractions from Heterogeneous Affective Datasets15 Aug 2023
- 2023Emoji Prediction in Tweets using BERT5 Jul 2023
- 2023Multi-source Semantic Graph-based Multimodal Sarcasm Explanation Generation29 Jun 2023
- 2023Efficient Online Processing with Deep Neural Networks23 Jun 2023
- 2023ShuttleSet: A Human-Annotated Stroke-Level Singles Dataset for Badminton Tactical Analysis8 Jun 2023
- 2023Shielded Representations: Protecting Sensitive Attributes Through Iterative Gradient-Based Projection17 May 2023
- 2023Stop Uploading Test Data in Plain Text: Practical Strategies for Mitigating Data Contamination by Evaluation Benchmarks17 May 2023
- 2023A Comprehensive Survey on Affective Computing; Challenges, Trends, Applications, and Future Directions8 May 2023
- 2023"When Words Fail, Emojis Prevail": Generating Sarcastic Utterances with Emoji Using Valence Reversal and Semantic Incongruity6 May 2023
- 2023LEIA: Linguistic Embeddings for the Identification of Affect21 Apr 2023
- 2023Researchers eye-view of sarcasm detection in social media textual content17 Apr 2023
- 2023Erasure of Unaligned Attributes from Neural Representations6 Feb 2023
- 2023StockEmotions: Discover Investor Emotions for Financial Sentiment Analysis and Multivariate Time Series23 Jan 2023
50 newest of 117 All 117 (JSON)
- 2023Apollo: Zero-shot MultiModal Reasoning with Multiple Experts25 Oct 2023
- 2021IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoningcited by 262
- 2023emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representationcited by 196
- 2023Stop Uploading Test Data in Plain Text: Practical Strategies for Mitigating Data Contamination by Evaluation Benchmarkscited by 139
- 2021Hatemoji: A Test Suite and Adversarially-Generated Dataset for Benchmarking and Detecting Emoji-based Hatecited by 50
- 2021Diverse Adversaries for Mitigating Bias in Trainingcited by 48
- 2022Dimensional Modeling of Emotions in Text with Appraisal Theories: Corpus Creation, Annotation Reliability, and Predictioncited by 45
- 2021SpanEmo: Casting Multi-label Emotion Classification as Span-predictioncited by 37
- 2021Balancing out Bias: Achieving Fairness Through Balanced Trainingcited by 34
- 2021Contrastive Learning for Fair Representationscited by 34
- 2022Gold Doesn't Always Glitter: Spectral Removal of Linear and Nonlinear Guarded Attribute Informationcited by 33
- 2021Refining Language Models with Compositional Explanationscited by 27
- 2022Towards Multi-Modal Sarcasm Detection via Hierarchical Congruity Modeling with Knowledge Enhancementcited by 26
12 most cited of 114 All 114 (JSON)
- 2026Unveiling the Limits of Large Language Models in Inferring Pragmatic Meaning from Non-Verbal Responses1 Jun 2026
- 2026A Hormone-inspired Emotion Layer for Transformer language models (HELT)13 Apr 2026
- 2026Toward Clinically Ready Foundation Models in Medical Image Analysis: Adaptation Mechanisms and Deployment Trade-offs15 Mar 2026
- 2026Obliviator Reveals the Cost of Nonlinear Guardedness in Concept Erasure8 Mar 2026
- 2025Classification of Hope in Textual Data using Transformer-Based Models17 Nov 2025
- 2025Adaptation of Foundation Models for Medical Image Analysis: Strategies, Challenges, and Future Directions3 Nov 2025
- 2025RedNote-Vibe: A Dataset for Capturing Temporal Dynamics of AI-Generated Text in Lifestyle Social Media26 Sep 2025
- 2025From Joy to Fear: A Benchmark of Emotion Estimation in Pop Song Lyrics6 Sep 2025
- 2025Nonlinear Concept Erasure: a Density Matching Approach16 Jul 2025
- 2025Emergence of Hierarchical Emotion Organization in Large Language Models12 Jul 2025
- 2025The Hidden Language of Harm: Examining the Role of Emojis in Harmful Online Communication and Content Moderation31 May 2025
- 2025Emotional Analysis of Fashion Trends Using Social Media and AI: Sentiment Analysis on Twitter for Fashion Trend Forecasting30 Apr 2025
12 newest of 114 All 114 (JSON)