mlsanityData to 7 Oct 2026

Exploring Transformers in Emotion Recognition: a comparison of BERT, DistillBERT, RoBERTa, XLNet and ELECTRA

arXiv 2104.02041 ↗First posted 5 Apr 2021cs.CLcited by 10

Not on the map. Why?

Abstract (arXiv)

This paper investigates how Natural Language Understanding (NLU) could be applied in Emotion Recognition, a specific task in affective computing. We finetuned different transformers language models (BERT, DistilBERT, RoBERTa, XLNet, and ELECTRA) using a fine-grained emotion dataset and evaluating them in terms of performance (f1-score) and time to complete.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 6 of its 13 references that are in the map. First posted on arXiv 5 Apr 2021.

Builds on

6 of 13 references.

References · 6

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  5. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
  6. 2020GoEmotions: A Dataset of Fine-Grained Emotionscited by 479

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 5; 2023: 0; 2024: 3; 2025: 1; 2026: 1.

10 papers.

  1. 2024Large Language Models for UAVs: Current State and Pathways to the Futurecited by 33
  2. 2022A Review on Text-Based Emotion Detection -- Techniques, Applications, Datasets, and Future Directionscited by 6
  3. 2022RaFoLa: A Rationale-Annotated Corpus for Detecting Indicators of Forced Labourcited by 5
  4. 2022A Comparative Study of Pre-trained Encoders for Low-Resource Named Entity Recognitioncited by 1
  5. 2024Beyond Simple Averaging: Improving NLP Ensemble Performance with Topological-Data-Analysis-Based Weightingcited by 1
  6. 2022TamilEmo: Finegrained Emotion Detection Dataset for Tamilcited by 0
  7. 2022CEFER: A Four Facets Framework based on Context and Emotion embedded features for Implicit and Explicit Emotion Recognitioncited by 0
  8. 2024Improved Text Emotion Prediction Using Combined Valence and Arousal Ordinal Classificationcited by 0
  9. 2025NepEMO: A Multi-Label Emotion and Sentiment Analysis on Nepali Reddit with Linguistic Insights and Temporal Trendscited by 0
  10. 2026Uncertainty-Aware Multimodal Emotion Recognition through Dirichlet Parameterizationcited by 0