mlsanityData to 14 Oct 2026

Leveraging IndoBERT and DistilBERT for Indonesian Emotion Classification in E-Commerce Reviews

arXiv 2509.14611 ↗First posted 18 Sep 2025cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Understanding emotions in the Indonesian language is essential for improving customer experiences in e-commerce. This study focuses on enhancing the accuracy of emotion classification in Indonesian by leveraging advanced language models, IndoBERT and DistilBERT. A key component of our approach was data processing, specifically data augmentation, which included techniques such as back-translation and synonym replacement. These methods played a significant role in boosting the model's performance. After hyperparameter tuning, IndoBERT achieved an accuracy of 80%, demonstrating the impact of careful data processing. While combining multiple IndoBERT models led to a slight improvement, it did not significantly enhance performance. Our findings indicate that IndoBERT was the most effective model for emotion classification in Indonesian, with data augmentation proving to be a vital factor in achieving high accuracy. Future research should focus on exploring alternative architectures and strategies to improve generalization for Indonesian NLP tasks.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 8 of its 40 references that are in the map. First posted on arXiv 18 Sep 2025.

Builds on

8 of 40 references.

References · 8

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  4. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  5. 2018DialogueRNN: An Attentive RNN for Emotion Detection in Conversationscited by 218
  6. 2020IndoNLU: Benchmark and Resources for Evaluating Indonesian Natural Language Understandingcited by 109
  7. 2020Do RNN and LSTM have Long Memory?cited by 47
  8. 2021SpanEmo: Casting Multi-label Emotion Classification as Span-predictioncited by 37

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.