Leveraging IndoBERT and DistilBERT for Indonesian Emotion Classification in E-Commerce Reviews
Not on the map. Why?
Abstract (arXiv)
Understanding emotions in the Indonesian language is essential for improving customer experiences in e-commerce. This study focuses on enhancing the accuracy of emotion classification in Indonesian by leveraging advanced language models, IndoBERT and DistilBERT. A key component of our approach was data processing, specifically data augmentation, which included techniques such as back-translation and synonym replacement. These methods played a significant role in boosting the model's performance. After hyperparameter tuning, IndoBERT achieved an accuracy of 80%, demonstrating the impact of careful data processing. While combining multiple IndoBERT models led to a slight improvement, it did not significantly enhance performance. Our findings indicate that IndoBERT was the most effective model for emotion classification in Indonesian, with data augmentation proving to be a vital factor in achieving high accuracy. Future research should focus on exploring alternative architectures and strategies to improve generalization for Indonesian NLP tasks.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 8 of its 40 references that are in the map. First posted on arXiv 18 Sep 2025.
Builds on
8 of 40 references.
References · 8
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
- 2018DialogueRNN: An Attentive RNN for Emotion Detection in Conversationscited by 218
- 2020IndoNLU: Benchmark and Resources for Evaluating Indonesian Natural Language Understandingcited by 109
- 2020Do RNN and LSTM have Long Memory?cited by 47
- 2021SpanEmo: Casting Multi-label Emotion Classification as Span-predictioncited by 37
Built on by
Citing papers per year: 2025: 1.
1 paper.