# An Investigation of Transfer Learning-Based Sentiment Analysis in Japanese

arXiv: https://arxiv.org/abs/1905.09642 · HTML: https://mlsanity.com/paper/1905.09642/

## Key facts

- Cited by 7 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 23 May 2019.

## Built on by (most cited first, 7 of 7)

- [Improved Knowledge Distillation for Pre-trained Language Models via Knowledge Selection](https://mlsanity.com/paper/2302.00444/) (2023)
- [Evaluating Pre-Trained Models for User Feedback Analysis in Software Engineering: A Study on Classification of App-Reviews](https://mlsanity.com/paper/2104.05861/) (2021)
- [Zero-shot Sentiment Analysis in Low-Resource Languages Using a Multilingual Sentiment Lexicon](https://mlsanity.com/paper/2402.02113/) (2024)
- [Auto Response Generation in Online Medical Chat Services](https://mlsanity.com/paper/2104.12755/) (2021)
- [Transfer Learning Approach for Detecting Psychological Distress in Brexit Tweets](https://mlsanity.com/paper/2102.00912/) (2021)
- [SASICM A Multi-Task Benchmark For Subtext Recognition](https://mlsanity.com/paper/2106.06944/) (2021)
- [Stress Testing BERT Anaphora Resolution Models for Reaction Extraction in Chemical Patents](https://mlsanity.com/paper/2306.13379/) (2023)

## Abstract (arXiv)

Text classification approaches have usually required task-specific model architectures and huge labeled datasets. Recently, thanks to the rise of text-based transfer learning techniques, it is possible to pre-train a language model in an unsupervised manner and leverage them to perform effective on downstream tasks. In this work we focus on Japanese and show the potential use of transfer learning techniques in text classification. Specifically, we perform binary and multi-class sentiment classification on the Rakuten product review and Yahoo movie review datasets. We show that transfer learning-based approaches perform better than task-specific models trained on 3 times as much data. Furthermore, these approaches perform just as well for language modeling pre-trained on only 1/30 of the data. We release our pre-trained models and code as open source.