A Benchmark Study on Sentiment Analysis for Software Engineering Research
Not on the map. Why?
Abstract (arXiv)
A recent research trend has emerged to identify developers' emotions, by applying sentiment analysis to the content of communication traces left in collaborative development environments. Trying to overcome the limitations posed by using off-the-shelf sentiment analysis tools, researchers recently started to develop their own tools for the software engineering domain. In this paper, we report a benchmark study to assess the performance and reliability of three sentiment analysis tools specifically customized for software engineering. Furthermore, we offer a reflection on the open challenges, as they emerge from a qualitative analysis of misclassified texts.
Key facts. Cited by 14 papers in the map (data through 13 Oct 2026). First posted on arXiv 17 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 3; 2023: 2; 2024: 0; 2025: 1; 2026: 1.
14 papers.
Sort:
- 2022A Comprehensive Empirical Study of Bias Mitigation Methods for Machine Learning Classifierscited by 30
- 2021Seeking Common but Distinguishing Difference, A Joint Aspect-based Sentiment Analysis Modelcited by 13
- 2021On the validity of pre-trained transformers for natural language processing in the software engineering domaincited by 11
- 2021BERT-Based Sentiment Analysis: A Software Engineering Perspectivecited by 9
- 2022Automated Identification of Toxic Code Reviews Using ToxiCRcited by 8
- 2021Evaluating Pre-Trained Models for User Feedback Analysis in Software Engineering: A Study on Classification of App-Reviewscited by 7
- 2023Deep Learning-based Sentiment Classification: A Comparative Surveycited by 4
- 2021An Empirical Study of the Effectiveness of an Ensemble of Stand-alone Sentiment Detection Tools for Software Engineering Datasetscited by 3
- 2021TOUR: Dynamic Topic and Sentiment Analysis of User Reviews for Assisting App Releasecited by 2
- 2021Polarity in the Classroom: A Case Study Leveraging Peer Sentiment Toward Scalable Assessmentcited by 0
- 2022Do Not Take It for Granted: Comparing Open-Source Libraries for Software Development Effort Estimationcited by 0
- 2023Less, but Stronger: On the Value of Strong Heuristics in Semi-supervised Learning for Software Analyticscited by 0
- 2026Sentiment analysis for software engineering: How far can zero-shot learning (ZSL) go?15 Apr 2026
- 2025Sentiment Analysis in Software Engineering: Evaluating Generative Pre-trained Transformers22 Apr 2025
- 2023Deep Learning-based Sentiment Classification: A Comparative Survey12 Dec 2023
- 2023Less, but Stronger: On the Value of Strong Heuristics in Semi-supervised Learning for Software Analytics3 Feb 2023
- 2022A Comprehensive Empirical Study of Bias Mitigation Methods for Machine Learning Classifiers7 Jul 2022
- 2022Do Not Take It for Granted: Comparing Open-Source Libraries for Software Development Effort Estimation4 Jul 2022
- 2022Automated Identification of Toxic Code Reviews Using ToxiCR26 Feb 2022
- 2021Seeking Common but Distinguishing Difference, A Joint Aspect-based Sentiment Analysis Model18 Nov 2021
- 2021An Empirical Study of the Effectiveness of an Ensemble of Stand-alone Sentiment Detection Tools for Software Engineering Datasets4 Nov 2021
- 2021On the validity of pre-trained transformers for natural language processing in the software engineering domain10 Sep 2021
- 2021Polarity in the Classroom: A Case Study Leveraging Peer Sentiment Toward Scalable Assessment2 Aug 2021
- 2021BERT-Based Sentiment Analysis: A Software Engineering Perspective4 Jun 2021
- 2022A Comprehensive Empirical Study of Bias Mitigation Methods for Machine Learning Classifierscited by 30
- 2021Seeking Common but Distinguishing Difference, A Joint Aspect-based Sentiment Analysis Modelcited by 13
- 2021On the validity of pre-trained transformers for natural language processing in the software engineering domaincited by 11
- 2021BERT-Based Sentiment Analysis: A Software Engineering Perspectivecited by 9
- 2022Automated Identification of Toxic Code Reviews Using ToxiCRcited by 8
- 2021Evaluating Pre-Trained Models for User Feedback Analysis in Software Engineering: A Study on Classification of App-Reviewscited by 7
- 2023Deep Learning-based Sentiment Classification: A Comparative Surveycited by 4
- 2021An Empirical Study of the Effectiveness of an Ensemble of Stand-alone Sentiment Detection Tools for Software Engineering Datasetscited by 3
- 2021TOUR: Dynamic Topic and Sentiment Analysis of User Reviews for Assisting App Releasecited by 2
- 2021Polarity in the Classroom: A Case Study Leveraging Peer Sentiment Toward Scalable Assessmentcited by 0
- 2022Do Not Take It for Granted: Comparing Open-Source Libraries for Software Development Effort Estimationcited by 0
- 2023Less, but Stronger: On the Value of Strong Heuristics in Semi-supervised Learning for Software Analyticscited by 0
12 most cited of 14 All 14 (JSON)
- 2026Sentiment analysis for software engineering: How far can zero-shot learning (ZSL) go?15 Apr 2026
- 2025Sentiment Analysis in Software Engineering: Evaluating Generative Pre-trained Transformers22 Apr 2025
- 2023Deep Learning-based Sentiment Classification: A Comparative Survey12 Dec 2023
- 2023Less, but Stronger: On the Value of Strong Heuristics in Semi-supervised Learning for Software Analytics3 Feb 2023
- 2022A Comprehensive Empirical Study of Bias Mitigation Methods for Machine Learning Classifiers7 Jul 2022
- 2022Do Not Take It for Granted: Comparing Open-Source Libraries for Software Development Effort Estimation4 Jul 2022
- 2022Automated Identification of Toxic Code Reviews Using ToxiCR26 Feb 2022
- 2021Seeking Common but Distinguishing Difference, A Joint Aspect-based Sentiment Analysis Model18 Nov 2021
- 2021An Empirical Study of the Effectiveness of an Ensemble of Stand-alone Sentiment Detection Tools for Software Engineering Datasets4 Nov 2021
- 2021On the validity of pre-trained transformers for natural language processing in the software engineering domain10 Sep 2021
- 2021Polarity in the Classroom: A Case Study Leveraging Peer Sentiment Toward Scalable Assessment2 Aug 2021
- 2021BERT-Based Sentiment Analysis: A Software Engineering Perspective4 Jun 2021
12 newest of 14 All 14 (JSON)