Zero-shot Bilingual App Reviews Mining with Large Language Models
Not on the map. Why?
Abstract (arXiv)
App reviews from app stores are crucial for improving software requirements. A large number of valuable reviews are continually being posted, describing software problems and expected features. Effectively utilizing user reviews necessitates the extraction of relevant information, as well as their subsequent summarization. Due to the substantial volume of user reviews, manual analysis is arduous. Various approaches based on natural language processing (NLP) have been proposed for automatic user review mining. However, the majority of them requires a manually crafted dataset to train their models, which limits their usage in real-world scenarios. In this work, we propose Mini-BAR, a tool that integrates large language models (LLMs) to perform zero-shot mining of user reviews in both English and French. Specifically, Mini-BAR is designed to (i) classify the user reviews, (ii) cluster similar reviews together, (iii) generate an abstractive summary for each cluster and (iv) rank the user review clusters. To evaluate the performance of Mini-BAR, we created a dataset containing 6,000 English and 6,000 French annotated user reviews and conducted extensive experiments. Preliminary results demonstrate the effectiveness and efficiency of Mini-BAR in requirement engineering by analyzing bilingual app reviews. (Replication package containing the code, dataset, and experiment setups on https://github.com/Jl-wei/mini-bar )
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 17 of its 34 references that are in the map. First posted on arXiv 6 Nov 2023.
Builds on
17 of 34 references.
References · 17
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2023A Survey of Large Language Modelscited by 2,576
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
- 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,253
- 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 981
- 2020SummEval: Re-evaluating Summarization Evaluationcited by 674
- 2019CamemBERT: a Tasty French Language Modelcited by 368
- 2022One Embedder, Any Task: Instruction-Finetuned Text Embeddingscited by 333
- 2019Classifying Multilingual User Feedback using Traditional Machine Learning and Deep Learningcited by 10
5 more
- 2022Where is Your App Frustrating Users?cited by 5
- 2021Unsupervised Topic Discovery in User Commentscited by 4
- 2022Listening to Users' Voice: Automatic Summarization of Helpful App Reviewscited by 4
- 2021Transfer Learning for Mining Feature Requests and Bug Reports from Tweets and App Store Reviewscited by 2
- 2022Towards a Data-Driven Requirements Engineering Approach: Automatic Analysis of User Reviewscited by 2
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 1.
3 papers.