SkillScope: A Tool to Predict Fine-Grained Skills Needed to Solve Issues on GitHub
Not on the map. Why?
Abstract (arXiv)
New contributors often struggle to find tasks that they can tackle when onboarding onto a new Open Source Software (OSS) project. One reason for this difficulty is that issue trackers lack explanations about the knowledge or skills needed to complete a given task successfully. These explanations can be complex and time-consuming to produce. Past research has partially addressed this problem by labeling issues with issue types, issue difficulty level, and issue skills. However, current approaches are limited to a small set of labels and lack in-depth details about their semantics, which may not sufficiently help contributors identify suitable issues. To surmount this limitation, this paper explores large language models (LLMs) and Random Forest (RF) to predict the multilevel skills required to solve the open issues. We introduce a novel tool, SkillScope, which retrieves current issues from Java projects hosted on GitHub and predicts the multilevel programming skills required to resolve these issues. In a case study, we demonstrate that SkillScope could predict 217 multilevel skills for tasks with 91% precision, 88% recall, and 89% F-measure on average. Practitioners can use this tool to better delegate or choose tasks to solve in OSS projects.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 13 of its 23 references that are in the map. First posted on arXiv 27 Jan 2025.
Builds on
13 of 23 references.
References · 13
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2023Can Large Language Models Transform Computational Social Science?cited by 245
- 2023Can ChatGPT Reproduce Human-Generated Labels? A Study of Social Computing Taskscited by 88
- 2018A no-regret generalization of hierarchical softmax to extreme multi-label classificationcited by 52
- 2024Efficacy of Synthetic Data as a Benchmarkcited by 29
- 2022Understanding Skills for OSS Communities on GitHubcited by 9
- 2023Does Synthetic Data Make Large Language Models More Efficient?cited by 8
- 2021Can I Solve It? Identifying APIs Required to Complete OSS Taskcited by 7
- 2019A Bug or a Suggestion? An Automatic Way to Label Issuescited by 5
- 2023GiveMeLabeledIssues: An Open Source Issue Recommendation Systemcited by 3
- 2022Attracting and Retaining OSS Contributors with a Maintainer Dashboardcited by 2
1 more
Built on by
Citing papers per year: 2025: 1.
1 paper.