Characterizing and Classifying Developer Forum Posts with their Intentions
Not on the map. Why?
Abstract (arXiv)
With the rapid growth of the developer community, the amount of posts on online technical forums has been growing rapidly, which poses difficulties for users to filter useful posts and find important information. Tags provide a concise feature dimension for users to locate their interested posts and for search engines to index the most relevant posts according to the queries. However, most tags are only focused on the technical perspective (e.g., program language, platform, tool). In most cases, forum posts in online developer communities reveal the author's intentions to solve a problem, ask for advice, share information, etc. The modeling of the intentions of posts can provide an extra dimension to the current tag taxonomy. By referencing previous studies and learning from industrial perspectives, we create a refined taxonomy for the intentions of technical forum posts. Through manual labeling and analysis on a sampled post dataset extracted from online forums, we understand the relevance between the constitution of posts (code, error messages) and their intentions. Furthermore, inspired by our manual study, we design a pre-trained transformer-based model to automatically predict post intentions. The best variant of our intention prediction framework, which achieves a Micro F1-score of 0.589, Top 1-3 accuracy of 62.6% to 87.8%, and an average AUC of 0.787, outperforms the state-of-the-art baseline approach. Our characterization and automated classification of forum posts regarding their intentions may help forum maintainers or third-party tool developers improve the organization and retrieval of posts on technical forums. We have released our annotated dataset and codes in our supplementary material package.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 19 of its 59 references that are in the map. First posted on arXiv 21 Dec 2023.
Builds on
19 of 59 references.
References · 19
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
- 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,218
- 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,310
- 2019Is BERT Really Robust? A Strong Baseline for Natural Language Attack on Text Classification and Entailmentcited by 671
- 2021CoSQA: 20,000+ Web Queries for Code Search and Question Answeringcited by 75
- 2019Understanding the Behaviors of BERT in Rankingcited by 49
7 more
- 2021Applying CodeBERT for Automated Program Repair of Java Simple Bugscited by 44
- 2020Code and Named Entity Recognition in StackOverflowcited by 39
- 2022PTM4Tag: Sharpening Tag Recommendation of Stack Overflow Posts with Pre-trained Modelscited by 16
- 2021On the validity of pre-trained transformers for natural language processing in the software engineering domaincited by 11
- 2022Aspect-Based API Review Classification: How Far Can Pre-Trained Transformer Model Go?cited by 4
- 2019DeepTagRec: A Content-cum-User based Tag Recommendation Framework for Stack Overflowcited by 3
- 2021Characterization and Prediction of Questions without Accepted Answers on Stack Overflowcited by 2
Built on by
Citing papers per year: 2025: 1.
1 paper.