Stack Trace-Based Crash Deduplication with Transformer Adaptation
Not on the map. Why?
Abstract (arXiv)
Automated crash reporting systems generate large volumes of duplicate reports, overwhelming issue-tracking systems and increasing developer workload. Traditional stack trace-based deduplication methods---relying on string similarity, rule-based heuristics, or deep learning (DL) models---often fail to capture the contextual and structural relationships within stack traces. We propose dedupT, a transformer-based approach that models stack traces holistically rather than as isolated frames. dedupT first adapts a pretrained language model (PLM) to stack traces, then uses its embeddings to train a fully-connected network (FCN) to rank duplicate crashes effectively. Extensive experiments on real-world datasets show that dedupT outperforms existing DL and traditional methods (e.g., sequence alignment and information retrieval techniques) in both duplicate ranking and unique crash detection, significantly reducing manual triage effort. On four public datasets, dedupT improves Mean Reciprocal Rank (MRR) often by over 15% compared to the best DL baseline and up to 10% over traditional methods while achieving higher Receiver Operating Characteristic Area Under the Curve (ROC-AUC) in detecting unique crash reports. Our work advances the integration of modern natural language processing (NLP) techniques into software engineering, providing an effective solution for stack trace-based crash deduplication.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 57 references that are in the map. First posted on arXiv 26 Aug 2025.
Builds on
25 of 57 references.
References · 25
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2018Deep contextualized word representationscited by 2,290
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,989
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,605
13 more
- 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,310
- 2023C-Pack: Packed Resources For General Chinese Embeddingscited by 578
- 2024The Faiss librarycited by 376
- 2023Large Language Models for Information Retrieval: A Surveycited by 331
- 2017Efficient Natural Language Response Suggestion for Smart Replycited by 229
- 2019A Comparative Study on Transformer vs RNN in Speech Applicationscited by 211
- 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Aheadcited by 155
- 2022Pretrained Language Models for Text Generation: A Surveycited by 122
- 2018Approximate Nearest Neighbor Search in High Dimensionscited by 47
- 2020TraceSim: A Method for Calculating Stack Trace Similaritycited by 5
- 2021S3M: Siamese Stack (Trace) Similarity Measurecited by 3
- 2023DeepLSH: Deep Locality-Sensitive Hash Learning for Fast and Efficient Near-Duplicate Crash Report Detectioncited by 3
- 2024Stack Trace Deduplication: Faster, More Accurately, and in More Realistic Scenarioscited by 1
Built on by
Not cited yet.