GIRT-Model: Automated Generation of Issue Report Templates
Not on the map. Why?
Abstract (arXiv)
Platforms such as GitHub and GitLab introduce Issue Report Templates (IRTs) to enable more effective issue management and better alignment with developer expectations. However, these templates are not widely adopted in most repositories, and there is currently no tool available to aid developers in generating them. In this work, we introduce GIRT-Model, an assistant language model that automatically generates IRTs based on the developer's instructions regarding the structure and necessary fields. We create GIRT-Instruct, a dataset comprising pairs of instructions and IRTs, with the IRTs sourced from GitHub repositories. We use GIRT-Instruct to instruction-tune a T5-base model to create the GIRT-Model. In our experiments, GIRT-Model outperforms general language models (T5 and Flan-T5 with different parameter sizes) in IRT generation by achieving significantly higher scores in ROUGE, BLEU, METEOR, and human evaluation. Additionally, we analyze the effectiveness of GIRT-Model in a user study in which participants wrote short IRTs with GIRT-Model. Our results show that the participants find GIRT-Model useful in the automated generation of templates. We hope that through the use of GIRT-Model, we can encourage more developers to adopt IRTs in their repositories. We publicly release our code, dataset, and model at https://github.com/ISE-Research/girt-model.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 24 of its 58 references that are in the map. First posted on arXiv 4 Feb 2024.
Builds on
24 of 58 references.
References · 24
- 2017Attention Is All You Needcited by 59,932
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
- 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
- 2022Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Taskscited by 858
- 2021Cross-Task Generalization via Natural Language Crowdsourcing Instructionscited by 696
- 2023Zephyr: Direct Distillation of LM Alignmentcited by 498
- 2023LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Datasetcited by 449
12 more
- 2023How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resourcescited by 405
- 2022Unnatural Instructions: Tuning Language Models with (Almost) No Human Laborcited by 395
- 2021Generating Datasets with Pretrained Language Modelscited by 192
- 2022Help me write a poem: Instruction Tuning as a Vehicle for Collaborative Poetry Writingcited by 71
- 2020RecipeGPT: Generative Pre-training Based Cooking Recipe Generation and Evaluation Systemcited by 34
- 2020Predicting Visual Importance Across Graphic Design Typescited by 30
- 2023GlotScript: A Resource and Tool for Low Resource Writing System Identificationcited by 15
- 2020Predicting the Objective and Priority of Issue Reports in Software Repositoriescited by 11
- 2021Predicting Issue Types on GitHubcited by 10
- 2022CatIss: An Intelligent Tool for Categorizing Issues Reports using Transformerscited by 5
- 2022iTiger: An Automatic Issue Title Generation Toolcited by 4
- 2023GIRT-Data: Sampling GitHub Issue Report Templatescited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.