On the feasibility of automated prediction of bug and non-bug issuesJournal-First
Sat 29 May 2021 07:50 - 08:10 at Blended Sessions Room 4 - 4.5.4. Obtaining Information from Issues and Commits
Context: Issue tracking systems are used to track and describe tasks in the development process, e.g., requested feature improvements or reported bugs. However, past research has shown that the reported issue types often do not match the description of the issue. Objective: We want to understand the overall maturity of the state of the art of issue type prediction with the goal to predict if issues are bugs and evaluate if we can improve existing models by incorporating manually specified knowledge about issues. Method: We train different models for the title and description of the issue to account for the difference in structure between these fields, e.g., the length. Moreover, we manually detect issues whose description contains a null pointer exception, as these are strong indicators that issues are bugs. Results: Our approach performs best overall, but not significantly different from an approach from the literature based on the fastText classifier from Facebook AI Research. The small improvements in prediction performance are due to structural information about the issues we used. We found that using information about the content of issues in form of null pointer exceptions is not useful. We demonstrate the usefulness of issue type prediction through the example of labelling bugfixing commits. Conclusions: Issue type prediction can be a useful tool if the use case allows either for a certain amount of missed bug reports or the prediction of too many issues as bug is acceptable.
Fri 28 MayDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
19:30 - 20:30 | 4.5.4. Obtaining Information from Issues and CommitsJournal-First Papers at Blended Sessions Room 4 +12h Chair(s): Antonia Bertolino CNR-ISTI | ||
19:30 20mPaper | Automated Issue Assignment: Results and Insights from an Industrial CaseJournal-First Journal-First Papers Link to publication DOI Pre-print Media Attached | ||
19:50 20mPaper | On the feasibility of automated prediction of bug and non-bug issuesJournal-First Journal-First Papers Steffen Herbold University of Göttingen, Alexander Trautsch University of Göttingen, Fabian Trautsch University of Göttingen Link to publication DOI Pre-print Media Attached | ||
20:10 20mPaper | Better Data Labelling with EMBLEM (and how that Impacts Defect Prediction)Journal-First Journal-First Papers Huy Tu North Carolina State University, USA, Zhe Yu Rochester Institute of Technology, Tim Menzies North Carolina State University, USA Link to publication DOI Pre-print Media Attached |
Sat 29 MayDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
07:30 - 08:30 | |||
07:30 20mPaper | Automated Issue Assignment: Results and Insights from an Industrial CaseJournal-First Journal-First Papers Link to publication DOI Pre-print Media Attached | ||
07:50 20mPaper | On the feasibility of automated prediction of bug and non-bug issuesJournal-First Journal-First Papers Steffen Herbold University of Göttingen, Alexander Trautsch University of Göttingen, Fabian Trautsch University of Göttingen Link to publication DOI Pre-print Media Attached | ||
08:10 20mPaper | Better Data Labelling with EMBLEM (and how that Impacts Defect Prediction)Journal-First Journal-First Papers Huy Tu North Carolina State University, USA, Zhe Yu Rochester Institute of Technology, Tim Menzies North Carolina State University, USA Link to publication DOI Pre-print Media Attached |