Automated Issue Assignment: Results and Insights from an Industrial CaseJournal-First
Sat 29 May 2021 07:30 - 07:50 at Blended Sessions Room 4 - 4.5.4. Obtaining Information from Issues and Commits
We automate the process of assigning issue reports to development teams by using data mining approaches and share our experience gained by deploying the resulting system, called IssueTAG, at Softtech. Being a subsidiary of the largest private bank in Turkey, Softtech on average receives 350 issue reports daily from the field, which need to be handled with utmost importance and urgency. IssueTAG has been making all the issue assignments at Softtech since its deployment on Jan 12, 2018. Deploying IssueTAG presented us not only with an unprecedented opportunity to observe the practical effects of automated issue assignment, but also with an opportunity to carry out user studies, both of which (to the best of our knowledge) have not been done before in this context. We first empirically determine the data mining approach to be used in IssueTAG. We then deploy IssueTAG and make a number of valuable observations. First, it is not just about deploying a system for automated issue assignment, but also about designing/changing the assignment process around the system. Second, the accuracy of the assignments does not have to be higher than that of manual assignments in order for the system to be useful. Third, deploying such a system requires the development of additional functionalities, such as creating human-readable explanations for the assignments and detecting deteriorations in assignment accuracies, for both of which we have developed and empirically evaluated different approaches. Last but not least, stakeholders do not necessarily resist change and gradual transition helps build confidence.
Fri 28 MayDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
19:30 - 20:30 | 4.5.4. Obtaining Information from Issues and CommitsJournal-First Papers at Blended Sessions Room 4 +12h Chair(s): Antonia Bertolino CNR-ISTI | ||
19:30 20mPaper | Automated Issue Assignment: Results and Insights from an Industrial CaseJournal-First Journal-First Papers Link to publication DOI Pre-print Media Attached | ||
19:50 20mPaper | On the feasibility of automated prediction of bug and non-bug issuesJournal-First Journal-First Papers Steffen Herbold University of Göttingen, Alexander Trautsch University of Göttingen, Fabian Trautsch University of Göttingen Link to publication DOI Pre-print Media Attached | ||
20:10 20mPaper | Better Data Labelling with EMBLEM (and how that Impacts Defect Prediction)Journal-First Journal-First Papers Huy Tu North Carolina State University, USA, Zhe Yu Rochester Institute of Technology, Tim Menzies North Carolina State University, USA Link to publication DOI Pre-print Media Attached |
Sat 29 MayDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
07:30 - 08:30 | |||
07:30 20mPaper | Automated Issue Assignment: Results and Insights from an Industrial CaseJournal-First Journal-First Papers Link to publication DOI Pre-print Media Attached | ||
07:50 20mPaper | On the feasibility of automated prediction of bug and non-bug issuesJournal-First Journal-First Papers Steffen Herbold University of Göttingen, Alexander Trautsch University of Göttingen, Fabian Trautsch University of Göttingen Link to publication DOI Pre-print Media Attached | ||
08:10 20mPaper | Better Data Labelling with EMBLEM (and how that Impacts Defect Prediction)Journal-First Journal-First Papers Huy Tu North Carolina State University, USA, Zhe Yu Rochester Institute of Technology, Tim Menzies North Carolina State University, USA Link to publication DOI Pre-print Media Attached |