Review Dynamics and Their Impact on Software QualityJournal-First
Wed 26 May 2021 23:20 - 23:40 at Blended Sessions Room 5 - 2.1.5. Code Review: Observational Studies
Code review is a crucial activity for ensuring the quality of software products. Unlike the traditional code review process of the past where reviewers independently examine software artifacts, contemporary code review processes allow teams to collaboratively examine and discuss proposed patches. While the visibility of reviewing activities including review discussions in a contemporary code review tends to increase developer collaboration and openness, little is known whether such visible information influences the evaluation decision of a reviewer or not (i.e., knowing others’ feedback about the patch before providing ones own feedback). Therefore, in this work, we set out to investigate the review dynamics, i.e., a practice of providing a vote to accept a proposed patch, in a code review process. To do so, we first characterize the review dynamics by examining the relationship between the evaluation decision of a reviewer and the visible information about a patch under review (e.g., comments and votes that are provided by prior co-reviewers). We then investigate the association between the characterized review dynamics and the defect-proneness of a patch. Through a case study of 83,750 patches of the OpenStack and Qt projects, we observe that the amount of feedback (either votes and comments of prior reviewers) and the co-working frequency of a reviewer with the patch author are highly associated with the likelihood that the reviewer will provide a positive vote to accept a proposed patch. Furthermore, we find that the proportion of reviewers who provided a vote consistent with prior reviewers is significantly associated with the defect-proneness of a patch. However, the associations of these review dynamics are not as strong as the confounding factors (i.e., patch characteristics and overall reviewing activities). Our observations shed light on the implicit influence of the visible information about a patch under review on the evaluation decision of a reviewer. Our findings suggest that the code reviewing policies that are mindful of these practices may help teams improve code review effectiveness. Nonetheless, such review dynamics should not be too concerning in terms of software quality.
Wed 26 MayDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
23:20 - 00:20 | |||
23:20 20mPaper | Review Dynamics and Their Impact on Software QualityJournal-First Journal-First Papers Patanamon Thongtanunam University of Melbourne, Ahmed E. Hassan School of Computing, Queen's University DOI Pre-print Media Attached | ||
23:40 20mPaper | Code Reviews with Divergent Review Scores: An Empirical Study of the OpenStack and Qt CommunitiesJournal-First Journal-First Papers Toshiki Hirao dTosh Inc.,, Shane McIntosh , Akinori Ihara Wakayama University, Kenichi Matsumoto Nara Institute of Science and Technology DOI Pre-print Media Attached | ||
00:00 20mPaper | A Longitudinal Study of Static Analysis Warning Evolution and the Effects of PMD on Software Quality in Apache Open Source ProjectsJournal-First Journal-First Papers Alexander Trautsch University of Göttingen, Steffen Herbold University of Göttingen, Jens Grabowski University of Göttingen Link to publication DOI Pre-print Media Attached |