Primers or Reminders? The Effects of Existing Review Comments on Code ReviewTechnical
In contemporary code review, the comments put by reviewers on a specific code change are immediately visible to the other reviewers involved. May this visibility prime new reviewers’ attention (due to the human’s proneness to availability bias), thus biasing the code review outcome? In this study, we investigate this topic by conducting a controlled experiment with 85 developers who perform a code review and a psychological experiment. Although ~70% of participants are assessed to be prone to availability bias, we did not observe a biasing effect due to the existing review comments. Only when reviewers are primed by a comment on a bug that normally is not considered in code review, they are more likely to find another occurrence of this type of bug. Moreover, this priming effect does not influence reviewers’ likelihood of detecting other types of bugs. Our findings suggest that the current code review practice is effective because existing review comments about bugs in code changes are not negative primers, rather positive reminders for bugs that would otherwise be overlooked during code review.
Wed 8 JulDisplayed time zone: (UTC) Coordinated Universal Time change
16:05 - 17:05 | A10-Human Aspects 2Journal First / Technical Papers at Baekje Chair(s): Giuseppe Scanniello University of Basilicata | ||
16:05 8mTalk | Characterizing and Identifying Reverted CommitsJ1 Journal First Meng Yan Chongqing University, Xin Xia Monash University, David Lo Singapore Management University, Ahmed E. Hassan Queen's University, Shanping Li Zhejiang University | ||
16:13 8mTalk | An Empirical Study of Obsolete Answers on Stack OverflowJ1 Journal First Haoxiang Zhang Software Analysis and Intelligence Lab (SAIL), Queen’s University, Kingston, Ontario, Canada, Shaowei Wang Mississippi State University, Tse-Hsun (Peter) Chen Concordia University, Ying Zou Queen's University, Kingston, Ontario, Ahmed E. Hassan Queen's University | ||
16:21 8mTalk | An Empirical Characterization of Bad Practices in Continuous IntegrationJ1 Journal First Fiorella Zampetti University of Sannio, Carmine Vassallo University of Zurich, Sebastiano Panichella Zurich University of Applied Sciences, Gerardo Canfora University of Sannio, Harald Gall University of Zurich, Massimiliano Di Penta University of Sannio Link to publication DOI Pre-print | ||
16:29 8mTalk | To the Attention of Mobile Software Developers: Guess What, Test your App!J1 Journal First Luís Cruz Deflt University of Technology, Rui Abreu Instituto Superior Técnico, U. Lisboa & INESC-ID, David Lo Singapore Management University DOI Pre-print Media Attached | ||
16:37 12mTalk | Primers or Reminders? The Effects of Existing Review Comments on Code ReviewTechnical Technical Papers Davide Spadini Delft University of Technology, Netherlands, Gül Calikli Chalmers | University of Gothenburg, Alberto Bacchelli University of Zurich DOI Pre-print Media Attached |