Write a Blog >>
ICSE 2020
Wed 24 June - Thu 16 July 2020
Thu 9 Jul 2020 08:25 - 08:33 at Baekje - I16-Testing and Debugging 2 Chair(s): Rui Abreu

Defect models are analytical models for building empirical theories related to software quality. Prior studies often derive knowledge from such models using interpretation techniques, e.g., ANOVA Type-I. Recent work raises concerns that correlated metrics may impact the interpretation of defect models. Yet, the impact of correlated metrics in such models has not been investigated. In this paper, we investigate the impact of correlated metrics on the interpretation of defect models and the improvement of the interpretation of defect models when removing correlated metrics. Through a case study of 14 publicly- available defect datasets, we find that (1) correlated metrics have the largest impact on the consistency, the level of discrepancy, and the direction of the ranking of metrics, especially for ANOVA techniques. On the other hand, we find that removing all correlated metrics (2) improves the consistency of the produced rankings regardless of the ordering of metrics (except for ANOVA Type-I); (3) improves the consistency of ranking of metrics among the studied interpretation techniques; (4) impacts the model performance by less than 5 percentage points. Thus, when one wishes to derive sound interpretation from defect models, one must (1) mitigate correlated metrics especially for ANOVA analyses; and (2) avoid using ANOVA Type-I even if all correlated metrics are removed.

Thu 9 Jul
Times are displayed in time zone: (UTC) Coordinated Universal Time change

08:05 - 09:05: Paper Presentations - I16-Testing and Debugging 2 at Baekje
Chair(s): Rui AbreuInstituto Superior T├ęcnico, U. Lisboa & INESC-ID
icse-2020-papers08:05 - 08:17
Yan CaiInstitute of Software, Chinese Academy of Sciences, Ruijie MengUniversity of Chinese Academy of Sciences, Jens PalsbergUniversity of California, Los Angeles
icse-2020-Journal-First08:17 - 08:25
Masanari KondoKyoto Institute of Technology, Cor-Paul BezemerUniversity of Alberta, Canada, Yasutaka KameiKyushu University, Ahmed E. HassanQueen's University, Osamu MizunoKyoto Institute of Technology
icse-2020-Journal-First08:25 - 08:33
Jirayus JiarpakdeeMonash University, Australia, Chakkrit (Kla) TantithamthavornMonash University, Australia, Ahmed E. HassanQueen's University
icse-2020-Journal-First08:33 - 08:41
Yuanrui FanZhejiang University, Xin XiaMonash University, Daniel Alencar Da CostaUniversity of Otago, David LoSingapore Management University, Ahmed E. HassanQueen's University, Shanping LiZhejiang University
icse-2020-Journal-First08:41 - 08:49
Zhongxin LiuZhejiang University, Xin XiaMonash University, David LoSingapore Management University, Zhenchang XingAustralia National University, Ahmed E. HassanQueen's University, Shanping LiZhejiang University
icse-2020-papers08:49 - 09:01
Ke LiUniversity of Exeter, Zilin XiangUniversity of Electronic Science and Technology of China, Tao ChenLoughborough University, Shuo Wang, Kay Chen TanCity University of Hong Kong