Write a Blog >>
ICSE 2020
Wed 24 June - Thu 16 July 2020
Tue 7 Jul 2020 08:35 - 08:47 at Goguryeo - I5-Deep Learning Testing and Debugging Chair(s): Pooyan Jamshidi

The growing application of deep neural networks in safety-critical domains makes the analysis of faults that occur in such systems of enormous importance. In this paper we introduce a large taxonomy of faults in deep learning (DL) systems. We have manually analysed 1059 artefacts gathered from GitHub commits and issues of projects that use the most popular DL frameworks (TensorFlow, Keras and PyTorch) and from related Stack Overflow posts. Structured interviews with 20 researchers and practitioners describing the problems they have encountered in their experience have enriched our taxonomy with a variety of additional faults that did not emerge from the other two sources. Our final taxonomy was validated with a survey involving an additional set of 21 developers, confirming that almost all fault categories (13/15) were experienced by at least 50% of the survey participants.

Tue 7 Jul
Times are displayed in time zone: (UTC) Coordinated Universal Time change

08:05 - 09:05: Paper Presentations - I5-Deep Learning Testing and Debugging at Goguryeo
Chair(s): Pooyan JamshidiUniversity of South Carolina
icse-2020-papers08:05 - 08:17
Huiyan WangState Key Lab. for Novel Software Tech. and Dept. of Comp. Sci. and Tech., Nanjing University, Nanjing, China, Jingwei XuNanjing University, Chang XuNanjing University, Xiaoxing MaNanjing University, Jian LuNanjing University
icse-2020-papers08:17 - 08:29
Peixin ZhangZhejiang University, Jingyi WangNational University of Singapore, Singapore, Jun SunSingapore Management University, Guoliang DongComputer College of Zhejiang University, Xinyu WangZhejiang University, Xingen WangZhejiang University, Jin Song DongNational University of Singapore, Dai TingHuawei Corporation
Demonstrations08:29 - 08:32
Salah GhamiziSntT - University of Luxembourg, Maxime CordySnT, University of Luxembourg, Mike PapadakisUniversity of Luxembourg, Yves Le TraonUniversity of Luxembourg
Demonstrations08:32 - 08:35
Yongqiang TIANThe Hong Kong University of Science and Technology, Zhihua ZengZhejiang University, Ming WenHuazhong University of Science and Technology, China, Yepang LiuSouthern University of Science and Technology, Tzu-yang KuoThe Hong Kong University of Science and Technology, Shing-Chi CheungDepartment of Computer Science and Engineering, The Hong Kong University of Science and Technology
icse-2020-papers08:35 - 08:47
Nargiz HumbatovaUniversità della Svizzera italiana, Gunel JahangirovaUniversità della Svizzera italiana, Gabriele BavotaUniversità della Svizzera italiana, Vincenzo RiccioUniversità della Svizzera italiana, Andrea StoccoUniversità della Svizzera italiana, Paolo TonellaUniversità della Svizzera italiana
icse-2020-papers08:47 - 08:59
Ru ZhangMicrosoft Research, Wencong XiaoAlibaba, Hongyu ZhangUniversity of Newcastle, Australia, Yu LiuMicrosoft Research, Haoxiang LinMicrosoft Research, Mao YangMicrosoft Research