Write a Blog >>
ICSE 2020
Wed 24 June - Thu 16 July 2020
Tue 7 Jul 2020 08:05 - 08:17 at Goguryeo - I5-Deep Learning Testing and Debugging Chair(s): Pooyan Jamshidi

Deep learning (DL) applications are becoming increasingly popular. Their reliabilities largely depend on the performance of DL models integrated in these applications. Traditional techniques need to retrain the models or rebuild and redeploy the applications for coping with unexpected conditions beyond the models’ handling capabilities. In this paper, we take a fault tolerance approach, DISSECTOR, to distinguishing those inputs that represent unexpected conditions (beyond-inputs) from normal inputs that are still within the models’ handling capabilities (within-inputs), thus keeping the applications still function with expected reliabilities. The key insight of DISSECTOR is that a DL model should interpret a within-input with increasing confidence, while a beyond-input would probably cause confused guesses in the prediction process. DISSECTOR works in an application-specific way, adaptive to DL models used in applications, and extremely efficiently, scalable to large-size datasets from complex scenarios. The experimental evaluation shows that DISSECTOR outperformed state-of-the-art techniques in the effectiveness (AUC: avg. 0.8935 and up to 0.9894) and efficiency (runtime overhead: only 3.3–5.8 milliseconds). Besides, it also exhibited encouraging usefulness in defensing against adversarial inputs (AUC: avg. 0.9983) and improving a DL model’s actual accuracy in use (up to 16% for CIFAR-100 and 20% for ImageNet).

Tue 7 Jul
Times are displayed in time zone: (UTC) Coordinated Universal Time change

08:05 - 09:05: Paper Presentations - I5-Deep Learning Testing and Debugging at Goguryeo
Chair(s): Pooyan JamshidiUniversity of South Carolina
icse-2020-papers08:05 - 08:17
Huiyan WangState Key Lab. for Novel Software Tech. and Dept. of Comp. Sci. and Tech., Nanjing University, Nanjing, China, Jingwei XuNanjing University, Chang XuNanjing University, Xiaoxing MaNanjing University, Jian LuNanjing University
icse-2020-papers08:17 - 08:29
Peixin ZhangZhejiang University, Jingyi WangNational University of Singapore, Singapore, Jun SunSingapore Management University, Guoliang DongComputer College of Zhejiang University, Xinyu WangZhejiang University, Xingen WangZhejiang University, Jin Song DongNational University of Singapore, Dai TingHuawei Corporation
Demonstrations08:29 - 08:32
Salah GhamiziSntT - University of Luxembourg, Maxime CordySnT, University of Luxembourg, Mike PapadakisUniversity of Luxembourg, Yves Le TraonUniversity of Luxembourg
Demonstrations08:32 - 08:35
Yongqiang TIANThe Hong Kong University of Science and Technology, Zhihua ZengZhejiang University, Ming WenHuazhong University of Science and Technology, China, Yepang LiuSouthern University of Science and Technology, Tzu-yang KuoThe Hong Kong University of Science and Technology, Shing-Chi CheungDepartment of Computer Science and Engineering, The Hong Kong University of Science and Technology
icse-2020-papers08:35 - 08:47
Nargiz HumbatovaUniversità della Svizzera italiana, Gunel JahangirovaUniversità della Svizzera italiana, Gabriele BavotaUniversità della Svizzera italiana, Vincenzo RiccioUniversità della Svizzera italiana, Andrea StoccoUniversità della Svizzera italiana, Paolo TonellaUniversità della Svizzera italiana
icse-2020-papers08:47 - 08:59
Ru ZhangMicrosoft Research, Wencong XiaoAlibaba, Hongyu ZhangUniversity of Newcastle, Australia, Yu LiuMicrosoft Research, Haoxiang LinMicrosoft Research, Mao YangMicrosoft Research