Write a Blog >>
ICSE 2020
Wed 24 June - Thu 16 July 2020
Tue 7 Jul 2020 15:36 - 15:48 at Baekje - A1-Autonomous Driving Systems Chair(s): Donghwan Shin

Black-box testing has been extensively applied to test models of Cyber-Physical systems (CPS) since these models are not often amenable to static and symbolic testing and verification. Black-box testing, however, requires to execute the model under test for a large number of candidate test inputs. This poses a challenge for a large and practically-important category of CPS models, known as compute-intensive CPS (CI-CPS) models, where a single simulation may take hours to complete. We propose a novel approach, namely ARIsTEO, to enable effective and efficient testing of CI-CPS models. Our approach embeds black-box testing into an iterative approximation-refinement loop. At the start, some sampled inputs and outputs of the CI-CPS model under test are used to generate a surrogate model that is faster to execute and can be subjected to black-box testing. Any failure-revealing test identified for the surrogate model is checked on the original model. If spurious, the test results are used to refine the surrogate model to be tested again. Otherwise, the test reveals a valid failure. We evaluated ARIsTEO by comparing it with S-Taliro, an open-source and industry-strength tool for testing CPS models. Our results, obtained based on five publicly-available CPS models, show that, on average, ARIsTEO is able to find 24% more requirements violations than S-Taliro and is 31% faster than S-Taliro in finding those violations. We further assessed the effectiveness and efficiency of ARIsTEO on a large industrial case study from the satellite domain. In contrast to S-Taliro, ARIsTEO successfully tested two different versions of this model and could identify three requirements violations, requiring four hours, on average, for each violation.

Tue 7 Jul
Times are displayed in time zone: (UTC) Coordinated Universal Time change

15:00 - 16:00: Paper Presentations - A1-Autonomous Driving Systems at Baekje
Chair(s): Donghwan ShinUniversity of Luxembourg (SnT)
icse-2020-papers15:00 - 15:12
Shafiul Azam ChowdhuryUniversity of Texas at Arlington, Sohil Lal ShresthaThe University of Texas at Arlington, Taylor T JohnsonVanderbilt University, Christoph CsallnerUniversity of Texas at Arlington
Link to publication DOI Media Attached
icse-2020-papers15:12 - 15:24
Husheng ZhouThe University of Texas at Dallas, Wei LiSouthern University of Science and Technology, Zelun KongThe University of Texas at Dallas, Junfeng GuoThe University of Texas at Dallas, Yuqun ZhangSouthern University of Science and Technology, Lingming ZhangThe University of Texas at Dallas, Bei YuThe Chinese University of Hong Kong, Cong LiuUT Dallas
icse-2020-papers15:24 - 15:36
Andrea StoccoUniversità della Svizzera italiana, Michael WeissUniversità della Svizzera Italiana (USI), Marco CalzanaUniversità della Svizzera Italiana (USI), Paolo TonellaUniversità della Svizzera italiana
icse-2020-papers15:36 - 15:48
Claudio MenghiUniversity of Luxembourg, Shiva NejatiUniversity of Ottawa, Lionel BriandSnT Centre/University of Luxembourg, Yago Isasi ParacheLuxSpace
icse-2020-papers15:48 - 16:00
Joshua GarciaUniversity of California, Irvine, Yang FengNanjing University, Junjie ShenUniversity of California, Irvine, Sumaya AlmaneeUniversity of California, Irvine, Yuan XiaUniversity of California, Irvine, Qi Alfred ChenUniversity of California, Irvine