Write a Blog >>
ICSE 2020
Wed 24 June - Thu 16 July 2020
Fri 10 Jul 2020 15:28 - 15:36 at Silla - A21-Testing and Debugging 3 Chair(s): Tingting Yu

Crash reproduction approaches help developers during debugging by generating a test case that reproduces a given crash. Several solutions have been proposed to automate this task. However, the proposed solutions have been evaluated on a limited number of projects, making comparison difficult. In this paper, we enhance this line of research by proposing JCrashPack, an extensible benchmark for Java crash reproduction, together with ExRunner, a tool to simply and systematically run evaluations. JCrashPack contains 200 stack traces from various Java projects, including industrial open-source ones. We used JCrashPack to run an extensive evaluation of EvoCrash, the state-of-the-art tool for search-based crash reproduction. EvoCrash successfully reproduced 43% of the crashes. Furthermore, we observed that reproducing NullPointerException, IllegalArgumentException, and IllegalStateException is relatively easier than reproducing ClassCastException, ArrayIndexOutOfBoundsException, and StringIndexOutOfBoundsException. Our results include a detailed manual analysis of EvoCrash outputs, from which we derive 14 current challenges for crash reproduction, among which the generation of input data and the handling of abstract and anonymous classes are the most frequents. Finally, based on those challenges, we discuss future research directions for search-based crash reproduction for Java.

Fri 10 Jul
Times are displayed in time zone: (UTC) Coordinated Universal Time change

icse-2020-paper-presentations
15:00 - 16:00: Paper Presentations - A21-Testing and Debugging 3 at Silla
Chair(s): Tingting YuUniversity of Kentucky
icse-2020-papers15:00 - 15:12
Talk
Dirk van der LindenUniversity of Bristol, Pauline AnthonysamyGoogle Inc., Bashar NuseibehThe Open University (UK) & Lero (Ireland), Thein Tun, Marian PetreThe Open University, Mark LevineLancaster University, John TowseLancaster University, Awais RashidUniversity of Bristol, UK
icse-2020-Journal-First15:12 - 15:20
Talk
Van-Thuan PhamMonash University, Marcel BöhmeMonash University, Andrew SantosaNational University of Singapore, Alexandru Răzvan CăciulescuUiPath, Abhik RoychoudhuryNational University of Singapore, Singapore
icse-2020-Journal-First15:20 - 15:28
Talk
Xuan HuoNanjing University, Ferdian ThungSingapore Management University, Ming LiNanjing University, David LoSingapore Management University, Shu-Ting ShiNanjing University
icse-2020-Journal-First15:28 - 15:36
Talk
Mozhan SoltaniLeiden University, Pouria DerakhshanfarDelft University of Technology, Xavier DevroeyDelft University of Technology, Arie van DeursenDelft University of Technology
Link to publication DOI Pre-print Media Attached
icse-2020-papers15:36 - 15:48
Talk
Sadia TabassumUniversity of Birmingham, UK, Leandro MinkuUniversity of Birmingham, UK, Danyi FengXiLiu Tech, George CabralUniversidade Federal Rural de Pernambuco, Liyan SongUniversity of Birmingham
icse-2020-Journal-First15:48 - 15:56
Talk
Taher Ahmed GhalebQueen's University, Daniel Alencar Da CostaUniversity of Otago, Ying ZouQueen's University, Kingston, Ontario
Link to publication DOI Pre-print