Algorithm or Representation? An Empirical Study on How SAPIENZ Achieves Coverage
Testing is a very important and expensive part of developingAndroid applications. Several tools for automatically testing Android applications have been proposed. In particular, Sapienz is a searchbased tool that has been recently deployed in an industrial setting. Although it has been shown that Sapienz outperforms several stateof-the-art tools, it is still to be seen what features of Sapienz impact the most on its effectiveness.
We conducted an extensive empirical study where we compare the impact of the search algorithm and the usage of motif genes, a more compact representation of individuals. Our empirical study shows that the usage of motif genes improves statement coverage both for evolutionary algorithms and random approaches. In particular, our study shows that although the evolutionary algorithm used by Sapienz (i.e., NSGA-II) outperforms other search algorithms, it is not statistically distinguishable from Random Search. These facts cast doubts about the use of evolutionary algorithms in the context of Android test generation and suggest that motif genes have a great impact on the overall effectiveness.
Wed 15 JulDisplayed time zone: (UTC) Coordinated Universal Time change
14:00 - 15:00 | |||
14:00 10mResearch paper | Exploratory Datamorphic Testing of Classification Applications AST | ||
14:10 10mResearch paper | Algorithm or Representation? An Empirical Study on How SAPIENZ Achieves Coverage AST Iván Arcuschin Moreno University of Buenos Aires, Argentina, Juan Pablo Galeotti University of Buenos Aires, Diego Garbervetsky University of Buenos Aires and CONICET, Argentina Pre-print | ||
14:20 10mResearch paper | Automatic Ex-Vivo Regression Testing of Microservices AST Luca Gazzola Università degli Studi di Milano-Bicocca, Maayan Goldstein Nokia Bell Labs, Israel, Leonardo Mariani University of Milano Bicocca, Itai Segall Nokia Bell-Labs, Luca Ussi University of Milano-Bicocca, Italy File Attached | ||
14:30 10mResearch paper | Validating Test Case Migration via Mutation Analysis AST Ivan Jovanovikj Paderborn University, Enes Yigitbas University of Paderborn, Germany, Achyuth Nagaraj Paderborn University, Stefan Sauer Paderborn University, Gregor Engels Paderborn University Pre-print | ||
14:40 10mShort-paper | Automated Analysis of Flakiness-mitigating Delays AST Jean Malm Malardalen University, Adnan Causevic Mälardalen University, Bjorn Lisper Malardalen University, Sigrid Eldh Ericsson, Sweden | ||
14:50 10mShort-paper | The Power of String Solving: Simplicity of Comparison AST Mitja Kulczynski Kiel University, Florin Manea University of Göttingen, Dirk Nowotka Kiel University, Danny Bøgsted Poulsen Aalborg University |