Exploratory Datamorphic Testing of Classification Applications
Testing has been widely recognised as difficult for AI applications. This paper proposes a set of testing strategies for testing machine learning applications in the framework of the datamorphism testing methodology. In these strategies, testing aims at exploring the data space of a classification or clustering application to discover the boundaries between classes that the machine learning application defines. This enables the tester to understand precisely the behaviour and function of the software under test. In the paper, three variants of exploratory strategies are presented with the algorithms as implemented in the automated datamorphic testing tool Morphy. The correctness of these algorithms are formally proved. The paper also reports the results of some controlled experiments with Morphy that study the factors that affect the test effectiveness of the strategies.
Wed 15 JulDisplayed time zone: (UTC) Coordinated Universal Time change
14:00 - 15:00 | |||
14:00 10mResearch paper | Exploratory Datamorphic Testing of Classification Applications AST | ||
14:10 10mResearch paper | Algorithm or Representation? An Empirical Study on How SAPIENZ Achieves Coverage AST Iván Arcuschin Moreno University of Buenos Aires, Argentina, Juan Pablo Galeotti University of Buenos Aires, Diego Garbervetsky University of Buenos Aires and CONICET, Argentina Pre-print | ||
14:20 10mResearch paper | Automatic Ex-Vivo Regression Testing of Microservices AST Luca Gazzola Università degli Studi di Milano-Bicocca, Maayan Goldstein Nokia Bell Labs, Israel, Leonardo Mariani University of Milano Bicocca, Itai Segall Nokia Bell-Labs, Luca Ussi University of Milano-Bicocca, Italy File Attached | ||
14:30 10mResearch paper | Validating Test Case Migration via Mutation Analysis AST Ivan Jovanovikj Paderborn University, Enes Yigitbas University of Paderborn, Germany, Achyuth Nagaraj Paderborn University, Stefan Sauer Paderborn University, Gregor Engels Paderborn University Pre-print | ||
14:40 10mShort-paper | Automated Analysis of Flakiness-mitigating Delays AST Jean Malm Malardalen University, Adnan Causevic Mälardalen University, Björn Lisper Malardalen University, Sigrid Eldh Ericsson, Sweden | ||
14:50 10mShort-paper | The Power of String Solving: Simplicity of Comparison AST Mitja Kulczynski Kiel University, Florin Manea University of Göttingen, Dirk Nowotka Kiel University, Danny Bøgsted Poulsen Aalborg University |