Muteria: An Extensible and Flexible Multi-Criteria Software Testing Framework
Program based test adequacy criteria (TAC), such as statement, branch coverage and mutation give objectives for software testing. Many techniques and tools have been developed to improve each phase of the TAC-based software testing process. Nonetheless, The engineering effort required to integrate these tools and techniques into the software testing process limits their use and creates an overhead to the users. Especially for system testing with languages like C, where test cases are not always well structured in a framework.
In response to these challenges, this paper presents Muteria, a TAC-based software testing framework. Muteria enables the integration of multiple software testing tools.
Muteria abstracts each phase of the TAC-based software testing process to provide tool drivers interfaces for the implementation of tool drivers. Tool drivers enable Muteria to call the corresponding tools during the testing process. An initial set of drivers for KLEE, Shadow and SEMu test-generation tools, Gcov, and coverage.py code coverage tools, and Mart mutant generation tool for C and Python programming language were implemented with an average of 345 lines of Python code. Moreover, the user configuration file required to measure code coverage and mutation score on a sample C programs, using the Muteria framework, consists of less than 15 configuration variables.
Users of the Muteria framework select, in a configuration file, the tools and TACs to measure. The Muteria framework uses the user configuration to run the testing process and report the outcome. Users interact with Muteria through its Application Programming Interface and Command Line Interface. Muteria can benefit to researchers as a laboratory to execute experiments, and to software practitioners.
|Muteria - preprint (main.pdf)||794KiB|
Wed 15 Jul Times are displayed in time zone: (UTC) Coordinated Universal Time change
|16:00 - 16:10|
Tanapuch WanwarangCISPA Helmholtz Center for Information Security, Nataniel Borges Jr.CISPA Helmholtz Center for Information Security, Leon BettscheiderCISPA Helmholtz Center for Information Security, Andreas ZellerCISPA Helmholtz Center for Information SecurityPre-print
|16:10 - 16:20|
A Delta-Debugging Approach to Assessing the Resilience of Actor Programs through Run-time Test Perturbations
Jonas De BleserSofware Languages Lab, Vrije Universiteit Brussel, Dario Di NucciTilburg University, Coen De RooverVrije Universiteit BrusselPre-print
|16:20 - 16:30|
Thierry Titcheu ChekamUniversity of Luxembourg (SnT), Mike PapadakisUniversity of Luxembourg, Yves Le TraonUniversity of LuxembourgFile Attached
|16:30 - 16:40|
Difference Grouping and Test Suite Evaluation: Lessons from Automated Differential Testing for Adobe Analytics
|16:40 - 16:50|
Chang-Seo ParkGoogle LLC
|16:50 - 17:00|