Write a Blog >>
ICSE 2020
Wed 24 June - Thu 16 July 2020
Wed 15 Jul 2020 16:20 - 16:30 at AST - Live Session 3 Chair(s): Hong Zhu

Program based test adequacy criteria (TAC), such as statement, branch coverage and mutation give objectives for software testing. Many techniques and tools have been developed to improve each phase of the TAC-based software testing process. Nonetheless, The engineering effort required to integrate these tools and techniques into the software testing process limits their use and creates an overhead to the users. Especially for system testing with languages like C, where test cases are not always well structured in a framework.

In response to these challenges, this paper presents Muteria, a TAC-based software testing framework. Muteria enables the integration of multiple software testing tools.

Muteria abstracts each phase of the TAC-based software testing process to provide tool drivers interfaces for the implementation of tool drivers. Tool drivers enable Muteria to call the corresponding tools during the testing process. An initial set of drivers for KLEE, Shadow and SEMu test-generation tools, Gcov, and coverage.py code coverage tools, and Mart mutant generation tool for C and Python programming language were implemented with an average of 345 lines of Python code. Moreover, the user configuration file required to measure code coverage and mutation score on a sample C programs, using the Muteria framework, consists of less than 15 configuration variables.

Users of the Muteria framework select, in a configuration file, the tools and TACs to measure. The Muteria framework uses the user configuration to run the testing process and report the outcome. Users interact with Muteria through its Application Programming Interface and Command Line Interface. Muteria can benefit to researchers as a laboratory to execute experiments, and to software practitioners.

Muteria - preprint (main.pdf)794KiB

Wed 15 Jul
Times are displayed in time zone: (UTC) Coordinated Universal Time change

16:00 - 17:00: Live Session 3AST at AST
Chair(s): Hong ZhuOxford Brookes University
16:00 - 16:10
Research paper
Testing Apps With Real World Inputs
Tanapuch WanwarangCISPA Helmholtz Center for Information Security, Nataniel Borges Jr.CISPA Helmholtz Center for Information Security, Leon BettscheiderCISPA Helmholtz Center for Information Security, Andreas ZellerCISPA Helmholtz Center for Information Security
16:10 - 16:20
Research paper
A Delta-Debugging Approach to Assessing the Resilience of Actor Programs through Run-time Test Perturbations
Jonas De BleserSofware Languages Lab, Vrije Universiteit Brussel, Dario Di NucciTilburg University, Coen De RooverVrije Universiteit Brussel
16:20 - 16:30
Muteria: An Extensible and Flexible Multi-Criteria Software Testing Framework
Thierry Titcheu ChekamUniversity of Luxembourg (SnT), Mike PapadakisUniversity of Luxembourg, Yves Le TraonUniversity of Luxembourg
File Attached
16:30 - 16:40
Industry talk
Difference Grouping and Test Suite Evaluation: Lessons from Automated Differential Testing for Adobe Analytics
Darryl JarmanAdobe, Scott HuntAdobe, Jeffrey BerryAdobe, Inc., Dave ToweyUniversity of Nottingham Ningbo China
16:40 - 16:50
Industry talk
Automatic Prevention of Accidents in Production
Chang-Seo ParkGoogle LLC
16:50 - 17:00
Industry talk
The Effectiveness of Client-side JavaScript Testing
Jonny MoonAdobe, Inc., Brian FarnsworthAdobe, Inc., Riley SmithAdobe, Inc.