Write a Blog >>
ICSE 2020
Wed 24 June - Thu 16 July 2020
Wed 15 Jul 2020 16:20 - 16:30 at AST - Live Session 3 Chair(s): Hong Zhu

Program based test adequacy criteria (TAC), such as statement, branch coverage and mutation give objectives for software testing. Many techniques and tools have been developed to improve each phase of the TAC-based software testing process. Nonetheless, The engineering effort required to integrate these tools and techniques into the software testing process limits their use and creates an overhead to the users. Especially for system testing with languages like C, where test cases are not always well structured in a framework.

In response to these challenges, this paper presents Muteria, a TAC-based software testing framework. Muteria enables the integration of multiple software testing tools.

Muteria abstracts each phase of the TAC-based software testing process to provide tool drivers interfaces for the implementation of tool drivers. Tool drivers enable Muteria to call the corresponding tools during the testing process. An initial set of drivers for KLEE, Shadow and SEMu test-generation tools, Gcov, and coverage.py code coverage tools, and Mart mutant generation tool for C and Python programming language were implemented with an average of 345 lines of Python code. Moreover, the user configuration file required to measure code coverage and mutation score on a sample C programs, using the Muteria framework, consists of less than 15 configuration variables.

Users of the Muteria framework select, in a configuration file, the tools and TACs to measure. The Muteria framework uses the user configuration to run the testing process and report the outcome. Users interact with Muteria through its Application Programming Interface and Command Line Interface. Muteria can benefit to researchers as a laboratory to execute experiments, and to software practitioners.

Muteria - preprint (main.pdf)794KiB

Wed 15 Jul

Displayed time zone: (UTC) Coordinated Universal Time change

16:00 - 17:00
Live Session 3AST at AST
Chair(s): Hong Zhu Oxford Brookes University
16:00
10m
Research paper
Testing Apps With Real World Inputs
AST
Tanapuch Wanwarang CISPA Helmholtz Center for Information Security, Nataniel Borges Jr. CISPA Helmholtz Center for Information Security, Leon Bettscheider CISPA Helmholtz Center for Information Security, Andreas Zeller CISPA Helmholtz Center for Information Security
Pre-print
16:10
10m
Research paper
A Delta-Debugging Approach to Assessing the Resilience of Actor Programs through Run-time Test Perturbations
AST
Jonas De Bleser Sofware Languages Lab, Vrije Universiteit Brussel, Dario Di Nucci Tilburg University, Coen De Roover Vrije Universiteit Brussel
Pre-print
16:20
10m
Short-paper
Muteria: An Extensible and Flexible Multi-Criteria Software Testing Framework
AST
Thierry Titcheu Chekam University of Luxembourg (SnT), Mike Papadakis University of Luxembourg, Yves Le Traon University of Luxembourg
File Attached
16:30
10m
Industry talk
Difference Grouping and Test Suite Evaluation: Lessons from Automated Differential Testing for Adobe Analytics
AST
Darryl Jarman Adobe, Scott Hunt Adobe, Jeffrey Berry Adobe, Inc., Dave Towey University of Nottingham Ningbo China
16:40
10m
Industry talk
Automatic Prevention of Accidents in Production
AST
Chang-Seo Park Google LLC
16:50
10m
Industry talk
The Effectiveness of Client-side JavaScript Testing
AST
Jonny Moon Adobe, Inc., Brian Farnsworth Adobe, Inc., Riley Smith Adobe, Inc.