Write a Blog >>
ICSE 2020
Wed 24 June - Thu 16 July 2020
Thu 9 Jul 2020 08:55 - 09:05 at Goguryeo - I17-Contracts and Analysis Chair(s): Jaechang Nam

Metamorphic testing (MT) is well known for its ability to alleviate the oracle problem in software testing. The main idea of MT is to test a software system by checking whether each identified metamorphic relation (MR) holds among several executions. This alleviates the need for comparing the actual output and the expected output for individual test cases, and thus addresses the oracle problem. At present, MT has already been successfully applied in various fields.

While MT is receiving more and more attention, some challenging issues still deserve substantial effort to address, such as acquisition of good MRs, effective test case generation, and research on foundation theory of MT. Since MRs play an important role in MT, effective and efficient acquisition of MRs is an essential task. Despite their importance, most MRs are still manually or arbitrarily identified. If MRs cannot be identified systematically, the effective application of MT would be affected.

In view of the importance of MRs, METRIC was developed to help software testers identify MRs from a given set of complete test frames (generated using the category-choice framework). Among the existing MR identification techniques, METRIC has the following advantages: (a) wide range of application domains, (b) few restrictions or assumptions, and (c) efficient MR identification process. However, METRIC still has the following limitations: (a) METRIC does not leverage the information of the output domain for MR identification, which may render the identification process less effective. (b) METRIC lacks an effective mechanism for reducing the search space of complete test frames when identifying potential MRs, which could be tedious and inefficient in those complex scenarios. (c) Fault detection effectiveness of MRs identified by METRIC has not been verified by means of experiments.

To address these problems, we propose an enhanced MR identification technique, namely METRIC$^{+}$, which significantly improves the efficacy and automation of METRIC by incorporating an output-domain-guided mechanism. METRIC$^{+}$ is not a simple extension of METRIC. It provides (a) systematic guidelines on identifying the fine-grained relations between the input domain and the output domain, which, in turn, improve the effectiveness of MR identification; and (b) a search space reduction mechanism that enhances the efficiency of MR identification. A supporting tool named MR-GEN$^{+}$ has been developed, which automates most steps of MR identification based on METRIC$^{+}$ (available at: http://www.mt4ws.cc/MR-GEN). Two rounds of experiments, involving four real-life specifications, have been conducted to evaluate the effectiveness and efficiency of METRIC$^{+}$. The results have confirmed that METRIC$^{+}$ is highly effective and efficient in MR identification. Additional experiments have been performed to compare the fault detection capability of the MRs generated by METRIC$^{+}$ and those by $\mu$MT (another MR identification technique). The comparison results have confirmed that the MRs generated by METRIC$^{+}$ are highly effective in fault detection.

Conference Day
Thu 9 Jul

Displayed time zone: (UTC) Coordinated Universal Time change

08:05 - 09:05
I17-Contracts and AnalysisDemonstrations / Technical Papers / Software Engineering in Practice / Journal First at Goguryeo
Chair(s): Jaechang NamHandong Global University
08:05
10m
Talk
How to reduce risk effectively in fixed price software developmentSEIP
Software Engineering in Practice
Volker GruhnUniversity Duisburg-Essen, Niklas Spitczok von Brisinskiadesso AG
08:15
10m
Talk
Seraph: Enabling Cross-Platform Security Analysis For EVM and WASM Smart ContractsDemo
Demonstrations
Zhiqiang YangOxford-Hainan Blockchain Research Institute, Han LiuTsinghua University, Yue LiOxford-Hainan Blockchain Research Institute, Huixuan ZhengOxford-Hainan Blockchain Research Institute, Lei WangOxford-Hainan Blockchain Research Institute, Bangdao ChenOxford-Hainan Blockchain Research Institute
08:25
10m
Talk
Escape from Escape Analysis of GolangSEIP
Software Engineering in Practice
Cong WangTsinghua University, Mingrui ZhangTsinghua University, Beijing, China, Yu Jiang, Huafeng ZhangHuawei Technologies, Hangzhou, China, Zhenchang XingAustralia National University, Ming Gu
08:35
10m
Talk
Smart Contract Development: Challenges and OpportunitiesJ1
Journal First
Weiqin ZouNanjing University, David LoSingapore Management University, Pavneet Singh KochharMicrosoft, Xuan-Bach D. LeSingapore Management University, Singapore, Xin XiaMonash University, Yang FengNanjing University, Zhenyu ChenNanjing University, Baowen XuNanjing University
08:45
10m
Talk
Empirical Review of Automated Analysis Tools on 47,587 Ethereum Smart ContractsArtifact ReusableTechnicalArtifact Available
Technical Papers
Thomas DurieuxKTH Royal Institute of Technology, Sweden, João F. FerreiraINESC-ID and IST, University of Lisbon, Rui AbreuInstituto Superior Técnico, U. Lisboa & INESC-ID, Pedro CruzIST, University of Lisbon, Portugal
Pre-print
08:55
10m
Talk
An Extended Abstract of “METRIC+: A Metamorphic Relation Identification Technique Based on Input Plus Output Domains”J1
Journal First
Chang-ai SunUniversity of Science and Technology Beijing, An FuUniversity of Science and Technology Beijing, Pak-Lok PoonSchool of Engineering & Technology, Central Queensland University, Australia, Xiaoyuan XieSchool of Computer Science, Wuhan University, China, Huai LiuSwinburne University of Technology, Tsong Yueh ChenSwinburne University of Technology