An Extended Abstract of “METRIC+: A Metamorphic Relation Identification Technique Based on Input Plus Output Domains”J1
Metamorphic testing (MT) is well known for its ability to alleviate the oracle problem in software testing. The main idea of MT is to test a software system by checking whether each identified metamorphic relation (MR) holds among several executions. This alleviates the need for comparing the actual output and the expected output for individual test cases, and thus addresses the oracle problem. At present, MT has already been successfully applied in various fields.
While MT is receiving more and more attention, some challenging issues still deserve substantial effort to address, such as acquisition of good MRs, effective test case generation, and research on foundation theory of MT. Since MRs play an important role in MT, effective and efficient acquisition of MRs is an essential task. Despite their importance, most MRs are still manually or arbitrarily identified. If MRs cannot be identified systematically, the effective application of MT would be affected.
In view of the importance of MRs, METRIC was developed to help software testers identify MRs from a given set of complete test frames (generated using the category-choice framework). Among the existing MR identification techniques, METRIC has the following advantages: (a) wide range of application domains, (b) few restrictions or assumptions, and (c) efficient MR identification process. However, METRIC still has the following limitations: (a) METRIC does not leverage the information of the output domain for MR identification, which may render the identification process less effective. (b) METRIC lacks an effective mechanism for reducing the search space of complete test frames when identifying potential MRs, which could be tedious and inefficient in those complex scenarios. (c) Fault detection effectiveness of MRs identified by METRIC has not been verified by means of experiments.
To address these problems, we propose an enhanced MR identification technique, namely METRIC$^{+}$, which significantly improves the efficacy and automation of METRIC by incorporating an output-domain-guided mechanism. METRIC$^{+}$ is not a simple extension of METRIC. It provides (a) systematic guidelines on identifying the fine-grained relations between the input domain and the output domain, which, in turn, improve the effectiveness of MR identification; and (b) a search space reduction mechanism that enhances the efficiency of MR identification. A supporting tool named MR-GEN$^{+}$ has been developed, which automates most steps of MR identification based on METRIC$^{+}$ (available at: http://www.mt4ws.cc/MR-GEN). Two rounds of experiments, involving four real-life specifications, have been conducted to evaluate the effectiveness and efficiency of METRIC$^{+}$. The results have confirmed that METRIC$^{+}$ is highly effective and efficient in MR identification. Additional experiments have been performed to compare the fault detection capability of the MRs generated by METRIC$^{+}$ and those by $\mu$MT (another MR identification technique). The comparison results have confirmed that the MRs generated by METRIC$^{+}$ are highly effective in fault detection.
Thu 9 JulDisplayed time zone: (UTC) Coordinated Universal Time change
08:05 - 09:05 | I17-Contracts and AnalysisDemonstrations / Technical Papers / Software Engineering in Practice / Journal First at Goguryeo Chair(s): Jaechang Nam Handong Global University | ||
08:05 10mTalk | How to reduce risk effectively in fixed price software developmentSEIP Software Engineering in Practice | ||
08:15 10mTalk | Seraph: Enabling Cross-Platform Security Analysis For EVM and WASM Smart ContractsDemo Demonstrations Zhiqiang Yang Oxford-Hainan Blockchain Research Institute, Han Liu Tsinghua University, Yue Li Oxford-Hainan Blockchain Research Institute, Huixuan Zheng Oxford-Hainan Blockchain Research Institute, Lei Wang Oxford-Hainan Blockchain Research Institute, Bangdao Chen Oxford-Hainan Blockchain Research Institute | ||
08:25 10mTalk | Escape from Escape Analysis of GolangSEIP Software Engineering in Practice Cong Wang Tsinghua University, Mingrui Zhang Tsinghua University, Beijing, China, Yu Jiang , Huafeng Zhang Huawei Technologies, Hangzhou, China, Zhenchang Xing Australia National University, Ming Gu | ||
08:35 10mTalk | Smart Contract Development: Challenges and OpportunitiesJ1 Journal First Weiqin Zou Nanjing University, David Lo Singapore Management University, Pavneet Singh Kochhar Microsoft, Xuan-Bach D. Le Singapore Management University, Singapore, Xin Xia Monash University, Yang Feng Nanjing University, Zhenyu Chen Nanjing University, Baowen Xu Nanjing University | ||
08:45 10mTalk | Empirical Review of Automated Analysis Tools on 47,587 Ethereum Smart ContractsTechnical Technical Papers Thomas Durieux KTH Royal Institute of Technology, Sweden, João F. Ferreira INESC-ID and IST, University of Lisbon, Rui Abreu Instituto Superior Técnico, U. Lisboa & INESC-ID, Pedro Cruz IST, University of Lisbon, Portugal Pre-print | ||
08:55 10mTalk | An Extended Abstract of “METRIC+: A Metamorphic Relation Identification Technique Based on Input Plus Output Domains”J1 Journal First Chang-ai Sun University of Science and Technology Beijing, An Fu University of Science and Technology Beijing, Pak-Lok Poon School of Engineering & Technology, Central Queensland University, Australia, Xiaoyuan Xie School of Computer Science, Wuhan University, China, Huai Liu Swinburne University of Technology, Tsong Yueh Chen Swinburne University of Technology |