Write a Blog >>
ICSE 2020
Wed 24 June - Thu 16 July 2020
Sat 11 Jul 2020 15:00 - 15:08 at Baekje - A25-Android Testing Chair(s): Ting Su

High energy consumption is a challenging issue that an ever increasing number of mobile applications face today. However, energy consumption is being tested in an ad hoc way, despite being an important non-functional requirement of an application. Such limitation becomes particularly disconcerting during software testing: on the one hand, developers do not really know how to measure energy; on the other hand, there is no knowledge as to what is the energy overhead imposed by the testing framework.

In this paper, we design a methodology to measure the energy consumption of eight popular UI testing frameworks within six typical interactions and three helper methods. We have discovered that there are automation frameworks that increase energy consumption up to roughly 2200%. While limited in the interactions one can do, Espresso is observed to be the most energy-efficient framework. However, depending on the needs of the tester, Appium, Monkeyrunner, or UIAutomator are good alternatives.

In practice, results show that deciding which is the most suitable framework is vital. We provide a decision tree to help developers make an educated decision on which framework suits best their testing needs. Finally, we show that helper methods to find components in the interface – i.e., lookup methods – should be minimized to prevent affecting energy results. In particular, lookup methods based on the content of the UI component need to be avoided. They consistently yield poor energy efficiency when compared to lookups based on id (e.g., in Espresso it creates an overhead of 600%).

Sat 11 Jul
Times are displayed in time zone: (UTC) Coordinated Universal Time change

icse-2020-paper-presentations
15:00 - 16:00: Paper Presentations - A25-Android Testing at Baekje
Chair(s): Ting Su
icse-2020-Journal-First15:00 - 15:08
Talk
Luis CruzDeflt University of Technology, Rui AbreuInstituto Superior Técnico, U. Lisboa & INESC-ID
DOI Pre-print Media Attached
icse-2020-papers15:08 - 15:20
Talk
Jue WangNanjing University, Yanyan JiangNanjing University, Chang XuNanjing University, Chun CaoNanjing University, Xiaoxing MaNanjing University, Jian LuNanjing University
icse-2020-papers15:20 - 15:32
Talk
Carlos Bernal-CárdenasWilliam and Mary, Nathan CooperCollege of William & Mary, Kevin MoranWilliam & Mary/George Mason University, Oscar ChaparroCollege of William & Mary, Andrian MarcusUniversity of Texas at Dallas, Denys PoshyvanykWilliam and Mary
Pre-print Media Attached
icse-2020-Journal-First15:32 - 15:40
Talk
Bruno Gois MateusUniversité Polytechnique Hauts-de-France, Matias MartinezUniversité Polytechnique Hauts-de-France
icse-2020-Journal-First15:40 - 15:48
Talk
Gian Luca ScocciaUniversity of L'Aquila, Ivano Malavolta, Marco AutiliUniversity of L'Aquila, Italy, Amleto Di SalleUniversity of L'Aquila, Paola InverardiUniversity of L'Aquila
Link to publication DOI Pre-print
icse-2020-Journal-First15:48 - 15:56
Talk
Md AhasanuzzamanQueen's University, Safwat HassanQueens University, Kingston, Canada, Cor-Paul BezemerUniversity of Alberta, Canada, Ahmed E. HassanQueen's University