Write a Blog >>
ICSE 2020
Wed 24 June - Thu 16 July 2020
Sat 11 Jul 2020 15:00 - 15:08 at Baekje - A25-Android Testing Chair(s): Ting Su

High energy consumption is a challenging issue that an ever increasing number of mobile applications face today. However, energy consumption is being tested in an ad hoc way, despite being an important non-functional requirement of an application. Such limitation becomes particularly disconcerting during software testing: on the one hand, developers do not really know how to measure energy; on the other hand, there is no knowledge as to what is the energy overhead imposed by the testing framework.

In this paper, we design a methodology to measure the energy consumption of eight popular UI testing frameworks within six typical interactions and three helper methods. We have discovered that there are automation frameworks that increase energy consumption up to roughly 2200%. While limited in the interactions one can do, Espresso is observed to be the most energy-efficient framework. However, depending on the needs of the tester, Appium, Monkeyrunner, or UIAutomator are good alternatives.

In practice, results show that deciding which is the most suitable framework is vital. We provide a decision tree to help developers make an educated decision on which framework suits best their testing needs. Finally, we show that helper methods to find components in the interface – i.e., lookup methods – should be minimized to prevent affecting energy results. In particular, lookup methods based on the content of the UI component need to be avoided. They consistently yield poor energy efficiency when compared to lookups based on id (e.g., in Espresso it creates an overhead of 600%).

Conference Day
Sat 11 Jul

Displayed time zone: (UTC) Coordinated Universal Time change

15:00 - 16:00
A25-Android TestingTechnical Papers / Journal First at Baekje
Chair(s): Ting Su
15:00
8m
Talk
On the Energy Footprint of Mobile Testing FrameworksJ1
Journal First
Luís CruzDeflt University of Technology, Rui AbreuInstituto Superior Técnico, U. Lisboa & INESC-ID
DOI Pre-print Media Attached
15:08
12m
Talk
ComboDroid: Generating High-Quality Test Inputs for Android Apps via Use Case CombinationsTechnicalArtifact Available
Technical Papers
Jue WangNanjing University, Yanyan JiangNanjing University, Chang XuNanjing University, Chun CaoNanjing University, Xiaoxing MaNanjing University, Jian LuNanjing University
15:20
12m
Talk
Translating Video Recordings of Mobile App Usages into Replayable ScenariosACM SIGSOFT Distinguished Paper AwardsTechnical
Technical Papers
Carlos Bernal-CárdenasWilliam and Mary, Nathan CooperCollege of William & Mary, Kevin MoranWilliam & Mary/George Mason University, Oscar ChaparroCollege of William & Mary, Andrian MarcusUniversity of Texas at Dallas, Denys PoshyvanykWilliam and Mary
Pre-print Media Attached
15:32
8m
Talk
An Empirical Study on Quality of AndroidApplications written in Kotlin languageJ1
Journal First
Bruno Gois MateusUniversité Polytechnique Hauts-de-France, Matias MartinezUniversité Polytechnique Hauts-de-France
15:40
8m
Talk
Enhancing Trustability of Android Applications via User-Centric Flexible PermissionsJ1
Journal First
Gian Luca ScocciaUniversity of L'Aquila, Ivano MalavoltaVrije Universiteit Amsterdam, Marco AutiliUniversity of L'Aquila, Italy, Amleto Di SalleUniversity of L'Aquila, Paola InverardiUniversity of L'Aquila
Link to publication DOI Pre-print
15:48
8m
Talk
A Longitudinal Study of Popular Ad Libraries in the Google Play StoreJ1
Journal First
Md AhasanuzzamanQueen's University, Safwat HassanQueens University, Kingston, Canada, Cor-Paul BezemerUniversity of Alberta, Canada, Ahmed E. HassanQueen's University