Write a Blog >>
ICSE 2020
Wed 24 June - Thu 16 July 2020
Sat 11 Jul 2020 01:37 - 01:49 at Goguryeo - P29-Android and Web Testing Chair(s): Hironori Washizaki

According to the World Health Organization(WHO), it is estimated that approximately 1.3 billion people live with some form of vision impairment globally, of whom 36 million are blind. Due to their disability, engaging these minority into the society is a challenging problem. The recent rise of smart mobile phones provides a new solution by enabling blind users’ convenient access to the information and service for understanding the world. Users with vision impairment can adopt the screen reader embedded in the mobile operating systems to read the content of each screen within the app, and use gestures to interact with the phone. However, the prerequisite of using screen readers is that developers have to add natural-language labels to the image-based components when they are developing the app. Unfortunately, more than 77% apps have issues of missing labels, according to our analysis of 10,408 Android apps. Most of these issues are caused by developers’ lack of awareness and knowledge in considering the minority. And even if developers want to add the labels to UI components, they may not come up with concise and clear description as most of them are of no visual issues. To overcome these challenges, we develop a deep-learning based model to automatically predict the labels of image-based buttons by learning from large-scale commercial apps in Google Play. The experiment results show that our model can make accurate predictions and the generated labels are of higher quality than that from real Android developers. We also submit our predicted labels of buttons of some apps to their development teams, and successfully get some positive feedback.

Sat 11 Jul
Times are displayed in time zone: (UTC) Coordinated Universal Time change

01:05 - 02:05: Paper Presentations - P29-Android and Web Testing at Goguryeo
Chair(s): Hironori WashizakiWaseda University
icse-2020-papers01:05 - 01:17
George MathewNorth Carolina State University, Chris ParninNorth Carolina State University, Kathryn StoleeNorth Carolina State University
icse-2020-papers01:17 - 01:25
Rahulkrishna YandrapallyUniversity of British Columbia, Canada, Andrea StoccoUniversitĂ  della Svizzera italiana, Ali MesbahUniversity of British Columbia
icse-2020-Software-Engineering-in-Practice01:25 - 01:37
Qun XiaTencent Inc., Zhongzhu Zhouzhouzhzh8@mail2.sysu.edu.cn, Zhihao LiTencent Inc., Bin XuTencent Inc., Wei ZouTencent Inc., Zishun ChenTencent Inc., Huafeng MaTencent Inc., Gangqiang LiangTencent Inc., Haochuan LuFudan University, Shiyu GuoTencent Inc., Ting XiongTencent Inc., Yuetang DengTencent, Inc., Tao XiePeking University
icse-2020-papers01:37 - 01:49
Jieshan ChenAustralian National University, Chunyang ChenMonash University, Zhenchang XingAustralia National University, Xiwei XuData 61, Liming ZhuCSIRO's Data61 and UNSW, Guoqiang LiShanghai Jiao Tong University, Jinshui WangSchool of Information Science and Engineering, Fujian University of Technology, Fuzhou, China
Demonstrations01:49 - 01:52
Jian LiuEast China Normal University, Xusheng XiaoCase Western Reserve University, Lihua XuNew York University Shanghai, Liang DouEast China Normal University, Andy PodgurskiCase Western University
Demonstrations01:52 - 01:55
Muhammad Ali GulzarUniversity of California, Los Angeles, Madan MusuvathiMicrosoft Research, Miryung KimUniversity of California, Los Angeles