Write a Blog >>
ICSE 2020
Wed 24 June - Thu 16 July 2020
Tue 7 Jul 2020 07:12 - 07:20 at Baekje - I1-Metastudies Chair(s): Michael Vierhauser

We propose a robustness testing approach for software systems that process large amounts of data. Our method uses metamorphic relations to check software output for erroneous input in the absence of a tangible test oracle. We use this technique to test two major citation database systems: Scopus and the Web of Science. We report a surprising finding that the inclusion of hyphens in paper titles impedes citation counts, and that this is a result of the lack of robustness of the citation database systems in handling hyphenated paper titles. Our results are valid for the entire literature as well as for individual fields such as chemistry. We further find a strong and significant negative correlation between the journal impact factor (JIF) of IEEE Transactions on Software Engineering (TSE) and the percentage of hyphenated paper titles published in TSE. Similar results are found for ACM Transactions on Software Engineering and Methodology. A software engineering field-wide study reveals that the higher JIF-ranked journals are publishing a lower percentage of papers with hyphenated titles. Our results challenge the common belief that citation counts and JIFs are reliable measures of the impact of papers and journals, as they can be distorted simply by the presence of hyphens in paper titles.

Tue 7 Jul
Times are displayed in time zone: (UTC) Coordinated Universal Time change

07:00 - 08:00: Paper Presentations - I1-Metastudies at Baekje
Chair(s): Michael VierhauserJohannes Kepler University Linz
icse-2020-papers07:00 - 07:12
He ZhangNanjing University, Xin ZhouState Key Laboratory of Novel Software Technology, Software Institute, Nanjing University, Xin HuangState Key Laboratory of Novel Software Technology, Software Institute, Nanjing University, Huang HuangState Key Laboratory of Novel Software Technology, Software Institute, Nanjing University, Muhammad Ali BabarThe University of Adelaide
icse-2020-Journal-First07:12 - 07:20
Zhi Quan (George) ZhouUniversity of Wollongong, Australia, T.H. TseThe University of Hong Kong, Matt WitheridgeUniversity of Wollongong
icse-2020-Journal-First07:20 - 07:28
Adrian Santos ParrillaUniversity of Oulu, Sira VegasUniversidad Politecnica de Madrid, Markku OivoUniversity of Oulu, Natalia JuristoUniversidad Politecnica de Madrid
Demonstrations07:28 - 07:31
Andreas HinderksUniversity of Seville, Francisco José Domínguez MayoUniversity of Seville, Jörg ThomaschewskiUniversity of Applied Sciences Emden/Leer, María José EscalonaUniversity of Seville
icse-2020-New-Ideas-and-Emerging-Results07:31 - 07:37
Juyoung JeonHandong Global University, Shin HongHandong Global University
icse-2020-Journal-First07:37 - 07:45
Alessandro Vittorio PapadopoulosMälardalen University, Laurens VersluisVrije Universiteit Amsterdam, André BauerUniversity of Würzburg, Nikolas HerbstUniversity of Würzburg, Joakim von KistowskiUniversity of Würzburg, Ahmed Ali-EldinUMass Amherst, Cristina L. AbadEscuela Superior Politecnica del Litoral, Jose Nelson AmaralUniversity of Alberta, Petr TumaCharles University, Alexandru IosupVrije Universiteit Amsterdam
icse-2020-Journal-First07:45 - 07:53
Carlo A. FuriaUniversità della Svizzera italiana (USI), Robert FeldtChalmers | University of Gothenburg, Blekinge Institute of Technology, Richard TorkarChalmers and the University of Gothenburg
DOI Pre-print