An Evidence-Based Inquiry into the Use of Grey Literature in Software EngineeringTechnical
Context: Following on other scientific disciplines, such as health sciences, the use of grey literature (GL) is becoming widespread in Software Engineering (SE) research. Whilst the number of papers incorporating GL on SE is increasing, there is little empirically known about different aspects of the use of GL in SE research. Method: We used mixed-methods approach for this research. We carried out an Systematic Literature Review (SLR) of the use of GL in SE. Then we surveyed the authors of the papers included in the SLR and community experts on the use of GL in SE research. Results: We systematically selected and reviewed 102 SE secondary studies that incorporated GL in SE. We identified two groups based on their reporting: 1) 76 reviews only claim the use of GL; 2) 26 reviews report the results of GL. We also obtained 20 replies from the GL users and 24 replies from the invited experts. Conclusion: There is no common understanding of the meaning of GL in SE. Researchers define the scopes and definition of GL in a variety of ways. We find five main reasons of using GL in SE. The findings have enabled us to propose a conceptual model for the role of GL in SE research lifecycle . There is an important need of research to develop guidelines for using GL in SE and for quality assessment of the literature to be included.
Tue 7 JulDisplayed time zone: (UTC) Coordinated Universal Time change
07:00 - 08:00 | I1-MetastudiesNew Ideas and Emerging Results / Technical Papers / Journal First / Demonstrations at Baekje Chair(s): Michael Vierhauser Johannes Kepler University Linz | ||
07:00 12mTalk | An Evidence-Based Inquiry into the Use of Grey Literature in Software EngineeringTechnical Technical Papers He Zhang Nanjing University, Xin Zhou State Key Laboratory of Novel Software Technology, Software Institute, Nanjing University, Xin Huang State Key Laboratory of Novel Software Technology, Software Institute, Nanjing University, Huang Huang State Key Laboratory of Novel Software Technology, Software Institute, Nanjing University, Muhammad Ali Babar The University of Adelaide | ||
07:12 8mTalk | An Extended Abstract of "Metamorphic Robustness Testing: Exposing Hidden Defects in Citation Statistics and Journal Impact Factors"J1 Journal First Zhi Quan (George) Zhou University of Wollongong, Australia, T.H. Tse The University of Hong Kong, Matt Witheridge University of Wollongong | ||
07:20 8mTalk | A Procedure and Guidelines for Analyzing Groups of Software Engineering ReplicationsJ1 Journal First Adrian Santos Parrilla University of Oulu, Sira Vegas Universidad Politecnica de Madrid, Markku Oivo University of Oulu, Natalia Juristo Universidad Politecnica de Madrid | ||
07:28 3mTalk | An SLR-Tool: Search Process in PracticeDemo Demonstrations Andreas Hinderks University of Seville, Francisco José Domínguez Mayo University of Seville, Jörg Thomaschewski University of Applied Sciences Emden/Leer, María José Escalona University of Seville | ||
07:31 6mTalk | Threats to Validity in Experimenting Mutation-Based Fault LocalizationNIER New Ideas and Emerging Results | ||
07:37 8mTalk | Methodological Principles for Reproducible Performance Evaluation in Cloud ComputingJ1 Journal First Alessandro Vittorio Papadopoulos Mälardalen University, Laurens Versluis Vrije Universiteit Amsterdam, André Bauer University of Würzburg, Nikolas Herbst University of Würzburg, Joakim von Kistowski University of Würzburg, Ahmed Ali-Eldin UMass Amherst, Cristina L. Abad Escuela Superior Politecnica del Litoral, Jose Nelson Amaral University of Alberta, Petr Tuma Charles University, Alexandru Iosup Vrije Universiteit Amsterdam | ||
07:45 8mTalk | Bayesian Data Analysis in Empirical Software Engineering ResearchJ1 Journal First Carlo A. Furia Università della Svizzera italiana (USI), Robert Feldt Chalmers | University of Gothenburg, Blekinge Institute of Technology, Richard Torkar Chalmers and the University of Gothenburg DOI Pre-print |