Improving the Pull Requests Review Process Using Learning-to-rank AlgorithmsJ1
Collaborative software development platforms (such as GitHub and GitLab) have become increasingly popu- lar as they have attracted thousands of external contributors to open source projects. External contributors may submit their contributions via pull requests (PRs), which must be reviewed before being integrated into the central repository. During the review process, reviewers provide feedback to contributors, conduct tests and request further modifications before finally accepting or rejecting the contributions. The role of reviewers is key to maintain the effective review process of the project. However, the number of decisions that reviewers can take is far superseded by the increasing number of pull requests submissions. Reviewers need help to perform more decisions on pull requests within their limited working time. In this paper [2], we propose a learning-to-rank (LtR) approach to recommend pull requests that can be quickly reviewed by reviewers. Different from a binary model for predicting the decisions of pull requests, our ranking approach complements the existing list of pull requests based on their likelihood of being quickly merged or rejected. We use 18 metrics to build LtR models and we use six different LtR algorithms, such as ListNet, RankNet, MART and random forest. We conduct empirical studies on 74 Java projects to compare the performances of the six LtR algorithms.
Thu 9 JulDisplayed time zone: (UTC) Coordinated Universal Time change
01:05 - 02:05 | P17-Software DevelopmentJournal First / Technical Papers / Demonstrations at Goguryeo Chair(s): Minghui Zhou Peking University | ||
01:05 8mTalk | Improving the Pull Requests Review Process Using Learning-to-rank AlgorithmsJ1 Journal First Guoliang Zhao Computer Science of Queen's University, Daniel Alencar Da Costa University of Otago, Ying Zou Queen's University, Kingston, Ontario | ||
01:13 8mTalk | Understanding the motivations, challenges and needs of Blockchain software developers: a surveyJ1 Journal First Amiangshu Bosu Wayne State University, Anindya Iqbal Bangladesh University of Engineering and Technology Dhaka, Bangladesh, Rifat Shahriyar Bangladesh University of Engineering and Technology Dhaka, Bangladesh, Partho Chakraborty Bangladesh University of Engineering and Technology Dhaka, Bangladesh | ||
01:21 12mTalk | Gap between Theory and Practice : An Empirical Study of Security Patches in SolidityTechnical Technical Papers | ||
01:33 12mTalk | A Tale from the Trenches: Cognitive Biases and Software DevelopmentTechnical Technical Papers Souti Chattopadhyay Graduate Student, Nicholas Nelson Oregon State University, Audrey Au Oregon State University, Natalia Morales Oregon State University, Christopher Sanchez Oregon State University, Rahul Pandita Phase Change Software, Anita Sarma Oregon State University | ||
01:45 3mTalk | VITALSE: Visualizing Eye Tracking and Biometric DataDemo Demonstrations Devjeet Roy Washington State University, Sarah Fakhoury Washington State University, Venera Arnaoudova Washington State University Pre-print |