Write a Blog >>
ICSE 2020
Wed 24 June - Thu 16 July 2020
Sat 11 Jul 2020 15:12 - 15:20 at Goguryeo - A26-Bugs and Repair Chair(s): Davide Falessi

Many big-data applications are batch applications that exploit dedicated frameworks to perform massively parallel computations across clusters of machines. The time needed to process the entirety of the inputs represents the application’s response time, which can be subject to deadlines. Spark, probably the most famous incarnation of these frameworks today, allocates resources to applications statically at the beginning of the execution and deviations are not managed: to meet the applications’ deadlines, resources must be allocated carefully. Our paper proposes an extension to Spark, called dynaSpark, that is able to allocate and redistribute resources to applications dynamically to meet deadlines and cope with the execution of unanticipated applications. This work is based on two key enablers: containers, to isolate Spark’s parallel executors and allow for the dynamic and fast allocation of resources, and control-theory to govern resource allocation at runtime and obtain required precision and speed. Our evaluation shows that dynaSpark can (i) allocate resources efficiently to execute single applications with respect to set deadlines and (ii) reduce deadline violations (w.r.t. Spark) when executing multiple concurrent applications.

Sat 11 Jul
Times are displayed in time zone: (UTC) Coordinated Universal Time change

15:00 - 16:00: Paper Presentations - A26-Bugs and Repair at Goguryeo
Chair(s): Davide FalessiCalifornia Polytechnic State University
icse-2020-papers15:00 - 15:12
Mingyuan WuSouthern University of Science and Technology, Yicheng OuyangSouthern University of Science and Technology, Husheng ZhouThe University of Texas at Dallas, Lingming ZhangThe University of Texas at Dallas, Cong LiuUT Dallas, Yuqun ZhangSouthern University of Science and Technology
icse-2020-Journal-First15:12 - 15:20
Luciano BaresiPolitecnico di Milano, Alberto LevaPolitecnico di Milano, Giovanni QuattrocchiPolitecnico di Milano
icse-2020-Journal-First15:20 - 15:28
Carlos Gavidia-CalderonUniversity College London, Federica SarroUniversity College London, UK, Mark HarmanFacebook and University College London, Earl T. BarrUniversity College London, UK
Link to publication DOI Pre-print Media Attached
icse-2020-Journal-First15:28 - 15:36
Anil KoyuncuUniversity of Luxembourg, Luxembourg, Kui LiuNanjing University of Aeronautics and Astronautics, Tegawendé F. BissyandéSnT, University of Luxembourg, Dongsun KimFuriosa.ai, Jacques KleinUniversity of Luxembourg, SnT, Martin MonperrusKTH Royal Institute of Technology, Yves Le TraonUniversity of Luxembourg
icse-2020-Journal-First15:36 - 15:44
Paul MunteanTU Munich, Martin MonperrusKTH Royal Institute of Technology, Hao SunUnaffiliated, Jens GrossklagsTechnical University of Munich, Claudia EckertTechnical University of Munich
icse-2020-papers15:44 - 15:56
Yi LiNew Jersey Institute of Technology, USA, Shaohua WangNew Jersey Institute of Technology, USA, Tien N. NguyenUniversity of Texas at Dallas