Write a Blog >>
ICSE 2020
Wed 24 June - Thu 16 July 2020
Sat 11 Jul 2020 00:12 - 00:24 at Silla - P27-Applications Chair(s): Ganesha Upadhyaya

Netflix is an internet entertainment service that routinely employs experimentation to guide strategy around product innovations. As Netflix grew, it had the opportunity to explore increasingly specialized improvements to its service, which generated demand for deeper analyses supported by richer metrics and powered by more diverse statistical methodologies. To facilitate this, and more fully harness the skill sets of both engineering and data science, Netflix engineers created a science-centric experimentation platform that leverages the expertise of scientists from a wide range of backgrounds working on data science tasks by allowing them to make direct code contributions in the languages used by them (Python and R). Moreover, the same code that runs in production is able to be run locally, making it straightforward to explore and graduate both metrics and causal inference methodologies directly into production services.

In this paper, we provide two main contributions. Firstly, we report on the architecture of this platform, with a special emphasis on its novel aspects: how it supports science-centric end-to-end workflows without compromising engineering requirements. Secondly, we describe its approach to causal inference, which leverages the potential outcomes conceptual framework to provide a unified abstraction layer for arbitrary statistical models and methodologies.

Sat 11 Jul
Times are displayed in time zone: (UTC) Coordinated Universal Time change

icse-2020-paper-presentations
00:00 - 01:00: Paper Presentations - P27-Applications at Silla
Chair(s): Ganesha UpadhyayaHarmony.one
icse-2020-papers00:00 - 00:12
Talk
Rafael-Michael KarampatsisThe University of Edinburgh, Hlib BabiiFree University of Bozen-Bolzano, Romain RobbesFree University of Bozen-Bolzano, Charles SuttonGoogle Research, Andrea JanesFree University of Bozen-Bolzano
DOI Pre-print
icse-2020-Software-Engineering-in-Practice00:12 - 00:24
Talk
Nikos DiamantopoulosNetflix, Inc., Jeffrey WongNetflix, Inc., David Issa MattosChalmers University of Technology, Ilias GerostathopoulosVrije Universiteit Amsterdam, Matthew WardropNetflix, Inc., Tobias MaoNetflix, Inc., Colin McFarlandNetflix, Inc.
icse-2020-papers00:24 - 00:36
Talk
Junwen YangUniversity of Chicago, Utsav SethiUniversity of Chicago, Cong YanUniversity of Washington, Alvin CheungUniversity of California, Berkeley, Shan LuUniversity of Chicago
icse-2020-papers00:36 - 00:48
Talk
Jingmei HuHarvard University, Jiwon JoungHarvard University, Maia JacobsHarvard University, Margo SeltzerUniversity of British Columbia, Krzysztof GajosHarvard University