Write a Blog >>
ICSE 2021
Mon 17 May - Sat 5 June 2021

We report on Facebook’s deployment of MIA (Metamorphic Interaction Automaton). MIA is used to test Facebook’s Web Enabled Simulation, built on a web infrastructure of hundreds of millions of lines of code. MIA tackles the twin problems of test flakiness and the unknowable oracle problem. It uses metamorphic testing to automate continuous integration and regression test execution. MIA also plays the role of a test bot, automatically commenting on all relevant changes submitted for code review. It currently uses a suite of over 40 metamorphic test cases. Even at this extreme scale, a non–trivial metamorphic test suite subset yields outcomes within 20 minutes (sufficient for continuous integration and review processes). Furthermore, our offline mode simulation reduces test flakiness from approximately 50% (of all online tests) to 0% (offline). Metamorphic testing has been widely-studied for 22 years. This paper is the first reported deployment into an industrial continuous integration system.

Wed 26 May

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

18:50 - 19:50
2.5.4. Some Big Companies' Practices: Cases at Facebook, Google & IBMSEIP - Software Engineering in Practice at Blended Sessions Room 4 +12h
Chair(s): Davide Falessi California Polytechnic State University
18:50
20m
Paper
Testing Web Enabled Simulation at Scale Using Metamorphic TestingSEIP
SEIP - Software Engineering in Practice
Mark Harman Facebook, Inc., John Ahlgren Facebook, Maria Eugenia Berezin Facebook, Elena Dulskyte Facebook, Inna Dvortsova Facebook, Johann George Facebook, Natalija Gucevska Facebook, Erik Meijer , Justin Spahr-Summers Facebook, Kinga Bojarczuk Facebook, Silvia Sapora Facebook, Maria Lomeli Facebook
Pre-print Media Attached
19:10
20m
Paper
Anomaly Detection in a Large-scale Cloud PlatformSEIP
SEIP - Software Engineering in Practice
Mohammad Saiful Islam Ryerson University, William Pourmajidi Ryerson University, Lei Zhang Ryerson University, John Steinbacher IBM, Tony Erwin IBM, Andriy Miranskyy Ryerson University
Pre-print Media Attached
19:30
20m
Paper
Smart Build Targets Batching Service at GoogleSEIP
SEIP - Software Engineering in Practice
Kaiyuan Wang Google, USA, Daniel Rall Google, Greg Tener Google, Vijay Gullapalli Google, Xin Huang , Ahmed Gad Google
Pre-print Media Attached

Thu 27 May

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

06:50 - 07:50
2.5.4. Some Big Companies' Practices: Cases at Facebook, Google & IBMSEIP - Software Engineering in Practice at Blended Sessions Room 4
06:50
20m
Paper
Testing Web Enabled Simulation at Scale Using Metamorphic TestingSEIP
SEIP - Software Engineering in Practice
Mark Harman Facebook, Inc., John Ahlgren Facebook, Maria Eugenia Berezin Facebook, Elena Dulskyte Facebook, Inna Dvortsova Facebook, Johann George Facebook, Natalija Gucevska Facebook, Erik Meijer , Justin Spahr-Summers Facebook, Kinga Bojarczuk Facebook, Silvia Sapora Facebook, Maria Lomeli Facebook
Pre-print Media Attached
07:10
20m
Paper
Anomaly Detection in a Large-scale Cloud PlatformSEIP
SEIP - Software Engineering in Practice
Mohammad Saiful Islam Ryerson University, William Pourmajidi Ryerson University, Lei Zhang Ryerson University, John Steinbacher IBM, Tony Erwin IBM, Andriy Miranskyy Ryerson University
Pre-print Media Attached
07:30
20m
Paper
Smart Build Targets Batching Service at GoogleSEIP
SEIP - Software Engineering in Practice
Kaiyuan Wang Google, USA, Daniel Rall Google, Greg Tener Google, Vijay Gullapalli Google, Xin Huang , Ahmed Gad Google
Pre-print Media Attached