Write a Blog >>
MET 2021
Wed 2 Jun 2021
co-located with ICSE 2021

Metamorphic testing requires the availability of a suitable set of metamorphic relations (MRs) for the application domain of interest. A software testing practitioner interested in using metamorphic testing is thus blocked unless they can devise a suitable set of MRs. In this paper we offer some practical advice on sources of inspiration for MRs, based on our experience building three fuzzing tools based on metamorphic testing: MRC++, which supports automated testing of C++11 libraries, C4, which tests concurrency support in C11 compilers, and spirv-fuzz, which aims to find bugs in compilers for the SPIR-V programming language (mainly used in computer graphics). The MRs we have devised have taken inspiration from three main sources: (1) careful study of specification documents related to the libraries and programming languages that these tools target, (2) consultation of prior work and discussion with domain experts, and (3) manual inspection of the results of automated code coverage analysis on the systems under test. We describe these sources of inspiration in detail, giving a range of concrete examples for each. We hope that this experience report will help to inform developers of future metamorphic testing tools as to the steps they can take to discover MRs in their domains of interest.

Wed 2 Jun

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

18:00 - 19:20
Session 4: Safety and Security and Simulation and Metamorphic RelationsMET 2021 at MET Room
Chair(s): Sergio Segura Universidad de Sevilla
18:00
30m
Long-paper
Applying Metamorphic Testing to Homomorphic Cryptography
MET 2021
Melvin Wolf Jacobs University Bremen, Jürgen Schönwälder Jacobs University Bremen
Media Attached
18:30
20m
Short-paper
Towards Automated Metamorphic Test identification for Ocean System Models
MET 2021
Dilip Jagadeeshwarswamy Hiremath GEOMAR, Helmholtz Centre for Ocean Research and Kiel University, Martin Claus GEOMAR, Helmholtz Centre for Ocean Research and Kiel University, Wilhelm Hasselbring Kiel University, Willi Rath GEOMAR, Helmholtz Centre for Ocean Research
Media Attached
18:50
30m
Long-paper
Dreaming up Metamorphic Relations: Experiences from Three Fuzzer ToolsBest MET Paper Award
MET 2021
Andrei Lascu Imperial College London, Matt Windsor Imperial College London, Alastair F. Donaldson Imperial College London, Tobias Grosser University of Edinburgh, John Wickerson Imperial College London
Media Attached

Information for Participants