Write a Blog >>
SEAMS 2021
Tue 18 - Fri 21 May 2021
co-located with ICSE 2021

With the increase of research in self-adaptive systems, there is a need to better understand the way research contributions are evaluated. Such insights will support researchers to better compare new findings when developing new knowledge for the community. However, so far there is no clear overview of how evaluations are performed in self-adaptive systems. To address this gap, we conduct a mapping study. The study focuses on experimental evaluations published in the last decade at the prime venue of research in software engineering for self-adaptive systems – the International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS). Results point out that specifics of self-adaptive systems require special attention in the experimental process, including the distinction of the managing system (i.e., the target of evaluation) and the managed system, the presence of uncertainties that affect the system behavior and hence need to be taken into account in data analysis, and the potential of managed systems to be reused across experiments, beyond replications. To conclude, we offer a set of suggestions derived from our study that can be used as input to enhance future experiments in self-adaptive systems.

Fri 21 May

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

14:30 - 15:25
Session 7: Core Approaches for Self-adaptationSEAMS 2021 at SEAMS Room
Chair(s): Genaina Rodrigues University of Brasilia
14:30
5m
Paper
How do we Evaluate Self-adaptive Software Systems?Long Paper
SEAMS 2021
Ilias Gerostathopoulos Vrije Universiteit Amsterdam, Thomas Vogel Humboldt-Universität zu Berlin, Danny Weyns KU Leuven, Patricia Lago Vrije Universiteit Amsterdam
Pre-print Media Attached
14:35
5m
Paper
Threat models at run time: the case for reflective and adaptive threat managementShort Paper
SEAMS 2021
Dimitri Van Landuyt Katholieke Universiteit Leuven, Liliana Pasquale University College Dublin & Lero, Laurens Sion imec-DistriNet, KU Leuven, Wouter Joosen Katholieke Universiteit Leuven
Media Attached
14:40
5m
Paper
Incremental Runtime Model Queries and Adaptive MonitoringShort Paper
SEAMS 2021
Matthias Barkowsky Hasso Plattner Institute, University of Potsdam, Germany, Thomas Brand , Holger Giese Hasso Plattner Institute, University of Potsdam
Media Attached
14:45
5m
Paper
RDMSim: An Exemplar for Evaluation and Comparison of Decision-Making Techniques for Self-AdaptationArtifact Paper
SEAMS 2021
Huma Samin , Cesar M. Carranza Hurtado , Luis H. Garcia Paucar , Nelly Bencomo Aston University, Erik Fredericks Grand Valley State University
Pre-print Media Attached
14:50
35m
Live Q&A
Session 7 - Discussion
SEAMS 2021

Media Attached

Information for Participants
Fri 21 May 2021 14:30 - 15:25 at SEAMS Room - Session 7: Core Approaches for Self-adaptation Chair(s): Genaina Rodrigues
Info for room SEAMS Room:

Go directly to this room on Clowdr