Write a Blog >>
ICSE 2021
Mon 17 May - Sat 5 June 2021

Combinatorial interaction testing (CIT) is an important technique for testing highly configurable software systems with demonstrated effectiveness in practice. The goal of CIT is to generate test cases covering the interactions of configuration options, under certain hard constraints. In this context, constrained covering arrays (CCAs) are frequently used as test cases in CIT. Constrained Covering Array Generation (CCAG) is an NP-hard combinatorial optimization problem, solving which requires an effective method for generating small CCAs. In particular, effectively solving t-way CCAG with t>=4 is even more challenging. Inspired by the success of automated algorithm configuration and automated algorithm selection in solving combinatorial optimization problems, in this paper, we investigate the efficacy of automated algorithm configuration and automated algorithm selection for the CCAG problem, and propose a novel, automated CCAG approach called AutoCCAG. Extensive experiments on public benchmarks show that AutoCCAG can find much smaller-sized CCAs than current state-of-the-art approaches, indicating the effectiveness of AutoCCAG. More encouragingly, to our best knowledge, our paper reports the first results for CCAG with a high coverage strength (i.e., 5-way CCAG) on public benchmarks. Our results demonstrate that AutoCCAG can bring considerable benefits in testing highly configurable software systems.

Wed 26 May

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

12:55 - 13:55
2.2.2. Configuration of Software Systems: TestingTechnical Track / SEIP - Software Engineering in Practice at Blended Sessions Room 2 +12h
Chair(s): Antonia Bertolino CNR-ISTI
12:55
20m
Paper
An Evolutionary Study of Configuration Design and Implementation in Cloud SystemsArtifact ReusableTechnical Track
Technical Track
Yuanliang Zhang National University of Defense Technology, Haochen He National University of Defense Technology, Owolabi Legunsen Cornell University, Shanshan Li National University of Defense Technology, Wei Dong National University of Defense Technology, Tianyin Xu University of Illinois Urbana-Champaign
Pre-print Media Attached File Attached
13:15
20m
Paper
AutoCCAG: An Automated Approach to Constrained Covering Array GenerationTechnical Track
Technical Track
Chuan Luo Microsoft Research, China, Jinkun Lin State Key Laboratory of Computer Science, Institute of Software, Chinese Academy of Sciences, China, Shaowei Cai Institute of Software at Chinese Academy of Sciences, China, Xin Chen Microsoft Research, China, Bing He Microsoft Research, China, Bo Qiao Microsoft Research, Beijing, China, Pu Zhao Microsoft Research, Beijing, China, Qingwei Lin Microsoft Research, Beijing, China, Hongyu Zhang The University of Newcastle, Wei Wu L3S Research Center, Leibniz University Hannover, Germany, Saravanakumar Rajmohan Microsoft Office, United States, Dongmei Zhang Microsoft Research
Pre-print Media Attached
13:35
20m
Paper
ConfigFix: Interactive Configuration Conflict Resolution for the Linux KernelSEIP
SEIP - Software Engineering in Practice
Patrick Franz Chalmers | University of Gothenburg, Thorsten Berger Chalmers | University of Gothenburg, Ibrahim Fayaz VecScan AB (Vector Sweden), Sarah Nadi University of Alberta, Evgeny Groshev Chalmers | University of Gothenburg
Pre-print Media Attached

Thu 27 May

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

00:55 - 01:55
2.2.2. Configuration of Software Systems: TestingSEIP - Software Engineering in Practice / Technical Track at Blended Sessions Room 2
00:55
20m
Paper
An Evolutionary Study of Configuration Design and Implementation in Cloud SystemsArtifact ReusableTechnical Track
Technical Track
Yuanliang Zhang National University of Defense Technology, Haochen He National University of Defense Technology, Owolabi Legunsen Cornell University, Shanshan Li National University of Defense Technology, Wei Dong National University of Defense Technology, Tianyin Xu University of Illinois Urbana-Champaign
Pre-print Media Attached File Attached
01:15
20m
Paper
AutoCCAG: An Automated Approach to Constrained Covering Array GenerationTechnical Track
Technical Track
Chuan Luo Microsoft Research, China, Jinkun Lin State Key Laboratory of Computer Science, Institute of Software, Chinese Academy of Sciences, China, Shaowei Cai Institute of Software at Chinese Academy of Sciences, China, Xin Chen Microsoft Research, China, Bing He Microsoft Research, China, Bo Qiao Microsoft Research, Beijing, China, Pu Zhao Microsoft Research, Beijing, China, Qingwei Lin Microsoft Research, Beijing, China, Hongyu Zhang The University of Newcastle, Wei Wu L3S Research Center, Leibniz University Hannover, Germany, Saravanakumar Rajmohan Microsoft Office, United States, Dongmei Zhang Microsoft Research
Pre-print Media Attached
01:35
20m
Paper
ConfigFix: Interactive Configuration Conflict Resolution for the Linux KernelSEIP
SEIP - Software Engineering in Practice
Patrick Franz Chalmers | University of Gothenburg, Thorsten Berger Chalmers | University of Gothenburg, Ibrahim Fayaz VecScan AB (Vector Sweden), Sarah Nadi University of Alberta, Evgeny Groshev Chalmers | University of Gothenburg
Pre-print Media Attached