AutoCCAG: An Automated Approach to Constrained Covering Array GenerationTechnical Track
Thu 27 May 2021 01:15 - 01:35 at Blended Sessions Room 2 - 2.2.2. Configuration of Software Systems: Testing
Combinatorial interaction testing (CIT) is an important technique for testing highly configurable software systems with demonstrated effectiveness in practice. The goal of CIT is to generate test cases covering the interactions of configuration options, under certain hard constraints. In this context, constrained covering arrays (CCAs) are frequently used as test cases in CIT. Constrained Covering Array Generation (CCAG) is an NP-hard combinatorial optimization problem, solving which requires an effective method for generating small CCAs. In particular, effectively solving t-way CCAG with t>=4 is even more challenging. Inspired by the success of automated algorithm configuration and automated algorithm selection in solving combinatorial optimization problems, in this paper, we investigate the efficacy of automated algorithm configuration and automated algorithm selection for the CCAG problem, and propose a novel, automated CCAG approach called AutoCCAG. Extensive experiments on public benchmarks show that AutoCCAG can find much smaller-sized CCAs than current state-of-the-art approaches, indicating the effectiveness of AutoCCAG. More encouragingly, to our best knowledge, our paper reports the first results for CCAG with a high coverage strength (i.e., 5-way CCAG) on public benchmarks. Our results demonstrate that AutoCCAG can bring considerable benefits in testing highly configurable software systems.
Wed 26 MayDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
12:55 - 13:55 | 2.2.2. Configuration of Software Systems: TestingTechnical Track / SEIP - Software Engineering in Practice at Blended Sessions Room 2 +12h Chair(s): Antonia Bertolino CNR-ISTI | ||
12:55 20mPaper | An Evolutionary Study of Configuration Design and Implementation in Cloud SystemsTechnical Track Technical Track Yuanliang Zhang National University of Defense Technology, Haochen He National University of Defense Technology, Owolabi Legunsen Cornell University, Shanshan Li National University of Defense Technology, Wei Dong National University of Defense Technology, Tianyin Xu University of Illinois Urbana-Champaign Pre-print Media Attached File Attached | ||
13:15 20mPaper | AutoCCAG: An Automated Approach to Constrained Covering Array GenerationTechnical Track Technical Track Chuan Luo Microsoft Research, China, Jinkun Lin State Key Laboratory of Computer Science, Institute of Software, Chinese Academy of Sciences, China, Shaowei Cai Institute of Software at Chinese Academy of Sciences, China, Xin Chen Microsoft Research, China, Bing He Microsoft Research, China, Bo Qiao Microsoft Research, Beijing, China, Pu Zhao Microsoft Research, Beijing, China, Qingwei Lin Microsoft Research, Beijing, China, Hongyu Zhang The University of Newcastle, Wei Wu L3S Research Center, Leibniz University Hannover, Germany, Saravanakumar Rajmohan Microsoft Office, United States, Dongmei Zhang Microsoft Research Pre-print Media Attached | ||
13:35 20mPaper | ConfigFix: Interactive Configuration Conflict Resolution for the Linux KernelSEIP SEIP - Software Engineering in Practice Patrick Franz Chalmers | University of Gothenburg, Thorsten Berger Chalmers | University of Gothenburg, Ibrahim Fayaz VecScan AB (Vector Sweden), Sarah Nadi University of Alberta, Evgeny Groshev Chalmers | University of Gothenburg Pre-print Media Attached |
Thu 27 MayDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
00:55 - 01:55 | 2.2.2. Configuration of Software Systems: TestingSEIP - Software Engineering in Practice / Technical Track at Blended Sessions Room 2 | ||
00:55 20mPaper | An Evolutionary Study of Configuration Design and Implementation in Cloud SystemsTechnical Track Technical Track Yuanliang Zhang National University of Defense Technology, Haochen He National University of Defense Technology, Owolabi Legunsen Cornell University, Shanshan Li National University of Defense Technology, Wei Dong National University of Defense Technology, Tianyin Xu University of Illinois Urbana-Champaign Pre-print Media Attached File Attached | ||
01:15 20mPaper | AutoCCAG: An Automated Approach to Constrained Covering Array GenerationTechnical Track Technical Track Chuan Luo Microsoft Research, China, Jinkun Lin State Key Laboratory of Computer Science, Institute of Software, Chinese Academy of Sciences, China, Shaowei Cai Institute of Software at Chinese Academy of Sciences, China, Xin Chen Microsoft Research, China, Bing He Microsoft Research, China, Bo Qiao Microsoft Research, Beijing, China, Pu Zhao Microsoft Research, Beijing, China, Qingwei Lin Microsoft Research, Beijing, China, Hongyu Zhang The University of Newcastle, Wei Wu L3S Research Center, Leibniz University Hannover, Germany, Saravanakumar Rajmohan Microsoft Office, United States, Dongmei Zhang Microsoft Research Pre-print Media Attached | ||
01:35 20mPaper | ConfigFix: Interactive Configuration Conflict Resolution for the Linux KernelSEIP SEIP - Software Engineering in Practice Patrick Franz Chalmers | University of Gothenburg, Thorsten Berger Chalmers | University of Gothenburg, Ibrahim Fayaz VecScan AB (Vector Sweden), Sarah Nadi University of Alberta, Evgeny Groshev Chalmers | University of Gothenburg Pre-print Media Attached |