Domain-Specific Fixes for Flaky Tests with Wrong Assumptions on Underdetermined SpecificationsTechnical Track
Fri 28 May 2021 03:25 - 03:45 at Blended Sessions Room 2 - 3.3.2. API: Development
Library developers can provide classes and methods with underdetermined specifications that allow flexibility in future implementations. Library users may write code that relies on a specific implementation rather than on the specification, e.g., assuming mistakenly that the order of elements cannot change in the future. Prior work proposed the NonDex approach that detects such wrong assumptions.
We present a novel approach, called DexFix, to repair wrong assumptions on underdetermined specifications in an automated way. We run the NonDex tool on 200 open-source Java projects and detect 275 tests that fail due to wrong assumptions. The majority of failures are from iterating over HashMap/HashSet collections and the getDeclaredFields method. We provide several new repair strategies that can fix these violations in both the test code and the main code. We implement our strategies in a prototype DexFix tool. Our experiments show that DexFix can fix 119 tests from our sample of 275 tests. We have already reported 102 fixes as GitHub pull requests: 64 have been merged, with only 5 rejected, and the remaining pending.
Thu 27 MayDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
15:05 - 16:05 | 3.3.2. API: Development Technical Track / SEIP - Software Engineering in Practice at Blended Sessions Room 2 +12h Chair(s): Carolyn Seaman University of Maryland Baltimore County | ||
15:05 20mPaper | Unveiling the Mystery of API Evolution in Deep Learning Frameworks -- A Case Study of Tensorflow 2SEIP SEIP - Software Engineering in Practice Zejun Zhang Zhejiang University, Yanming Yang Monash University, Xin Xia Huawei Software Engineering Application Technology Lab, David Lo Singapore Management University, Xiaoxue Ren Zhejiang University, John Grundy Monash University Pre-print Media Attached | ||
15:25 20mPaper | Domain-Specific Fixes for Flaky Tests with Wrong Assumptions on Underdetermined SpecificationsTechnical Track Technical Track Peilun Zhang University of Illinois at Urbana-Champaign, Yanjie Jiang Beijing Institute of Technology, Anjiang Wei Peking University, Victoria Stodden University of Illinois at Urbana-Champaign, Darko Marinov University of Illinois at Urbana-Champaign, August Shi The University of Texas at Austin Pre-print Media Attached | ||
15:45 20mPaper | Studying Test Annotation Maintenance in the WildTechnical Track Technical Track Dong Jae Kim Concordia University, Nikolaos Tsantalis Concordia University, Tse-Hsun (Peter) Chen Concordia University, Jinqiu Yang Concordia University Link to publication Pre-print Media Attached |
Fri 28 MayDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
03:05 - 04:05 | 3.3.2. API: Development SEIP - Software Engineering in Practice / Technical Track at Blended Sessions Room 2 | ||
03:05 20mPaper | Unveiling the Mystery of API Evolution in Deep Learning Frameworks -- A Case Study of Tensorflow 2SEIP SEIP - Software Engineering in Practice Zejun Zhang Zhejiang University, Yanming Yang Monash University, Xin Xia Huawei Software Engineering Application Technology Lab, David Lo Singapore Management University, Xiaoxue Ren Zhejiang University, John Grundy Monash University Pre-print Media Attached | ||
03:25 20mPaper | Domain-Specific Fixes for Flaky Tests with Wrong Assumptions on Underdetermined SpecificationsTechnical Track Technical Track Peilun Zhang University of Illinois at Urbana-Champaign, Yanjie Jiang Beijing Institute of Technology, Anjiang Wei Peking University, Victoria Stodden University of Illinois at Urbana-Champaign, Darko Marinov University of Illinois at Urbana-Champaign, August Shi The University of Texas at Austin Pre-print Media Attached | ||
03:45 20mPaper | Studying Test Annotation Maintenance in the WildTechnical Track Technical Track Dong Jae Kim Concordia University, Nikolaos Tsantalis Concordia University, Tse-Hsun (Peter) Chen Concordia University, Jinqiu Yang Concordia University Link to publication Pre-print Media Attached |