Write a Blog >>
AST 2021
Fri 28 - Sat 29 May 2021
co-located with ICSE 2021
Fri 21 May 2021 15:45 - 16:15 at AST Room - Testing for Specific Domains - 2 Chair(s): Alejandra Garrido

Flaw-finding static analysis tools typically generate large volumes of code flaw alerts including many false positives. To save on human effort to triage these alerts, a significant body of work attempts to use machine learning to classify and prioritize alerts. Identifying a useful set of training data, however, remains a fundamental challenge in developing such classifiers in many contexts. We propose using static analysis test suites (i.e., repositories of benchmark programs that are purpose-built to test static analysis tools) as a novel source of training data. Specifically, we generated a large quantity of alerts by executing various static analyzers on the Juliet test suite, and we automatically derived ground truth labels for these alerts by referencing the Juliet test suite metadata. Finally, we used this data to train classifiers to predict whether an alert is a false positive. Our classifiers obtained high precision and recall for a large number of code flaw types on a hold-out test set. This preliminary result suggests that pre-training classifiers on test suite data could help to jumpstart static analysis alert classification in data-limited contexts.

Fri 21 May

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

15:00 - 16:15
Testing for Specific Domains - 2AST 2021 at AST Room
Chair(s): Alejandra Garrido LIFIA, University of La Plata & CONICET, Argentina
15:00
15m
Short-paper
Automated User Experience Testing through Multi-Dimensional Performance Impact Analysis
AST 2021
Chidera Biringa University of Massachusetts, Gokhan Kul University of Massachusetts Dartmouth
Pre-print Media Attached
15:15
30m
Long-paper
A Survey of Video Game Testing
AST 2021
Cristiano Politowski Concordia University, Fabio Petrillo Université du Québec à Chicoutimi, Canada, Yann-Gaël Guéhéneuc Concordia University and Polytechnique Montréal
Pre-print Media Attached
15:45
30m
Long-paper
Test suites as a source of training data for static analysis alert classifiers
AST 2021
Pre-print Media Attached

Information for Participants
Fri 21 May 2021 15:00 - 16:15 at AST Room - Testing for Specific Domains - 2 Chair(s): Alejandra Garrido
Info for room AST Room:

Go directly to this room on Clowdr