RENE - Replications and Negative Results

This track provides a venue for researchers to submit (i) replications of all types of empirical studies related to Search-Based Software Engineering, and (ii) original works reporting negative results on any of the topics of interest for the SSBSE conference (see the main Research track).

NIER - New Ideas and Emerging Results

The New Ideas and Emerging Results Track at SSBSE 2023 is a forum to present and get feedback on forward-looking, innovative ideas in the Search-Based Software Engineering (SBSE) field. This forum provides an opportunity for researchers to present and gather feedback on groundbreaking results, tools under development, experience reports, or position papers. The track provides an opportunity for researchers to introduce ideas that challenge the status-quo in the SBSE community, start a discussion, and receive feedback on new research ideas or results in an early stage of investigation. Early career researchers and Ph.D. students are particularly encouraged to present inspiring research efforts that push the boundaries of SBSE.

Tracks
You're viewing the program in a time zone which is different from your device's time zone change time zone

Fri 8 Dec

Displayed time zone: Pacific Time (US & Canada) change

10:10 - 10:50
Session 1Challenge Track at Foothill E
Chair(s): Erik Fredericks Grand Valley State University
10:10
20m
Talk
StableYolo: Optimizing Image Generation for Large Language Models
Challenge Track
Harel Berger , Aidan Dakhama King's College London, Zishuo Ding University of Waterloo, Karine Even-Mendoza King’s College London, David Kelly , Hector Menendez , Rebecca Moussa University College London, Federica Sarro University College London
10:30
20m
Talk
Improving the Readability of Generated Tests Using GPT-4 and ChatGPT Code Interpreter
Challenge Track
Gregory Gay Chalmers | University of Gothenburg
11:20 - 12:35
Session 2Hot off the Press / Challenge Track at Foothill E
Chair(s): Aitor Arrieta Mondragon University
11:20
20m
Talk
Evaluating Explanations for Software Patches Generated by Large Language Models
Challenge Track
Dominik Sobania , Alina Geiger , James Callan UCL, Alexander E.I. Brownlee University of Stirling, Carol Hanna University College London, Rebecca Moussa University College London, Mar Zamorano López , Justyna Petke University College London, Federica Sarro University College London
11:40
20m
Talk
Enhancing Genetic Improvement Mutations Using Large Language Models
Challenge Track
Alexander E.I. Brownlee University of Stirling, James Callan UCL, Karine Even-Mendoza King’s College London, Alina Geiger , Carol Hanna University College London, Justyna Petke University College London, Federica Sarro University College London, Dominik Sobania
12:00
20m
Talk
SearchGEM5: Towards Reliable gem5 with Search Based Software Testing and Large Language Models
Challenge Track
Aidan Dakhama King's College London, Karine Even-Mendoza King’s College London, William B. Langdon University College London, Hector Menendez King’s College London, Justyna Petke University College London
12:20
15m
Talk
SSBSE Summary of Neuroevolution-based Generation of Tests and Oracles for Games
Hot off the Press
Patric Feldmeier University of Passau, Gordon Fraser University of Passau
14:00 - 15:15
Session 3Research Papers / Hot off the Press / RENE / NIER at Foothill E
Chair(s): Bobby Bruce University of California at Davis, USA
14:00
20m
Talk
Generating Android Tests using Novelty Search
Research Papers
Michael Auer University of Passau, Michael Pusl , Gordon Fraser University of Passau
14:20
15m
Talk
Search-based Optimisation of LLM Learning Shots for Story Point Estimation
RENE / NIER
Vali Tawosi J.P. Morgan AI Research, Salwa Alamir J.P. Morgan AI Research, Xiaomo Liu
14:35
20m
Talk
A Novel Mutation Operator for Search-based Test Case Selection
Research Papers
Aitor Arrieta Mondragon University, Miren Illarramendi Mondragon University
14:55
15m
Talk
SSBSE Summary of .NET/C# Instrumentation for Search-Based Software Testing
Hot off the Press
Amid Golmohammadi Kristiania University College, Man Zhang Kristiania University, Andrea Arcuri Kristiania University College and Oslo Metropolitan University
15:45 - 17:05
Session 4Research Papers at Foothill E
Chair(s): Erik Fredericks Grand Valley State University
15:45
20m
Talk
Expound: A Black-box Approach for Generating Diversity-Driven Adversarial Examples
Research Papers
Kenneth Chan , Betty H.C. Cheng Michigan State University
16:05
20m
Talk
Search-Based Mock Generation of External Web Service Interactions
Research Papers
Susruthan Seran Kristiania University College, Man Zhang Kristiania University, Andrea Arcuri Kristiania University College and Oslo Metropolitan University
16:25
20m
Talk
Developer Views on Software Carbon Footprint and its Potential for Automated Reduction
Research Papers
Haozhou Lyu Chalmers University of Technology, Gregory Gay Chalmers | University of Gothenburg, Maiko Sakamoto
16:45
20m
Talk
Exploring Genetic Improvement of the Carbon Footprint of Web Pages
Research Papers
Haozhou Lyu Chalmers University of Technology, Gregory Gay Chalmers | University of Gothenburg, Maiko Sakamoto
17:30 - 18:10
Session 5RENE / NIER at Foothill E
Chair(s): Erik Fredericks Grand Valley State University
17:30
20m
Talk
On the Impact of Tool Evolution and Case Study Size on SBSE Experiments: A Replicated Study with EvoMaster
RENE / NIER
Amid Golmohammadi Kristiania University College, Man Zhang Kristiania University, Andrea Arcuri Kristiania University College and Oslo Metropolitan University
17:50
20m
Talk
Multi-Objective Black-box Test Case Prioritization based on WordNet Distances
RENE / NIER
Imara van Dinten Delft University of Technology, Andy Zaidman Delft University of Technology, Annibale Panichella Delft University of Technology
DOI Pre-print

Call for Papers

NIER Track - New Ideas and Emerging Results

The New Ideas and Emerging Results Track is a forum to present and get feedback on forward-looking, innovative ideas in the Search-Based Software Engineering field. This forum provides an opportunity for researchers to present and gather feedback on groundbreaking results, tools under development, experience reports, or position papers. The track provides an opportunity for researchers to introduce ideas that challenge the status-quo in the SBSE community, start a discussion, and receive feedback on new research ideas or results in an early stage of investigation. Early career researchers and Ph.D. students are particularly encouraged to present inspiring research efforts that push the boundaries of SBSE. However, researchers at all levels are invited to submit.

You are encouraged to submit your work that provides:

  • Innovative results that may open new research directions in SBSE;
  • New ideas that can be further explored by emerging SBSE community;
  • Perspectives that call into question long held beliefs or conventions;
  • Visions of new directions in SBSE; and,
  • Novel interdisciplinary synergies.

Papers submitted to the NIER Track should address the following questions:

  • Why is the problem worth exploring?
  • What is the potential for disruption of current practice?
  • What makes the approach original?
  • Is the proposed approach sound and feasible?
  • Has the relevant literature been covered?

RENE Track - Replications and Negative Results

The Replications and Negative Results Track provides a venue for researchers to submit replications of all types of empirical studies related to Search-Based Software Engineering, and original works reporting negative results on any of the topics of interest for the research track of the SSBSE conference.

Replications: Replications can either strengthen the results of the original study by increasing external validity with additional data or provide new insights into the variables that may impact the results. Papers can report replications of the author’s own work or replications of another researcher’s work. If the experiments have been replicated and reproduced either partially or fully, the RENE track is the right venue to submit your findings.

Replication papers should describe any changes to the original study design made during the replication, along with a justification for each change. The papers should contain a discussion section that compares the findings of the original and replication studies and describe the new knowledge gained and lessons learned from the replication. Partial replications are also welcome as long as the paper clearly states which parts of the study were replicated and which parts are new. When possible, i.e., when not dealing with proprietary artifacts, papers should provide links to the artifacts that they are reusing and to the artifacts built in their work to allow verifiability.

Negative Results: We also welcome negative results papers as we believe they are important contributions to scientific knowledge because they allow us to constantly evaluate our hypothesis space and understanding of the current approaches. We welcome all types of empirical studies (controlled experiments, case studies, etc.) and all types of analyses (quantitative and qualitative) that show negative results. Papers must provide details and rationale for the type of analysis performed to show the validity of the chosen path. Of particular importance is the discussion of the implications of the results on the SSBSE community and of the future directions that should be considered.


Format and Submission

  • Submissions for the NIER Track should not exceed 6 pages in length, including all text, figures, appendices and references.
  • Submissions for the RENE Track can be either full papers (15 pages in length, including everything) or short papers (6 pages in length, including everything). Full papers are expected to describe a fully or partially replicated study or an original study reporting negative results. Short papers can report on work in progress or preliminary experimental designs with the intention of running the full study in the near future.

We suggest that authors follow the ACM SIGSOFT standard for optimization studies in SE (direct link to standard) in developing their methodology and submissions. Following these guidelines will improve the quality, trustworthiness, and reproducibility of your research.

All papers should be prepared for double-anonymous review following the symposium’s general instructions. Please, refer to the “Format and submission” section of the Research Track for further details.

Papers must not have been previously published, or be in consideration for any journal, book, or other conferences. Papers will be evaluated by members of the program committee of each track based on their originality, technical soundness, and presentation quality. Submissions must conform to Springer’s LNCS format (http://www.springer.com/lncs). If a paper is accepted, at least one author is expected to attend the symposium and present the paper. In the case of a student paper, the first (student) author is expected to attend and present the paper. All accepted papers will be published in the conference proceedings.

Papers can be submitted at https://ssbse23rene-nier.hotcrp.com/.

Special Issue for Best Papers

Following the conference, the authors of the best manuscripts in the RENE sub-track will be invited to extend their papers for a special section on Advances in Search-Based Software Engineering at the Automated Software Engineering journal. Details may be found at https://ause-journal.github.io/23ssbse.html.