The objective of the ASE 2023 Tool Demonstrations Track is to excite the software engineering community about new advances in our field through compelling demonstrations that help advance research and practice. The track is a highly interactive venue where researchers and practitioners can demonstrate their tools and discuss them with attendees.
Highlighting scientific contributions through concrete artifacts is a critical supplement to the traditional ASE research papers. A demonstration provides the opportunity to communicate how the scientific approach has been implemented or how a specific hypothesis has been assessed, including details such as implementation and usage issues, data models and representations, APIs for tool and data access. Authors of regular research papers are thus encouraged to submit an accompanying tool demonstration paper, stating clearly the contributions of the tool paper over the research paper. We also encourage tool demonstrations that focus on real-world applicability of the underlying ideas, e.g., by references to industrial case studies.
The solicited topics and the submission process will be announced soon.
Call for Ppaers
The ASE 2023 Demonstrations Track invites researchers and practitioners to present and discuss the most recent advances, experiences, and challenges in the field of software engineering supported by live presentations of new research tools, data, and other artifacts. We encourage innovative research demonstrations, which show early implementations of novel software engineering concepts, as well as mature prototypes. The research demonstrations are intended to highlight underlying scientific contributions.
Whereas a regular research paper points out the scientific contribution of a new software engineering approach, a demonstration paper provides the opportunity to show how a scientific contribution has been transferred into a working tool or data set. Authors of regular research papers are thus encouraged to submit an accompanying demonstration paper. Submissions of independent tools that are not associated with any research papers are welcome.
Papers submitted to the tool demonstration track should describe (a) novel early tool prototypes or (b) novel aspects of mature tools. The submissions must clearly communicate the following information to the audience:
- the envisioned users;
- the software engineering challenge the tool addresses;
- the methodology it implies for its users;
- the results of validation studies already conducted (for mature tools) or the design of planned studies (for early prototypes).
Submission
Papers must be submitted electronically through the HotCRP submission site by Fri 26 May 2023, and must:
- All submissions must be in PDF format and conform, at time of submission, to the IEEE Conference Proceedings Formatting Guidelines (title in 24pt font and full text in 10pt type, LaTeX users must use
\documentclass[10pt,conference]{IEEEtran}
without including thecompsoc
orcompsocconf
option). - All submissions must be in English.
- A demonstration submission must not exceed four pages (including all text, references, and figures);
- Authors are encouraged to submit a screencast of the tool as an appendix.
- Authors are encouraged to make their code and datasets open source and to provide a URL for the code and datasets with the submission;
- A submission must not have been previously published in a demonstration form and must not simultaneously be submitted to another symposium other than ASE;
- Submissions for the tool track do NOT follow a double-blind review process. If a tool track submission accompanies a submission to the research track (which is double-blind), please email the tool demonstration track chairs, notifying them about this. The chairs will ensure that tool papers and research papers are reviewed by different people to avoid revealing the authorship of research papers.
Tools and Data Availability
To promote replicability and to disseminate the advances achieved with the research tools and data sets, we require that data sets are publicly available for download and use. We strongly encourage the same for tools, ideally through their distribution with an open-source software license. Whenever the tool is not made publicly available, the paper must include a clear explanation for why this was not possible.
Authors are also encouraged to distribute their demonstration in a form that can be easily used, such as a virtual machine image, a software container (e.g., Docker), or a system configuration (e.g., Puppet, Ansible, Salt, CFEngine).
Screencast
To further increase the visibility of the presented tools and data sets, we require all authors to produce a screencast presenting their tool. For the papers that will be accepted for presentation, accompanying screencasts will be linked from the demonstration track website. The authors can submit a link to the screencast together with their papers as an appendix that describes the way the demonstration will be carried out.Evaluation
Each submission will be reviewed by at least three members of the tool demonstrations program committee. The evaluation criteria include:- the relevance of the proposed tool for the ASE audience;
- the technical soundness of the demonstrated tool;
- the originality of its underlying ideas;
- the degree to which the submission considers the relevant literature;
- the quality and usefulness of the accompanied artifacts: video, tool, code, and evaluation datasets.
For further information, please feel free to contact the track chairs.