ICST 2023
Sun 16 - Thu 20 April 2023 Dublin, Ireland

This page will 6th IEEE Workshop on NEXt level of Test Automation

NEXTA

Find full CFP here: http://www.wikicfp.com/cfp/servlet/event.showcfp?eventid=169930

Theme and Goals

NEXTA’23 is the sixth edition of the IEEE Workshop on Test Automation - highly relevant for both research and industry. Thus, NEXTA aims to attract both academic researchers and industry practitioners. Test automation has been an acknowledged software engineering best practice for years. However, the topic involves more than the repeated execution of test cases that often comes first to mind. Simply running test cases using a unit testing framework is no longer enough for test automation to keep up with the ever-shorter release cycles driven by continuous deployment and technological innovations such as microservices and DevOps pipelines. Now test automation needs to rise to the next level by going beyond mere test execution. The NEXTA workshop will explore how to advance test automation to further contribute to software quality in the context of tomorrow’s rapid release cycles. Take-aways for industry practitioners and academic researchers will encompass test case generation, automated test result analysis, test suite assessment and maintenance, and infrastructure for the future of test automation.

Topics of Interest

NEXTA solicits contributions targeting all aspects of test automation, from initial test design to automated verdict analysis. Topics of interest include, but are not limited to, the following:

  • Test execution automation
  • Test case generation
  • Automatic test design generation
  • Analytics, learning, and big data in relation to test automation
  • Automatic aspects management in test, progress, reporting, planning, etc.
  • Visualization of test
  • Evolution of test automation
  • Test suite architecture and infrastructure
  • Test environment, simulation, and other contextual issues for automated testing
  • Test tools, frameworks, and general support for test automation
  • Testing in an agile and continuous integration context, and testing within DevOps
  • Orchestration of test
  • Metrics, benchmarks, and estimation on any type of test automation
  • Any type of test technologies relying on automation of test
  • Process improvements and assessments related to test automation
  • Test automation maturity and experience reports on test automation
  • Automatic retrieval of test data and test preparation aspect
  • Maintainability, monitoring, and refactoring of automated test suites
  • Training and education on automated testing
  • Automated test for product lines and high-variability systems
  • Test automation patterns
  • Automated test oracle soon grows in content and contains information about the scope of this research track.

NEXTA solicits the following types of original papers:

  • Technical Papers (max. 8 pages in IEEE format). Full papers presenting research results or industrial practices related to the next generation of test automation.
  • Position and Experience Papers (max. 4 pages in IEEE format). Short papers introducing challenges, visions, positions, or preliminary results within the scope of the workshop. -
  • Experience reports and papers on open challenges in the industry are especially welcome.
  • Tool Papers (max. 4 pages in IEEE format). Tool papers introduce tools that implement an approach to support the transition to the next generation of test automation. A tool paper submission must include either 1) a URL to a screencast of the tool in action, or 2) a runnable version of the tool for evaluation by the program committee.

For more info, please contact: Leo Hatvani, Organization Co-chair, Leo.hatvani@mdu.se

Plenary
You're viewing the program in a time zone which is different from your device's time zone change time zone

Thu 20 Apr

Displayed time zone: Dublin change

09:00 - 10:30
Session 1NEXTA at Grand canal
Chair(s): Sahar Tahvili Ericsson AB

Welcome by the General Chair

09:00
15m
Day opening
Welcome by the General Chair
NEXTA
Sahar Tahvili Ericsson AB
09:15
45m
Keynote
What's Next After AI-driven Conversational Test Automation?
NEXTA
Robert Feldt Chalmers | University of Gothenburg, Blekinge Institute of Technology
10:00
30m
Research paper
Test Cost Reduction for 5G and Beyond using Machine Learning
NEXTA
10:30 - 11:00
Coffee breakSocial
10:30
30m
Coffee break
Break
Social

11:00 - 12:30
Session 2NEXTA at Grand canal
Chair(s): Kristian Sandahl Linköping University
11:00
30m
Research paper
Systematically Generated Formulas for Spectrum-Based Fault Localization
NEXTA
Qusay Idrees Sarhan Department of Software Engineering, University of Szeged, Tamás Gergely Department of Software Engineering, University of Szeged, Árpád Beszédes Department of Software Engineering, University of Szeged
11:30
30m
Research paper
An Intelligent Monitoring Algorithm to Detect Dependencies between Test Cases in the Manual Integration Process
NEXTA
12:00
30m
Research paper
Marco Polo - A Tool for Automated Exploratory Testing of Previously Unseen Online Stores
NEXTA
Cristina Gatt University of Malta, Mark Micallef University of Malta, Mark Bugeja University of Malta
12:30 - 14:00
LunchSocial
12:30
90m
Lunch
Lunch
Social

15:30 - 16:00
Coffee breakSocial
15:30
30m
Coffee break
Break
Social

16:00 - 17:30
Session 4NEXTA at Grand canal
Chair(s): Sahar Tahvili Ericsson AB
16:00
90m
Day closing
Closing Remarks and Presentation of Best Paper Award
NEXTA
Sahar Tahvili Ericsson AB

About NEXTA 2023

6th IEEE Workshop on NEXt level of Test Automation

NEXTA

20th April, 2023, Virtual Co-located with IEEE International Conference on Software Testing, Verification, and Validation (ICST 2023)

Theme and Goals

NEXTA’23 is the sixth edition of the IEEE Workshop on Test Automation - highly relevant for both research and industry. Thus, NEXTA aims to attract both academic researchers and industry practitioners. Test automation has been an acknowledged software engineering best practice for years. However, the topic involves more than the repeated execution of test cases that often comes first to mind. Simply running test cases using a unit testing framework is no longer enough for test automation to keep up with the ever-shorter release cycles driven by continuous deployment and technological innovations such as microservices and DevOps pipelines. Now test automation needs to rise to the next level by going beyond mere test execution. The NEXTA workshop will explore how to advance test automation to further contribute to software quality in the context of tomorrow’s rapid release cycles. Take-aways for industry practitioners and academic researchers will encompass test case generation, automated test result analysis, test suite assessment and maintenance, and infrastructure for the future of test automation.

Topics of Interest

NEXTA solicits contributions targeting all aspects of test automation, from initial test design to automated verdict analysis. Topics of interest include, but are not limited to, the following:

  • Test execution automation
  • Test case generation
  • Automatic test design generation
  • Analytics, learning, and big data in relation to test automation
  • Automatic aspects management in test, progress, reporting, planning, etc.
  • Visualization of test
  • Evolution of test automation
  • Test suite architecture and infrastructure
  • Test environment, simulation, and other contextual issues for automated testing
  • Test tools, frameworks, and general support for test automation
  • Testing in an agile and continuous integration context, and testing within DevOps
  • Orchestration of test
  • Metrics, benchmarks, and estimation on any type of test automation
  • Any type of test technologies relying on automation of test
  • Process improvements and assessments related to test automation
  • Test automation maturity and experience reports on test automation
  • Automatic retrieval of test data and test preparation aspect
  • Maintainability, monitoring, and refactoring of automated test suites
  • Training and education on automated testing
  • Automated test for product lines and high-variability systems
  • Test automation patterns
  • Automated test oracle

NEXTA solicits the following types of original papers:

  • Technical Papers (max. 8 pages in IEEE format and additional 2 pages with only references). Full papers presenting research results or industrial practices related to the next generation of test automation.
  • Position and Experience Papers (max. 4 pages in IEEE format, total). Short papers introducing challenges, visions, positions, or preliminary results within the scope of the workshop. - - - Experience reports and papers on open challenges in the industry are especially welcome.
  • Tool Papers (max. 4 pages in IEEE format, total). Tool papers introduce tools that implement an approach to support the transition to the next generation of test automation. A tool paper submission must include either 1) a URL to a screencast of the tool in action, or 2) a runnable version of the tool for evaluation by the program committee.

Authors should submit a PDF version of their paper through the NEXTA 2023 paper submission site: All accepted papers will be part of the ICST joint workshop proceedings published in the IEEE Digital Library.

Submission Format

All papers must conform to the two-column IEEE conference publication format. It must conform to the IEEE Conference Proceedings Formatting Guidelines (please use the letter format template and conference option). The submission must also comply with the ACM plagiarism policy and procedures. In particular, it must not have been published elsewhere and must not be under review elsewhere while under review for NEXTA. The submission must also comply with the IEEE Policy on Authorship.

For more info, please contact: Leo Hatvani, Organization Co-chair, Leo.hatvani@mdu.se