V2S: A Tool for Translating Video Recordings of Mobile App Usages into Replayable ScenariosDemonstration
Screen recordings are becoming increasingly important as rich software artifacts that inform mobile application development processes. However, the amount of manual effort required to extract information from these graphical artifacts can hinder resource-constrained mobile developers. This paper presents Video2Scenario (V2S), an automated tool that processes video recordings of Android app usages, utilizes neural object detection and image classification techniques to classify the depicted user actions, and translates these actions into a replayable scenario. We conducted a comprehensive evaluation to demonstrate V2S’s ability to reproduce recorded scenarios across a range of devices and a diverse set of usage cases and applications. The results indicate that, based on its performance with 175 videos depicting 3,534 GUI-based actions, V2S is able to reproduce about 89% of sequential actions from collected videos.
Thu 27 MayDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
20:15 - 20:45 | 3.3. Evolution 3DEMO - Demonstrations at Demonstration Room Chair(s): Francisco Servant Virginia Tech Each demo makes a 1-minute presentation (displayed in the Demonstration room). At the end of each presentation, a breakout room will be created for each demo. Attendees will be able to join and discuss with the authors. | ||
20:15 30mDemonstration | V2S: A Tool for Translating Video Recordings of Mobile App Usages into Replayable ScenariosDemonstration DEMO - Demonstrations Madeleine Havranek William & Mary, Carlos Bernal-Cárdenas Microsoft, Nathan Cooper William & Mary, Oscar Chaparro College of William & Mary, Denys Poshyvanyk College of William & Mary, Kevin Moran George Mason University Pre-print Media Attached | ||
20:15 30mDemonstration | gazel: Supporting Source Code Edits in Eye-Tracking StudiesDemonstration DEMO - Demonstrations Sarah Fakhoury Washington State University, Devjeet Roy Washington State University, Harry Pines Washington State University, Tyler Cleveland Washington State University, Cole S. Peterson University of Nebraska-Lincoln, USA, Venera Arnaoudova Washington State University, Bonita Sharif University of Nebraska-Lincoln, USA, Jonathan I. Maletic Kent State University Pre-print Media Attached | ||
20:15 30mDemonstration | COSTER: A Tool for Finding Fully Qualified Names of API Elements in Online Code SnippetsDemonstration DEMO - Demonstrations C M Khaled Saifullah Department of Computer Science, University of Saskatchewan, Muhammad Asaduzzaman Queen�s University, Chanchal K. Roy University of Saskatchewan Pre-print Media Attached | ||