Automatic Property-based Testing of GraphQL APIs
In recent years, GraphQL has become a popular way to expose web APIs. With its raise of adoption in industry, the quality of GraphQL APIs must be also assessed, as with any part of a software system, and preferably in an automated manner. However, there is currently a lack of methods to automatically generate tests to exercise GraphQL APIs. In this paper, we propose a method for automatically producing GraphQL queries to test GraphQL APIs. This is achieved using a property-based approach to create a generator for queries based on the GraphQL schema of the system under test. Our evaluation on a real world software system shows that this approach is both effective, in terms of finding real bugs, and efficient, as a complete schema can be covered in seconds. In addition, we evaluate the fault finding capability of the method when seeding known faults. 73% of the seeded faults where found, with room for improvements with regards to domain specific behavior, a common oracle challenge in automatic test generation.
Thu 20 MayDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
12:00 - 13:15 | |||
12:00 30mLong-paper | Automatic Property-based Testing of GraphQL APIs AST 2021 Stefan Karlsson ABB AB, Mälardalen University, Adnan Causevic Mälardalen University, Daniel Sundmark Mälardalen University Pre-print Media Attached | ||
12:30 30mLong-paper | Automated Performance Testing Based on Active Deep Learning AST 2021 Ali Sedaghatbaf RISE Research Institutes of Sweden, Mahshid Helali Moghadam RISE Research Institutes of Sweden , Mehrdad Saadatmand RISE Research Institutes of Sweden Pre-print Media Attached | ||
13:00 15mShort-paper | Towards exhaustive branch coverage with PathCrawler AST 2021 Nicky Williams CEA - LIST Pre-print Media Attached |
Go directly to this room on Clowdr