RESTful APIs are widely used to allow components of complex, distributed systems to communicate. Their prevalence means it is essential to test them and ensure that the APIs that the different components/systems expose are functional. There are several tools to test them in an automated fashion [1] (RQs 8 and 9). However, the question of measuring the quality and the thoroughness of the tests these tools generate still remains.
Different methods have been proposed to evaluate the quality of REST API tests, from classic code coverage [2] to REST-specific methods and tools [3][4]. The goal of the project is to compare these different metrics using different datasets of REST APIs [5][6][7] and tests generated using different tools.
[1] https://dl.acm.org/doi/full/10.1145/3617175
[2] https://www.atlassian.com/continuous-delivery/software-testing/code-coverage
[3] https://dl.acm.org/doi/abs/10.1145/3340433.3342822
[4] https://arxiv.org/abs/2608.28114
[5] https://github.com/WebFuzzing/Dataset
[6] https://github.com/ANSWER-OSU/Defects4REST
[7] https://dl.acm.org/doi/10.1145/3744916.3787787