Abstract

utomated testing is an essential component of Continuous Integration (CI) and Delivery (CD), such as scheduling automated test sessions on overnight builds. That allows stakeholders to execute entire test suites and achieve exhaustive test coverage, since running all tests is often infeasible during work hours, i.e., in parallel to development activities. On the other hand, developers also need test feedback from CI servers when pushing changes, even if not all test cases are executed. In this paper we evaluate similarity-based test case selection (SBTCS) on integration-level tests executed on continuous integration pipelines of two companies. We select test cases that maximise diversity of test coverage and reduce feedback time to developers. Our results confirm existing evidence that SBTCS is a strong candidate for test optimisation, by reducing feedback time (up to 92% faster in our case studies) while achieving full test coverage using only information from test artefacts themselves. Software Center: Aspects of Automated Testing


Original document

The different versions of the original document can be found in:

http://dx.doi.org/10.1145/3194733.3194744 under the license http://www.acm.org/publications/policies/copyright_policy#Background
https://dblp.uni-trier.de/db/conf/icse/ast2018.html#NetoALSE18,
https://doi.org/10.1145/3194733.3194744,
https://dl.acm.org/citation.cfm?doid=3194733.3194744,
https://ieeexplore.ieee.org/document/8536348,
https://academic.microsoft.com/#/detail/2810304347
Back to Top

Document information

Published on 01/01/2018

Volume 2018, 2018
DOI: 10.1145/3194733.3194744
Licence: Other

Document Score

0

Views 0
Recommendations 0

Share this document

claim authorship

Are you one of the authors of this document?