Can I read Using Synthetic Test Suites to Empirically Compare Search-based and Greedy Prioritizers on EtoBox?

Using Synthetic Test Suites to Empirically Compare Search-based and Greedy Prioritizers by Zachary D. Williams; Gregory M. Kapfhammer is a scholarly article available to read on EtoBox.

What is Using Synthetic Test Suites to Empirically Compare Search-based and Greedy Prioritizers about?

The increase in the complexity of modern software has led to the commensurate growth in the size and execution time of the test suites for these programs. In order to address this alarming trend, developers use test suite prioritization to reorder the test cases so that faults can be detected at an early stage of testing. Yet, the implementation and evaluation of greedy and search-based test prioritizers requires access to case study applications and their associated test suites, which are often difficult to find, configure, and use in an empirical study. This paper presents two types of synthetically generated test suites that support this process of experimentally evaluating prioritization methods. Using synthetic test suites affords greater control over test case characteristics and supports the identification of empirical trends that contradict the established wisdom about searchbased and greedy prioritization. For instance, we find that the hill climbing algorithm often exhibits a lower time overhead than the greedy test suite prioritizer while often producing test orderings with comparable effectiveness scores.

Author

Zachary D. Williams; Gregory M. Kapfhammer

Publisher

ACM

Published

2010

Language

EN