Can I read Test coverage and post-verification defects: A multiple case study on EtoBox?

Test coverage and post-verification defects: A multiple case study by Audris Mockus; Nachiappan Nagappan; Trung T. Dinh-Trong is a scholarly article available to read on EtoBox.

What is Test coverage and post-verification defects: A multiple case study about?

Test coverage is a promising measure of test effectiveness and development organizations are interested in costeffective levels of coverage that provide sufficient fault removal with contained testing effort. We have conducted a multiple-case study on two dissimilar industrial software projects to investigate if test coverage reflects test effectiveness and to find the relationship between test effort and the level of test coverage. We find that in both projects the increase in test coverage is associated with decrease in field reported problems when adjusted for the number of prerelease changes. A qualitative investigation revealed several potential explanations, including code complexity, developer experience, the type of functionality, and remote development teams. All these factors were related to the level of coverage and quality, with coverage having an effect even after these adjustments. We also find that the test effort increases exponentially with test coverage, but the reduction in field problems increases linearly with test coverage. This suggests that for most projects the optimal levels of coverage are likely to be well short of 100%.

Author

Audris Mockus; Nachiappan Nagappan; Trung T. Dinh-Trong

Publisher

IEEE

Published

2009

Language

EN