Can I read On the Cost-effectiveness of Composite Metamorphic Relations for Testing Deep Learning Systems on EtoBox?

On the Cost-effectiveness of Composite Metamorphic Relations for Testing Deep Learning Systems by Aitor Arrieta is a scholarly article available to read on EtoBox.

What is On the Cost-effectiveness of Composite Metamorphic Relations for Testing Deep Learning Systems about?

Deep Learning (DL) components are increasing their presence in mission and safety-critical systems, such as autonomous vehicles. The verification process of such systems needs to be rigorous, for which automated solutions are paramount. To allow test automation, test oracles are necessary. In the context of DL systems, metamorphic test oracles have found to be effective. However, such oracles require the execution of multiple tests, which makes testing more expensive. Metamorphic relation composition can reduce the cost of metamorphic testing. However, its effectiveness has found mixed answers. This paper reports the preliminary results of our study on measuring the cost-effectiveness of composite metamorphic relations for testing DL systems. To this end, we empirically evaluate the cost-effectiveness of composite metamorphic relations within a DL model for object classification. Our results suggest that composite metamorphic relations reduce the failure revealing capability when compared to their component metamorphic relations. CCS CONCEPTS • Software and its engineering → Software verification and validation.

Author

Aitor Arrieta

Publisher

ACM

Published

2022

Language

EN