Can I read 2017 IEEE/ACM 14th International Conference on Mining Software Repositories (MSR) - An Exploratory Study on Assessing the Impact of Environment Variations on the Results of Load Tests on EtoBox?

2017 IEEE/ACM 14th International Conference on Mining Software Repositories (MSR) - An Exploratory Study on Assessing the Impact of Environment Variations on the Results of Load Tests by Gao, Ruoyu; Jiang, Zhen Ming is a scholarly article available to read on EtoBox.

What is 2017 IEEE/ACM 14th International Conference on Mining Software Repositories (MSR) - An Exploratory Study on Assessing the Impact of Environment Variations on the Results of Load Tests about?

Large-scale software systems like Amazon and healthcare.gov are used by thousands or millions of people every day. To ensure the quality of these systems, load testing is a required testing procedure in addition to the conventional functional testing techniques like unit and system integration testing. One of the important requirements of load testing is to create a field-like test environment. Unfortunately, this task is often very challenging due to reasons like security and rapid field updates. In this paper, we have conducted an exploratory study on the impact of environment variations on the results of load tests. We have run over 110 hours load tests, which examine the system's behavior under load with various changes (e.g., installing an anti-virus program) to the targeted deployment environment. We call such load tests as environment-variation-based load tests. Case studies in three open source systems have shown that there is a clear performance impact on the system's performance due to these environment changes. Different scenarios react differently to the changes in the underlying computing resources. When predicting the performance of the system under environment change

Author

Gao, Ruoyu; Jiang, Zhen Ming

Publisher

IEEE

Published

2017

Language

EN