Can I read Towards effective assessment of steady state performance in Java software: Are we there yet? on EtoBox?

Towards effective assessment of steady state performance in Java software: Are we there yet? by Traini, Luca; Cortellessa, Vittorio; Di Pompeo, Daniele; Tucci, Michele is a scholarly article available to read on EtoBox.

What is Towards effective assessment of steady state performance in Java software: Are we there yet? about?

Microbenchmarking is a widely used form of performance testing in Java software. A microbenchmark repeatedly executes a small chunk of code while collecting measurements related to its performance. Due to Java Virtual Machine optimizations, microbenchmarks are usually subject to severe performance fluctuations in the first phase of their execution (also known as warmup). For this reason, software developers typically discard measurements of this phase and focus their analysis when benchmarks reach a steady state of performance. Developers estimate the end of the warmup phase based on their expertise, and configure their benchmarks accordingly. Unfortunately, this approach is based on two strong assumptions: (i) benchmarks always reach a steady state of performance and (ii) developers accurately estimate warmup. In this paper, we show that Java microbenchmarks do not always reach a steady state, and often developers fail to accurately estimate the end of the warmup phase. We found that a considerable portion of studied benchmarks do not hit the steady state, and warmup estimates provided by software developers are often inaccurate (with a large error). This has significant implicati

Author

Traini, Luca; Cortellessa, Vittorio; Di Pompeo, Daniele; Tucci, Michele

Published

2022

Language

EN