Dynamically reconfiguring software microbenchmarks: reducing execution time without sacrificing result quality
Abstract
Executing software microbenchmarks, a form of small-scale performance tests predominantly used for libraries and frameworks, is a costly endeavor. Full benchmark suites take up to multiple hours or days to execute, rendering frequent checks, e.g., as part of continuous integration (CI), infeasible. However, altering benchmark configurations to reduce execution time without considering the impact on result quality can lead to benchmark results that are not representative of the software’s true performance.
BibTeX
@inproceedings{Laaber-al:FSE20,
author = {Christoph Laaber and
Stefan W{\"{u}}rsten and
Harald C. Gall and
Philipp Leitner},
title = {Dynamically reconfiguring software microbenchmarks: reducing execution time without sacrificing result quality},
booktitle = {{ESEC/SIGSOFT} {FSE}},
pages = {989--1001},
publisher = {{ACM}},
year = {2020},
}