Optimizing test prioritization via test distribution analysis
Abstract
Test prioritization aims to detect regression faults faster via reordering test executions, and a large number of test prioritization techniques have been proposed accordingly. However, test prioritization effectiveness is usually measured in terms of the average percentage of faults detected concerned with the number of test executions, rather than the actual regression testing time, making it unclear which technique is optimal in actual regression testing time. To answer this question, this paper first conducts an empirical study to investigate the actual regression testing time of various prioritization techniques. The results reveal a number of practical guidelines. In particular, no prioritization technique can always perform optimal in practice.
BibTeX
@inproceedings{Chen-al:FSE18,
author = {Junjie Chen and
Yiling Lou and
Lingming Zhang and
Jianyi Zhou and
Xiaoleng Wang and
Dan Hao and
Lu Zhang},
title = {Optimizing test prioritization via test distribution analysis},
booktitle = {{ESEC/SIGSOFT} {FSE}},
pages = {656--667},
publisher = {{ACM}},
year = {2018},
}