Preempting Flaky Tests via Non-Idempotent-Outcome Tests

Anjiang Wei, Pu Yi, Zhengxi Li, Tao Xie, Darko Marinov, Wing Lam

Abstract

Regression testing can greatly help in software development, but it can be seriously undermined by flaky tests, which can both pass and fail, seemingly nondeterministically, on the same code commit. Flaky tests are an emerging topic in both research and industry. Prior work has identified multiple categories of flaky tests, developed techniques for detecting these flaky tests, and analyzed some detected flaky tests.

BibTeX

@inproceedings{Wei-al:ICSE22,
  author    = {Anjiang Wei and
               Pu Yi and
               Zhengxi Li and
               Tao Xie and
               Darko Marinov and
               Wing Lam},
  title     = {Preempting Flaky Tests via {Non-Idempotent-Outcome} Tests},
  booktitle = {ICSE},
  pages     = {1730--1742},
  publisher = {{ACM}},
  year      = {2022},
}

Preempting Flaky Tests via Non-Idempotent-Outcome Tests

Abstract

Related papers