Quantifying no-fault-found test failures to prioritize inspection of flaky tests at Ericsson

Abstract

A test fails and despite an investigation by a developer there is no fault found (NFF). Large software systems are often released with known failing and flaky tests. In this work, we quantify how often a test fails and does not find a fault. We conduct a case study on 9.9 million test runs of 10k tests across four releases of a large project at Ericsson.

BibTeX

@inproceedings{Rehman-Rigby:FSE21,
  author    = {Maaz Hafeez Ur Rehman and
               Peter C. Rigby},
  title     = {Quantifying no-fault-found test failures to prioritize inspection of flaky tests at Ericsson},
  booktitle = {{ESEC/SIGSOFT} {FSE}},
  pages     = {1371--1380},
  publisher = {{ACM}},
  year      = {2021},
}

Quantifying no-fault-found test failures to prioritize inspection of flaky tests at Ericsson

Abstract

Related papers