kirancodes.me
To Proof Maintenance & Beyond!
FSE 2019

Assessing the quality of the steps to reproduce in bug reports

Oscar Chaparro, Carlos Bernal-Cárdenas, Jing Lu, Kevin Moran, Andrian Marcus, Massimiliano Di Penta, Denys Poshyvanyk, Vincent Ng

PDFDOI 10.1145/3338906.3338947dblp

Abstract

A major problem with user-written bug reports, indicated by developers and documented by researchers, is the (lack of high) quality of the reported steps to reproduce the bugs. Low-quality steps to reproduce lead to excessive manual effort spent on bug triage and resolution. This paper proposes Euler, an approach that automatically identifies and assesses the quality of the steps to reproduce in a bug report, providing feedback to the reporters, which they can use to improve the bug report. The feedback provided by Euler was assessed by external evaluators and the results indicate that Euler correctly identified 98% of the existing steps to reproduce and 58% of the missing ones, while 73% of its quality annotations are correct.

BibTeX
@inproceedings{Chaparro-al:FSE19,
  author    = {Oscar Chaparro and
               Carlos Bernal{-}C{\'{a}}rdenas and
               Jing Lu and
               Kevin Moran and
               Andrian Marcus and
               Massimiliano Di Penta and
               Denys Poshyvanyk and
               Vincent Ng},
  title     = {Assessing the quality of the steps to reproduce in bug reports},
  booktitle = {{ESEC/SIGSOFT} {FSE}},
  pages     = {86--96},
  publisher = {{ACM}},
  year      = {2019},
}

Related papers