kirancodes.me
To Proof Maintenance & Beyond!
FSE 2022★ Distinguished Paper

Using nudges to accelerate code reviews at scale

Qianhua Shan, David Sukhdeo, Qianying Huang, Seth Rogers, Lawrence Chen, Elise Paradis, Peter C. Rigby, Nachiappan Nagappan

Abstract

We describe a large-scale study to reduce the amount of time code review takes. Each quarter at Meta we survey developers. Combining sentiment data from a developer experience survey and telemetry data from our diff review tool, we address, “When does a diff review feel too slow?” From the sentiment data alone, we learn that 84.7% of developers are satisfied with the time their diffs spend in review. By enriching the survey results with telemetry for each respondent, we determined that sentiment is closely associated with the 75th percentile time in review for that respondent’s diffs, ie those that take more than 24 hours.

BibTeX
@inproceedings{Shan-al:FSE22,
  author    = {Qianhua Shan and
               David Sukhdeo and
               Qianying Huang and
               Seth Rogers and
               Lawrence Chen and
               Elise Paradis and
               Peter C. Rigby and
               Nachiappan Nagappan},
  title     = {Using nudges to accelerate code reviews at scale},
  booktitle = {{ESEC/SIGSOFT} {FSE}},
  pages     = {472--482},
  publisher = {{ACM}},
  year      = {2022},
}

Related papers