Dead Code Removal at Meta: Automatically Deleting Millions of Lines of Code and Petabytes of Deprecated Data
Abstract
Software constantly evolves in response to user needs: new features are built, deployed, mature and grow old, and eventually their usage drops enough to merit switching them off. In any large codebase, this feature lifecycle can naturally lead to retaining unnecessary code and data. Removing these respects users’ privacy expectations, as well as helping engineers to work efficiently. In prior software engineering research, we have found little evidence of code deprecation or dead-code removal at industrial scale. We describe Systematic Code and Asset Removal Framework (SCARF), a product deprecation system to assist engineers working in large codebases. SCARF identifies unused code and data assets and safely removes them. It operates fully automatically, including committing code and dropping database tables. It also gathers developer input where it cannot take automated actions, leading to further removals. Dead code removal increases the quality and consistency of large codebases, aids with knowledge management and improves reliability. SCARF has had an important impact at Meta. In the last year alone, it has removed petabytes of data across 12.8 million distinct assets, and deleted over 104 million lines of code.
BibTeX
@inproceedings{Shackleton-al:FSE23,
author = {Will Shackleton and
Katriel Cohn{-}Gordon and
Peter C. Rigby and
Rui Abreu and
James Gill and
Nachiappan Nagappan and
Karim Nakad and
Ioannis Papagiannis and
Luke Petre and
Giorgi Megreli and
Patrick Riggs and
James Saindon},
title = {Dead Code Removal at Meta: Automatically Deleting Millions of Lines of Code and Petabytes of Deprecated Data},
booktitle = {{ESEC/SIGSOFT} {FSE}},
pages = {1705--1715},
publisher = {{ACM}},
year = {2023},
}