Intelligent container reallocation at Microsoft 365
Abstract
The use of containers in microservices has gained popularity as it facilitates agile development, resource governance, and software maintenance. Container reallocation aims to achieve workload balance via reallocating containers over physical machines. It affects the overall performance of microservice-based systems. However, container scheduling and reallocation remain an open issue due to their complexity in real-world scenarios. In this paper, we propose a novel Multi-Phase Local Search (MPLS) algorithm to optimize container reallocation. The experimental results show that our optimization algorithm outperforms state-of-the-art methods. In practice, it has been successfully applied to Microsoft 365 system to mitigate hotspot machines and balance workloads across the entire system.
BibTeX
@inproceedings{Qiao-al:FSE21,
author = {Bo Qiao and
Fangkai Yang and
Chuan Luo and
Yanan Wang and
Johnny Li and
Qingwei Lin and
Hongyu Zhang and
Mohit Datta and
Andrew Zhou and
Thomas Moscibroda and
Saravanakumar Rajmohan and
Dongmei Zhang},
title = {Intelligent container reallocation at Microsoft 365},
booktitle = {{ESEC/SIGSOFT} {FSE}},
pages = {1438--1443},
publisher = {{ACM}},
year = {2021},
}