A High-Speed Load-Balancer Design with Guaranteed Per-Connection-Consistency

Barbette, Tom;Tang, Chen;Yao, Haoran;Kostić, Dejan;Chiesa, Marco;et.al.
(2020) 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI′20) — Location: Santa Clara, CA (25.February.2020)

Files

Cheetah___stateless_load_balancer.pdf
  • Open Access
  • Adobe PDF
  • 613.18 KB

Details

Authors
  • Barbette, Tomorcid-logoUCLouvain
    Author
  • Tang, ChenKTH Royal Institute of Technology
    Author
  • Yao, HaoranKTH Royal Institute of Technology
    Author
  • Kostić, DejanKTH Royal Institute of Technology
    Author
  • Chiesa, MarcoKTH Royal Institute of Technology
    Author
Show more
Abstract
Large service providers use load balancers to dispatch millions of incoming connections per second towards thousands of servers. There are two basic yet critical requirements for a load balancer: uniform load distribution of the incoming connections across the servers and per-connection-consistency (PCC), ie, the ability to map packets belonging to the same connection to the same server even in the presence of changes in the number of active servers and load balancers. Yet, meeting both these requirements at the same time has been an elusive goal. Today's load balancers minimize PCC violations at the price of non-uniform load distribution.
Affiliations

Citations

Barbette, T., Tang, C., Yao, H., Kostić, D., Maguire Jr, G. Q., Papadimitratos, P., & Chiesa, M. (2020). A High-Speed Load-Balancer Design with Guaranteed Per-Connection-Consistency. 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20), p. 667-683. https://hdl.handle.net/2078.5/256349