Packet Order Matters! Improving Application Performance by Deliberately Delaying Packets
(2022) 19th USENIX Symposium on Networked Systems Design and Implementation (NSDI 22) — Location: Renton, WA (4.April.2022)
Files
Packet_Order_Matters__Improving_Application_Performance_by_Deliberately_Delaying_Packets.pdf
postprint
Open Access - Adobe PDF
- 1.24 MB
Details
- Authors
- Abstract
- Data centers increasingly deploy commodity servers with high-speed network interfaces to enable low-latency communication. However, achieving low latency at high data rates crucially depends on how the incoming traffic interacts with the system's caches. When packets that need to be processed in the same way are consecutive, i.e., exhibit high temporal and spatial locality, caches deliver great benefits. In this paper, we systematically study the impact of temporal and spatial traffic locality on the performance of commodity servers equipped with high-speed network interfaces. Our results show that (i) the performance of a variety of widely deployed applications degrade substantially with even the slightest lack of traffic locality, and (ii) a traffic trace from our organization reveals poor traffic locality as networking protocols, drivers, and the underlying switching/routing fabric spread packets out in time (reducing locality). To address these issues, we built Reframer, a software solution that deliberately delays packets and reorders them to increase traffic locality. Despite introducing μs-scale delays of some packets, we show that Reframer increases the throughput of a network service chain by up to 84% and reduces the flow completion time of a web server by 11% while improving its throughput by 20%.
- Affiliations
KTH Royal Institute of Technology EECS/CoS/NSLab
Citations
Hamid Ghasemirahni, Barbette, T., Katsikas, G. P., Farshin, A., Roozbeh, A., Girondi, M., Chiesa, M., Maguire Jr., G. Q., & Kostic, D. (2022). Packet Order Matters! Improving Application Performance by Deliberately Delaying Packets. Proceedings of the 19th USENIX Symposium on Networked Systems Design and Implementation (NSDI 22). Published. 19th USENIX Symposium on Networked Systems Design and Implementation (NSDI 22), Renton, WA. https://hdl.handle.net/2078.5/254907 (Original work published 2022)