C3: Cutting Tail Latency in Cloud Data Stores via Adaptive Replica Selection

Suresh, Lalith;Canini, Marco;Schmid, Stefan;Feldmann, Anja
(2015) USENIX Conference on Networked Systems Design and Implementation

Files

c3nsdi15.pdf
  • Open Access
  • Adobe PDF
  • 1.3 MB

Details

Authors
  • Suresh, LalithTU Berlin
    Author
  • Canini, MarcoUCLouvain
    Author
  • Schmid, StefanTU Berlin / T-Labs
    Author
  • Feldmann, AnjaTU Berlin
    Author
Abstract
Achieving predictable performance is critical for many distributed applications, yet difficult to achieve due to many factors that skew the tail of the latency distribution even in well-provisioned systems. In this paper, we present the fundamental challenges involved in designing a replica selection scheme that is robust in the face of performance fluctuations across servers. We illustrate these challenges through performance evaluations of the Cassandra distributed database on Amazon EC2. We then present the design and implementation of an adaptive replica selection mechanism, C3, that is robust to performance variability in the environment. We demonstrate C3's effectiveness in reducing the latency tail and improving throughput through extensive evaluations on Amazon EC2 and through simulations. Our results show that C3 significantly improves the latencies along the mean, median, and tail (up to 3 times improvement at the 99.9th percentile) and provides higher system throughput.
Affiliations

Citations

Suresh, L., Canini, M., Schmid, S., & Feldmann, A. (2015). C3: Cutting Tail Latency in Cloud Data Stores via Adaptive Replica Selection. 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI′15). Published. USENIX Conference on Networked Systems Design and Implementation. https://hdl.handle.net/2078.5/229135