Héron: Taming Tail Latencies in Key-Value Stores Under Heterogeneous Workloads

Jaiman, Vikas;Sonia Ben Mokhtar;Vivien Quema;Lydia Y. Chen;Riviere, Etienne
(2018) 2018 IEEE 37th Symposium on Reliable Distributed Systems (SRDS) — Location: Salvador, Brazil (2.October.2018)

Files

H_ronSRDS2018.pdf
  • Open Access
  • Adobe PDF
  • 388.29 KB

Details

Authors
  • Jaiman, VikasUCLouvain
    Author
  • Sonia Ben MokhtarINSA Lyon, LIRIS, CNRS, France
    Author
  • Vivien QuemaGrenoble INP, France
    Author
  • Lydia Y. ChenIBM Research – Zurich, Switzerland
    Author
  • Author
Abstract
Avoiding latency variability in distributed storage systems is challenging. Even in well-provisioned systems, factors such as the contention on shared resources or the unbalanced load between servers affect the latencies of requests and in particular the tail (95th and 99th percentile) of their distribution. One effective counter measure for reducing tail latency in key- value stores is to provide efficient replica selection algorithms. However, existing solutions are based on the assumption that all requests have almost the same execution time. This is not true for real workloads. This mismatch leads to increased latencies for requests with short execution time that get scheduled behind requests with large execution times. We propose He ́ron, a replica selection algorithm that supports workloads with heterogeneous request execution times. We evaluate He ́ron in a cluster of machines using a synthetic dataset inspired from the Facebook dataset as well as two real datasets from Flickr and WikiMedia. Our results show that He ́ron outperforms state-of-the-art algorithms by reducing both median and tail latency by up to 41%.
Affiliations

Citations

Jaiman, V., Sonia Ben Mokhtar, Vivien Quema, Lydia Y. Chen, & Riviere, E. (2018). Héron: Taming Tail Latencies in Key-Value Stores Under Heterogeneous Workloads. 2018 IEEE 37th Symposium on Reliable Distributed Systems (SRDS). Published. 2018 IEEE 37th Symposium on Reliable Distributed Systems (SRDS), Salvador, Brazil. https://doi.org/10.1109/srds.2018.00030