TY - GEN
T1 - Load balancing with JET
T2 - 17th ACM International Conference on emerging Networking EXperiments and Technologies, CoNEXT 2021
AU - Mendelson, Gal
AU - Vargaftik, Shay
AU - Lorenz, Dean H.
AU - Barabash, Kathy
AU - Keslassy, Isaac
AU - Orda, Ariel
N1 - Publisher Copyright:
© 2021 ACM.
PY - 2021/12/2
Y1 - 2021/12/2
N2 - Hash-based stateful load-balancers employ connection tracking to avoid per-connection-consistency (PCC) violations that lead to broken connections. In this paper, we propose Just Enough Tracking (JET), a new algorithmic framework that significantly reduces the size of the connection tracking tables for hash-based stateful load-balancers without increasing PCC violations. Under mild assumptions on how backend servers are added, JET adapts consistent hash techniques to identify which connections do not need to be tracked. We provide a model to identify these safe connections and a pluggable framework with appealing theoretical guarantees that supports a variety of consistent hash and connection-tracking modules. We implement JET in two different environments and with four different consistent hash techniques. Using a series of evaluations, we demonstrate that JET requires connection-tracking tables that are an order of magnitude smaller than those required with full connection tracking while preserving PCC and balance properties. In addition, JET often increases the lookup rate due to improved caching.
AB - Hash-based stateful load-balancers employ connection tracking to avoid per-connection-consistency (PCC) violations that lead to broken connections. In this paper, we propose Just Enough Tracking (JET), a new algorithmic framework that significantly reduces the size of the connection tracking tables for hash-based stateful load-balancers without increasing PCC violations. Under mild assumptions on how backend servers are added, JET adapts consistent hash techniques to identify which connections do not need to be tracked. We provide a model to identify these safe connections and a pluggable framework with appealing theoretical guarantees that supports a variety of consistent hash and connection-tracking modules. We implement JET in two different environments and with four different consistent hash techniques. Using a series of evaluations, we demonstrate that JET requires connection-tracking tables that are an order of magnitude smaller than those required with full connection tracking while preserving PCC and balance properties. In addition, JET often increases the lookup rate due to improved caching.
UR - http://www.scopus.com/inward/record.url?scp=85121578569&partnerID=8YFLogxK
U2 - 10.1145/3485983.3494851
DO - 10.1145/3485983.3494851
M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???
AN - SCOPUS:85121578569
T3 - CoNEXT 2021 - Proceedings of the 17th International Conference on emerging Networking EXperiments and Technologies
SP - 191
EP - 204
BT - CoNEXT 2021 - Proceedings of the 17th International Conference on emerging Networking EXperiments and Technologies
Y2 - 7 December 2021 through 10 December 2021
ER -