Can I read SwiftQueue: Optimizing Low-Latency Applications with Swift Packet Queuing on EtoBox?

SwiftQueue: Optimizing Low-Latency Applications with Swift Packet Queuing by Ray, Siddhant; Jiang, Xi; Luo, Jack; Feamster, Nick; Jiang, Junchen is a scholarly article available to read on EtoBox.

What is SwiftQueue: Optimizing Low-Latency Applications with Swift Packet Queuing about?

Low Latency, Low Loss, and Scalable Throughput (L4S), as an emerging router-queue management technique, has seen steady deployment in the industry. An L4S-enabled router assigns each packet to the queue based on the packet header marking. Currently, L4S employs per-flow queue selection, i.e. all packets of a flow are marked the same way and thus use the same queues, even though each packet is marked separately. However, this may hurt tail latency and latency-sensitive applications because transient congestion and queue buildups may only affect a fraction of packets in a flow. We present SwiftQueue, a new L4S queue-selection strategy in which a sender uses a novel per-packet latency predictor to pinpoint which packets likely have latency spikes or drops. The insight is that many packet-level latency variations result from complex interactions among recent packets at shared router queues. Yet, these intricate packet-level latency patterns are hard to learn efficiently by traditional models. Instead, SwiftQueue uses a custom Transformer, which is well-studied for its expressiveness on sequential patterns, to predict the next packet's latency based on the latencies of recently received

Author

Ray, Siddhant; Jiang, Xi; Luo, Jack; Feamster, Nick; Jiang, Junchen

Published

2024

Language

EN