Webinar On Demand

How Application-Level Priority Management Keeps Latency Low and Throughput High

Recorded October 26, 2021

View a Complimentary Webinar Sponsored by ScyllaDB

Throughput and latency are at a constant tension. Optimizing for throughput requires running machines at high utilization, which increases queuing delays and hurts latency. This talk will show how high throughput and low latency can both be achieved in a single application by using application-level priority scheduling.

  • Vertical scalability, or how a single node is a network

  • Shard-per-core, shared nothing design

  • Async everywhere

  • Schedulers for CPU and IO

  • Prioritizing multiple workloads on the same cluster

  • Getting the most out of the Linux OS and C++20

Avi Kivity

CTO & Co-founder, ScyllaDB


Avi Kivity is best known for starting the Kernel-based Virtual Machine (KVM) project, the hypervisor underlying many production clouds. He worked for Qumranet and Red Hat as KVM maintainer until December 2012. Avi is now CTO of ScyllaDB, a company that seeks to bring the same kind of innovation and optimization to the distributed database.