Running OLAP and OLTP Workloads on the Same Cluster with Workload Prioritization
Blog post from ScyllaDB
ScyllaDB's workload prioritization mechanism, introduced in ScyllaDB Enterprise Release 2019.1, aims to efficiently manage both OLTP and OLAP workloads on the same database cluster by allocating system resources based on user-defined shares. This feature allows for co-hosting of different workloads, addressing the traditional inefficiencies and costs associated with segregated clusters for OLTP and OLAP processes. By using ScyllaDB's internal schedulers and resource management tools, workload prioritization ensures that each process receives an appropriate share of resources, thus maintaining a balance even under high system loads. Test results demonstrate that with workload prioritization enabled, OLTP workloads experience minimal performance degradation when OLAP tasks are executed concurrently, with a controlled impact on latency and throughput. This mechanism provides a flexible and cost-effective solution to optimize resource utilization and meet service level agreements while avoiding the duplication of hardware setups typically required for handling conflicting workloads separately.