Litcius/Paper detail

Learning a Partitioning Advisor for Cloud Databases

Benjamin Hilprecht, Carsten Binnig, Uwe Röhm

202062 citationsDOI

Abstract

Cloud vendors provide ready-to-use distributed DBMS solutions as a service. While the provisioning of a DBMS is usually fully automated, customers typically still have to make important design decisions which were traditionally made by the database administrator such as finding an optimal partitioning scheme for a given database schema and workload. In this paper, we introduce a new learned partitioning advisor based on Deep Reinforcement Learning (DRL) for OLAP-style workloads. The main idea is that a DRL agent learns the cost tradeoffs of different partitioning schemes and can thus automate the partitioning decision. In the evaluation, we show that our advisor is able to find non-trivial partitionings for a wide range of workloads and outperforms more classical approaches for automated partitioning design.

Topics & Concepts

Computer scienceCloud computingProvisioningWorkloadPartition (number theory)DatabaseSchema (genetic algorithms)Online analytical processingDistributed computingDatabase administratorScheme (mathematics)Distributed databaseData warehouseMachine learningOperating systemMathematical analysisCombinatoricsMathematicsCloud Computing and Resource ManagementData Stream Mining TechniquesAdvanced Database Systems and Queries
Learning a Partitioning Advisor for Cloud Databases | Litcius