Litcius/Paper detail

KLL <sup>±</sup> approximate quantile sketches over dynamic datasets

Fuheng Zhao, Sujaya Maiyya, R. Wiener, Divyakant Agrawal, Amr El Abbadi

2021Proceedings of the VLDB Endowment28 citationsDOI

Abstract

Recently the long standing problem of optimal construction of quantile sketches was resolved by K arnin, L ang, and L iberty using the KLL sketch (FOCS 2016). The algorithm for KLL is restricted to online insert operations and no delete operations. For many real-world applications, it is necessary to support delete operations. When the data set is updated dynamically, i.e., when data elements are inserted and deleted, the quantile sketch should reflect the changes. In this paper, we propose KLL ± , the first quantile approximation algorithm to operate in the bounded deletion model to account for both inserts and deletes in a given data stream. KLL ± extends the functionality of KLL sketches to support arbitrary updates with small space overhead. The space bound for KLL ± is [EQUATION], where ∈ and δ are constants that determine precision and failure probability, and α bounds the number of deletions with respect to insert operations. The experimental evaluation of KLL ± highlights that with minimal space overhead, KLL ± achieves comparable accuracy in quantile approximation to KLL.

Topics & Concepts

QuantileBounded functionComputer scienceSketchOverhead (engineering)Theoretical computer scienceAlgorithmMathematicsStatisticsMathematical analysisOperating systemData Stream Mining TechniquesAdvanced Database Systems and QueriesMachine Learning and Algorithms
KLL <sup>±</sup> approximate quantile sketches over dynamic datasets | Litcius