A parallel space saving algorithm for frequent items and the Hurwitz zeta distribution



Downloads per month over past year

Cafaro, Massimo and Pulimeno, Marco and Tempesta, Piergiulio (2016) A parallel space saving algorithm for frequent items and the Hurwitz zeta distribution. Information sciences, 329 (17SI). pp. 1-19. ISSN 0020-0255

[thumbnail of tempesta21preprint.pdf]

Official URL: http://dx.doi.org/10.1016/j.ins.2015.09.003


We present a message-passing based parallel version of the Space Saving algorithm designed to solve the k-majority problem. The algorithm determines in parallel frequent items, i.e., those whose frequency is greater than a given threshold, and is therefore useful for iceberg queries and many other different contexts. We apply our algorithm to the detection of frequent items in both real and synthetic datasets whose probability distribution functions are a Hurwitz and a Zipf distribution respectively. Also, we compare its parallel performances and accuracy against a parallel algorithm recently proposed for merging summaries derived by the Space Saving or Frequent algorithms.

Item Type:Article
Additional Information:

We are indebted to the unknown referees for enlightening observations, which helped us to improve the paper. The authors would also like to thank G. Cormode and M. Hadjieleftheriou for making freely available their sequential implementation of the Space Saving algorithm. We are also grateful to Prof. Palpanas of Paris Descartes University for providing us with the real datasets used in the experiments. The research of M. Cafaro has been supported by CMCC, Italy, under the grant FISR Gemina project, Italian Ministry of Education, University and Research. The research of P. Tempesta has been supported by the grant FIS2011–22566, Ministerio de Ciencia e Innovaci´on, Spain.

Uncontrolled Keywords:Finding frequent; Elements; Streams
Subjects:Sciences > Physics > Physics-Mathematical models
Sciences > Physics > Mathematical physics
ID Code:41497
Deposited On:10 Mar 2017 14:39
Last Modified:10 Dec 2018 15:09

Origin of downloads

Repository Staff Only: item control page