TopPI: An efficient algorithm for item-centric mining - Archive ouverte HAL Access content directly
Journal Articles Information Systems Year : 2017

TopPI: An efficient algorithm for item-centric mining

Abstract

In this paper, we introduce item-centric mining, a new semantics for mining long-tailed datasets. Our algorithm, TopPI, finds for each item its top-k most frequent closed itemsets. While most mining algorithms focus on the globally most frequent itemsets, TopPI guarantees that each item is represented in the results, regardless of its frequency in the database. TopPI allows users to efficiently explore Web data, answering questions such as " what are the k most common sets of songs downloaded together with the ones of my favorite artist? ". When processing retail data consisting of 55 million supermarket receipts, TopPI finds the itemset " milk, puff pastry " that appears 10,315 times, but also " frangipane, puff pastry " and " nori seaweed, wasabi, sushi rice " that occur only 1120 and 163 times, respectively. Our experiments with analysts from the marketing department of our retail partner, demonstrate that item-centric mining discover valuable itemsets. We also show that TopPI can serve as a building-block to approximate complex itemset ranking measures such as the p-value. Thanks to efficient enumeration and pruning strategies, TopPI avoids the search space explosion induced by mining low support itemsets. We show how TopPI can be parallelized on multi-cores and distributed on Hadoop clusters. Our experiments on datasets with different characteristics show the superiority of TopPI when compared to standard top-k solutions, and to Parallel FP-Growth, its closest competitor.
Fichier principal
Vignette du fichier
toppi (1).pdf (694.63 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01479067 , version 1 (28-02-2017)

Identifiers

Cite

Vincent Leroy, Martin Kirchgessner, Alexandre Termier, Sihem Amer-Yahia. TopPI: An efficient algorithm for item-centric mining. Information Systems, 2017, 64, pp.104 - 118. ⟨10.1016/j.is.2016.09.001⟩. ⟨hal-01479067⟩
770 View
430 Download

Altmetric

Share

Gmail Facebook X LinkedIn More