Fractional greedy and partial restreaming partitioning: New methods for massive graph partitioning. - Archive ouverte HAL
Communication Dans Un Congrès Année : 2014

Fractional greedy and partial restreaming partitioning: New methods for massive graph partitioning.

Ghizlane Echbarthi

Résumé

Graph partitioning is an important challenging problem when performing computation tasks over large distributed graphs; the reason is that a good partitioning leads to faster computations. In this work, we first introduce a new heuristic for streaming partitioning and show that it outperforms the state-of-the-art heuristics for streaming partitioning, leading to exact balance and lower cut. Secondly, we introduce the partial restreaming partitioning which is a hybrid streaming model allowing only several portions of the graph to be restreamed while the rest is to be partitioned on a single pass of the data stream. We show that our method yields partitions of similar quality than those provided by methods restreaming the whole graph (e.g ReLDG, ReFENNEL), while incurring lower cost in running time and memory since only several portions of the graph will be restreamed.
Fichier principal
Vignette du fichier
New_methods_massive_graph_partitioning.pdf (211.51 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01282071 , version 1 (04-05-2017)

Licence

Identifiants

  • HAL Id : hal-01282071 , version 1

Citer

Ghizlane Echbarthi, Hamamache Kheddouci. Fractional greedy and partial restreaming partitioning: New methods for massive graph partitioning.. Big Data Conference, 2014, Washington DC, United States. ⟨hal-01282071⟩
281 Consultations
374 Téléchargements

Partager

More