Fractional greedy and partial restreaming partitioning: New methods for massive graph partitioning. - Archive ouverte HAL
Conference Papers Year : 2014

Fractional greedy and partial restreaming partitioning: New methods for massive graph partitioning.

Ghizlane Echbarthi

Abstract

Graph partitioning is an important challenging problem when performing computation tasks over large distributed graphs; the reason is that a good partitioning leads to faster computations. In this work, we first introduce a new heuristic for streaming partitioning and show that it outperforms the state-of-the-art heuristics for streaming partitioning, leading to exact balance and lower cut. Secondly, we introduce the partial restreaming partitioning which is a hybrid streaming model allowing only several portions of the graph to be restreamed while the rest is to be partitioned on a single pass of the data stream. We show that our method yields partitions of similar quality than those provided by methods restreaming the whole graph (e.g ReLDG, ReFENNEL), while incurring lower cost in running time and memory since only several portions of the graph will be restreamed.
Fichier principal
Vignette du fichier
New_methods_massive_graph_partitioning.pdf (211.51 Ko) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-01282071 , version 1 (04-05-2017)

Licence

Identifiers

  • HAL Id : hal-01282071 , version 1

Cite

Ghizlane Echbarthi, Hamamache Kheddouci. Fractional greedy and partial restreaming partitioning: New methods for massive graph partitioning.. Big Data Conference, 2014, Washington DC, United States. ⟨hal-01282071⟩
282 View
378 Download

Share

More