Applying MapReduce principle to High level information fusion - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2014

Applying MapReduce principle to High level information fusion

Résumé

The InSyTo Synthesis framework is based on graph structures, graph algorithms and similarity measures for soft data fusion managing inconsistencies. The framework can be used to enable non-redundant additions to an information network, as well as graph based information query on several applications. The graph fusion algorithm relies on the search of a maximum common subgraph isomorphism, which makes it a difficult problem, especially on large graphs. In this work, the subgraph matching algorithm is partially parallelized, based on the MapReduce approach and on the Hadoop framework. Using Hadoop enables the management of big graphs, first by avoiding the load of the graphs in memory and secondly by distributing the computations over several processing nodes. Our experiments on the Global Terrorism Database (which contains the descriptions of more than 113,000 terrorist attacks in a graph of more than 20,000,000 nodes) shows that InSyTo Synthesis now scales to socalled "big data" applications.
Fichier principal
Vignette du fichier
2014_Laudy-al__Map-Reduce_Information-Fusion__paper270.pdf (465.7 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04139064 , version 1 (23-06-2023)

Identifiants

  • HAL Id : hal-04139064 , version 1

Citer

Claire Laudy, Johann Dreo, Christophe Gouguenheim. Applying MapReduce principle to High level information fusion. 17th International Conference on Information Fusion, International Society on Information Fusion, Jul 2014, Salamanca, Spain. pp.1--8. ⟨hal-04139064⟩
1 Consultations
9 Téléchargements

Partager

Gmail Facebook X LinkedIn More