Big Data architecture for large-scale scientific computing - Archive ouverte HAL
Communication Dans Un Congrès Année : 2014

Big Data architecture for large-scale scientific computing

Résumé

Today, the scientific community uses massively simulations to test their theories and to understand physical phenomena. Simulation is however limited by two important factors: the number of elements used and the number of time-steps which are computed and stored. Both limits are constrained by hardware capabilities (computation nodes and/or storage). From this observation arises the VELaSSCo project1. The goal is to design, implement and deploy a platform to store data for DEM (Discrete Element Method) and FEM (Finite Element Method) simulations. These simulations can produce huge amounts of data regarding to the number of elements (particles in DEM) which are computed, and also regarding to the number of time-steps processed. The VELaSSCo platform solves this problem by providing a framework fulfilling the application needs and running on any available hardware. This platform is composed of different software modules: a Hadoop distribution and some specific plug-ins. The plug- ins which are designed deal with the data produced by the simulations. The output of the platform is designed to fit with requirements of available visualization software.
Fichier principal
Vignette du fichier
ABDA.pdf (735.9 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01061641 , version 1 (08-09-2014)

Identifiants

  • HAL Id : hal-01061641 , version 1

Citer

Benoit Lange, Toan Nguyen. Big Data architecture for large-scale scientific computing. world academy of science - ABDA 2014, Sep 2014, Las Vegas, United States. ⟨hal-01061641⟩
257 Consultations
402 Téléchargements

Partager

More