Data composition patterns in service-based workflows - Archive ouverte HAL Access content directly
Conference Papers Year : 2006

Data composition patterns in service-based workflows

Abstract

Workflow engines are powerful tools to implement data- intensive scientific applications exploiting parallel grid resources transparently. We discuss the advantages of impelmenting applications as workflows of services when dealing with large data sets. We show how the graph of services associated with data composition operators enable the description of complex data flows in a very compact format. We define a strict semantics for two common composition operators and we propose an algorithm to consistently satisfy this semantics all along the workflow execution. Finally, we show how our approach enables parallel execution of the application while preserving the data flow semantics. We implemented the algorithm proposed in MOTEUR, an open source workflow engine designed to execute parallel and data-intensive applications.
Fichier principal
Vignette du fichier
WORKS06.pdf (165.73 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-00683193 , version 1 (28-03-2012)

Identifiers

  • HAL Id : hal-00683193 , version 1

Cite

Johan Montagnat, Tristan Glatard, Diane Lingrand. Data composition patterns in service-based workflows. Workshop on Workflows in Support of Large-Scale Science (WORKS'06), Jun 2006, Paris, France. pp.1-10. ⟨hal-00683193⟩
300 View
119 Download

Share

Gmail Facebook X LinkedIn More