Deploying container-based applications on EGI with VIP - Archive ouverte HAL
Communication Dans Un Congrès Année : 2022

Deploying container-based applications on EGI with VIP

Déploiement d'applications containerisées avec VIP sur EGI

Résumé

The Virtual Imaging Platform (VIP) leverages resources available in the EGI biomed Virtual Organisation to offer open services for medical image data analysis to academic researchers worldwide. VIP relies on Boutiques to facilitate application installation and sharing. Boutiques applications are installed through software containers described in a rich and flexible JSON language. Docker containers are nowadays very popular, but the Docker daemon requires root privileges, preventing its support on HPC and HTC infrastructures. Singularity has emerged as an alternative allowing users to run containers without root privileges. However, on a very large and heterogeneous infrastructure such as EGI, resource providers may have different Singularity versions and configurations which may hinder the seamless deployment of container-based applications. Another alternative is udocker, which is a tool that can be installed on the fly for the execution of containers in user space without requiring root privileges. Last but not least, the availability of the image/container on the EGI worker node is also important. The common/standard image pull from a central hub may cause network issues if we have a large number of jobs pulling images at the same time on the same computing cluster. One alternative is to pre-deploy images/containers on the biomed CVMFS (CernVM File System) shared folder, commonly used for software deployment in EGI. Another alternative (not yet available) would be a dedicated EGI hub. The poster thus present the work and conclusions of the VIP team with respect to efficiently deploying and executing container-based applications on EGI HTC resources.
Fichier principal
Vignette du fichier
Presentation_light_Orateur_Bonnet_Axel_Deploiement_Application_VIP.pdf (644.97 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03975757 , version 1 (06-02-2023)

Identifiants

  • HAL Id : hal-03975757 , version 1

Citer

Axel Bonnet, Sandesh Patil, Sorina Camarasu-Pop, Tristan Glatard. Deploying container-based applications on EGI with VIP. JCAD 2022 - Journées Calcul Données, Oct 2022, Dijon, France. ⟨hal-03975757⟩
47 Consultations
44 Téléchargements

Partager

More