Prototyping access from visualisation tools to SKA science images and cubes stored in a Rucio Data Lake through IVOA discovery and access services
Résumé
SKA is the major low frequency radioastronomy project of the future with several major scientific applications: it will upgrade the amount of available sci- ence data by several orders of magnitudes reaching eventually more than 700 petabytes of storage per year. The SKA Observatory will proceed to the initial data processing to deliver observatory data products while the SKA Regional Center Network (SRCNet) will provide storage for those and processing capabilities to deliver and store advanced data products for the user community. Within the scope of the SRCNet, Orange (vi- sualisation), Magenta (data management) and Coral (node implementation) teams have prototyped the discovery access and visualisation of science data. Our visualisation tools VisIVO and Aladin discover, access and visualize test science data produced by SKA precursors and pathfinders stored in the Rucio (Barisits et al. 2019) Data Lake. Science metadata functionality has been implemented by the Magenta team to the Ru- cio Data Lake prototype to demonstrate a means of enabling IVOA-compliant data dis- covery and server-side processing. VisIVO, Aladin Desktop and Aladin Lite are able to query the Discovery service built on ObsCore (Louys et al. 2017) and SCS (Plante et al. 2008) IVOA protocols. This allows them to load DataLink (Dowler et al. 2015) responses providing links towards a SODA (Bonnarel et al. 2017) cutout service devel- oped by the Orange team able to extract sub-cubes or images directly from the datasets stored in the Rucio Data Lake. The Rucio Storage Element and SODA developments have been deployed and configured on the Spanish SRC node, providing computing and storage resources, managed by the Coral Team members. This prototype paves the way to collaborative development in the SRCNet and shows the possible integration of VO services and visualisation tools in Data Lakes and science platforms.
Domaines
Planète et Univers [physics]| Origine | Fichiers produits par l'(les) auteur(s) |
|---|