Communication Dans Un Congrès Année : 2025

Energy and Performance Evaluation of Serverless and Serverful Models on Spark for Database Join Operations

Phan-An-Truong Tran
  • Fonction : Auteur
Thuong-Cang Phan
  • Fonction : Auteur
Le Gruenwald
  • Fonction : Auteur
  • PersonId : 999621

Résumé

The demand for environmentally friendly cloud computing is on the rise, leading cloud service providers to focus on reducing carbon emissions by using renewable energy sources and energy-efficient computing models. This study assesses the performance and energy consumption of serverless and serverful architectures, specifically looking at join operations using Apache Spark for big data processing in a private cloud combined with Kubernetes. By using the TPC-DS benchmark, we examine the impact of cold-start and warm-start phases in the serverless environment, as well as the auto-scaling capabilities of Spark in serverless environments within the private cloud. The results show that the efficient and flexible resource management in serverless environments in private clouds leads to more optimal processing times and energy consumption compared to serverful architectures, especially in warm-start scenarios. These findings offer valuable insights for organizations seeking to streamline their big data infrastructure while also making a positive environmental impact within the IT industry.

Fichier principal
Vignette du fichier
34.pdf (1.93 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-05136844 , version 1 (30-06-2025)

Licence

Identifiants

  • HAL Id : hal-05136844 , version 1

Citer

Phan-An-Truong Tran, Laurent d'Orazio, Thuong-Cang Phan, Le Gruenwald. Energy and Performance Evaluation of Serverless and Serverful Models on Spark for Database Join Operations. International Conference on Database and Expert Systems Applications (DEXA), Aug 2025, Bangkok, Thailand. ⟨hal-05136844⟩
169 Consultations
330 Téléchargements

Partager

  • More