A Performance Evaluation of Apache Kafka in Support of Big Data Streaming Applications
Evaluation de performances d'Apache Kafka en support aux applications Big Data de traitement de flux
Résumé
Producer performances when modifying batch size for several number of nodes and a message size of 50B 7. Take-aways • The variation of the batch size shows that there is a range of batches with a better performance. • When varying the number of nodes in some scenarios: a sudden performance drop (probably due to the internal Kafka synchronizations as well as the underlying network). • Future work : evaluating reference processing frameworks (Apache Spark and Flink) Parameters : • Message size • Batch size • Acquirement strategy • Network and disk I/O threads • Message replication • Hardware 2. Contribution • Isolate the performance of each Kafka component
Fichier principal
KerData-Paul-Lenoach.pdf (2.4 Mo)
Télécharger le fichier
KerData-Paul-Lenoach (1).pdf (2.4 Mo)
Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)