Improving Date Fruit Sorting with a Novel Multimodal Approach and CNNs - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue International journal of advances in soft computing and its applications Année : 2023

Improving Date Fruit Sorting with a Novel Multimodal Approach and CNNs

Résumé

Date fruit is a beloved and widely consumed food in the Middle East and North Africa, and its popularity is growing globally. However, sorting these fruits can be a time-consuming and labor-intensive process, particularly when done manually. To address this challenge, we have proposed an innovative approach that uses multimodal data fusion and convolutional neural networks (CNNs) to efficiently classify Algerian date fruit. Our process involves capturing four RGB images of the date fruit from various angles, a thermal image, and the weight of the fruit. We create a new image where the first channel consists of a grayscale image obtained by averaging the four RGB images of the fruit. The second channel contains the thermal image, and the third channel contains the normalized weight data. The new dataset is then divided into training, validation, and testing sets. We conducted experiments using four different models: VGG16, InceptionV3, ResNet50, and Basic CNN. Our findings show that the VGG16 model achieved the highest accuracy during training, validation, and testing, with scores of 99.6%, 90.4%, and 94%, respectively. The InceptionV3 model had the lowest accuracy, while the ResNet50 and Basic CNN models had similar performances. Our results indicate that the VGG16 model is the most suitable for classifying Algerian date fruit. Our proposed approach offers a promising solution to improve efficiency and accuracy, ultimately enhancing the quality of sorted fruit and increasing its market value.
Fichier non déposé

Dates et versions

hal-04372771 , version 1 (04-01-2024)

Identifiants

Citer

Ibtissam Boumaraf, Abdelhamid Djeffal, Sarah Setta, Abdelmalik Taleb-Ahmed. Improving Date Fruit Sorting with a Novel Multimodal Approach and CNNs. International journal of advances in soft computing and its applications, 2023, 15 (3), pp.190-206. ⟨10.15849/IJASCA.231130.13⟩. ⟨hal-04372771⟩
23 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More