GT&I GAN: a generative adversarial network for data augmentation in regression and segmentation tasks - Archive ouverte HAL
Communication Dans Un Congrès Année : 2024

GT&I GAN: a generative adversarial network for data augmentation in regression and segmentation tasks

Résumé

For data augmentation (DA), Generative Adversarial Networks (GANs) are typically integrated with CNNs or MLPs to generate samples in classification and segmentation tasks. For classification, categorical ground truth is leveraged in conditional GANs to generate samples for each class. For regression, data generation becomes complex as the aim now is to generate both the samples (images) and their continuous ground truth vectors. ANs for classification can no longer, therefore, be leveraged for DA on regression. To address this issue, we propose GT&I GAN, a novel GAN-based DA model that generates jointly image samples and their ground truth continuous vectors by learning their conjoint distribution. The main idea behind GT&I GAN is to add, to the RGB sample image, an additional (fourth) channel associated with the ground vector. GT&I GAN offers the great advantage of generating conjointly the samples and their ground truths by a single model without needing an additional network. We assess our approach on an image dataset where the ground truth consists of a high dimensional vector of continuous values. The results show that the synthetic data consisting of the image & ground truth vector pairs are realistic and allow improving the CNN regressor performance. Moreover, we show that our GT&I GAN can be leveraged seamlessly for segmentation tasks by adding, in a similar way, the ground truth segmentation mask as an additional channel to the input RGB image.
Fichier principal
Vignette du fichier
HSI24-000087-final Hajar.pdf (2.64 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04663324 , version 1 (27-07-2024)

Identifiants

Citer

Hajar Hammouch, Sambit Mohapatra, Mounim El Yacoubi, Huafeng Qin, Hassan Berbia. GT&I GAN: a generative adversarial network for data augmentation in regression and segmentation tasks. 16th International Conference on Human System Interaction (HSI), Jul 2024, Paris, France. ⟨10.13140/RG.2.2.30834.11204⟩. ⟨hal-04663324⟩
47 Consultations
36 Téléchargements

Altmetric

Partager

More