VSGAN: Visual Saliency guided Generative Adversarial Network for data augmentation - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

VSGAN: Visual Saliency guided Generative Adversarial Network for data augmentation

Résumé

Deep learning approaches have allowed for a great leap in the performances of visual saliency models. However, the lack of annotated data remains the main challenge for visual saliency prediction. In this paper, we leverage image inpainting methods to synthesize augmented images, which is done by completing the weakly-salient areas, and propose a Visual Saliency guided Generative Adversarial Network (VSGAN) that contains a dual encoder to extract multiscale features and a generator equipped with visual saliency guided modulation to synthesize high fidelity and diversity results. Extensive experimental results show that our method outperforms state-of-the-art methods for image inpainting on visual saliency datasets, and demonstrate the effectiveness of VSGAN for visual saliency data augmentation both quantitatively and qualitatively. CCS CONCEPTS • Computing methodologies → Interest point and salient region detections.
Fichier principal
Vignette du fichier
zhang_imxw_2023.pdf (2.59 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04139629 , version 1 (23-06-2023)

Identifiants

Citer

Zhang Jun, Xian Chuahua, Alexandre Bruckert, Patrick Le Callet, Guiqing Li, et al.. VSGAN: Visual Saliency guided Generative Adversarial Network for data augmentation. ACM IMX workshop VAMEXP (Visual attention in Multimedia Experience ), Jun 2023, Nantes, France. pp.69-75, ⟨10.1145/3604321.3604382⟩. ⟨hal-04139629⟩
42 Consultations
80 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More