Re-Visiting Discriminator for Blind Free-Viewpoint Image Quality Assessment - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Multimedia Année : 2021

Re-Visiting Discriminator for Blind Free-Viewpoint Image Quality Assessment

Jing Li
Zhaohui Che
Wei Zhou
Junle Wang
  • Fonction : Auteur

Résumé

Accurate measurement of perceptual quality is important for various immersive multimedia, which demand real-time quality control or quality-based bench-marking for relevant algorithms. For instance, virtual views rendering in Free-Viewpoint (FV) navigation scenarios is a typical case that introduces challenging distortions, particularly the ones around dis-occluded regions. Existing quality metrics, most of which are targeting for impairments caused by compression or network condition, fail to quantify such non-uniform structure-related distortions. Moreover, the lack of quality databases for such distortions makes it even more challenging to develop robust quality metrics. In this work, a Generative Adversarial Networks based No-Reference (NR) quality Metric, namely GANs-NRM, is proposed. We first present an approach to create masks mimicking dis-occlusions/textureless regions, which is applicable on large-scale 2D image databases publicly available in the computer vision domain. Using these synthetic data, we then train a GANs-based context renderer with the capability of rendering those masked regions. Since the naturalness of the rendered dis-occluded regions strongly relates to the perceptual quality, we assume that the discriminator of the trained GANs has an intrinsic ability for quality assessment. We thus use the features extracted from the discriminator to learn a Bag-of-Distortion-Word (BDW) codebook. We show that a quality predictor can be then well trained using only a small amount of subjective quality data for the FV views rendering. Moreover, in the proposed framework, the discriminator is also adapted as a distortion-detector to locate possible distorted regions. According to the experimental results, the proposed model outperforms significantly the state-of-the-art quality metrics. The corresponding context renderer also shows appealing visualized results over other rendering algorithms.
Fichier principal
Vignette du fichier
Re-Visiting_Discriminator_for_Blind_Free-Viewpoint_Image_Quality_Assessment.pdf (5.37 Mo) Télécharger le fichier
Origine : Publication financée par une institution

Dates et versions

hal-03652620 , version 1 (30-03-2023)

Identifiants

Citer

Suiyi Ling, Jing Li, Zhaohui Che, Wei Zhou, Junle Wang, et al.. Re-Visiting Discriminator for Blind Free-Viewpoint Image Quality Assessment. IEEE Transactions on Multimedia, 2021, 23, pp.4245-4258. ⟨10.1109/TMM.2020.3038305⟩. ⟨hal-03652620⟩
30 Consultations
27 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More