Semantic label bias in subjective video quality evaluation: a standardization perspective - Archive ouverte HAL
Communication Dans Un Congrès Année : 2019

Semantic label bias in subjective video quality evaluation: a standardization perspective

Résumé

Recent studies brought to light that the semantic labels (e.g. Excellent, Good, Fair, Poor, and Bad) commonly associated with discrete scale ITU subjective quality evaluation induce a bias in MOS computation and that such a bias can be quantified by some reference coefficients which are independent with respect to the observers panel. The present paper reconsiders these results from a standard upgrading perspective. First, it theoretically investigates the way in which results obtained on semantically labeled scales can be “cleaned” from such an influence and derives the underlying computation formula for the mean opinion score. Secondly, it suggests a unitary evaluation procedure featuring both semantic free MOS computation and backward compatibility with respect to state-of-the-art solutions. The theoretical and methodological results are supported by subjective experiments corresponding to a total of 440 human observers, alternatively scoring 2D and stereoscopic video content. For each type of content, both high and low quality excerpts are alternatively considered. For each type of content and for each type of quality a 5 level (Excellent, Good, Fair, Poor, and Bad) grading scales is considered.
Fichier non déposé

Dates et versions

hal-02420282 , version 1 (19-12-2019)

Identifiants

Citer

Mihai Mitrea, Bensaied Rania, Patrick Le Callet. Semantic label bias in subjective video quality evaluation: a standardization perspective. ELECTRONIC IMAGING 2019: Image Quality and System Performance XVI, Jan 2019, Burlingame, United States. pp.311-1-311-8, ⟨10.2352/ISSN.2470-1173.2019.10.IQSP-311⟩. ⟨hal-02420282⟩
31 Consultations
0 Téléchargements

Altmetric

Partager

More