TOWARDS A FRAMEWORK OF INTER-OBSERVER ANALYSIS FOR MULTIMEDIA QUALITY ASSESSMENT - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2011

TOWARDS A FRAMEWORK OF INTER-OBSERVER ANALYSIS FOR MULTIMEDIA QUALITY ASSESSMENT

Résumé

In multimedia quality assessment, observer ratings are typically averaged into mean opinion scores (MOS) to obtain a subjective ground truth for a set of stimuli. Valuable information about individual observer rating behaviour and interobserver differences is lost during this process. Such information, however, can be useful to improve subjective experiment procedures and quality of experience prediction models. In this paper, we therefore present an inter-observer analysis framework that tackles the quality assessment problem from an inverse angle, setting the focus on individual observer differences rather than stimuli differences. The framework consists of a set of procedures for inter-observer analysis as well as the necessary considerations during pre-processing and post-processing. The aim of this paper is to raise awareness that sole consideration of MOS simplifies quality assessment too much, especially given the ever increasing complexity of multimedia quality assessment.
Fichier principal
Vignette du fichier
qomex_2011_ulrich.pdf (266.05 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00608314 , version 1 (12-07-2011)

Identifiants

Citer

Ulrich Engelke, Yohann Pitrey, Patrick Le Callet. TOWARDS A FRAMEWORK OF INTER-OBSERVER ANALYSIS FOR MULTIMEDIA QUALITY ASSESSMENT. Third International Workshop on Quality of Multimedia Experience (QoMEX), Sep 2011, Mechelen, Belgium. pp. 183- 188, ⟨10.1109/QoMEX.2011.6065700⟩. ⟨hal-00608314⟩
157 Consultations
118 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More