Evaluating complex scales through subjective ranking - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2014

Evaluating complex scales through subjective ranking

Résumé

In this paper, a subjective assessment methodology based on ranking, reordering and image categorization is proposed. It is designed to facilitate the evaluation of complex features such as monocular depth cues in natural images. These features can be particularly challenging to explain to test participants, and the proposed methodology is designed to provide to the test participants more insights and examples about the scale under evaluation. The performances of the method are compared to the absolute category rating methodology, and the advantages of each part of the test design are studied to verify the added value of the different steps of the evaluation procedure. Results show that the method is promising and can improve stability between subjective test participant results.
Fichier non déposé

Dates et versions

hal-01160471 , version 1 (05-06-2015)

Identifiants

Citer

Pierre Lebreton, Alexander Raake, Marcus Barkowsky, Patrick Le Callet. Evaluating complex scales through subjective ranking. Sixth International Workshop on Quality of Multimedia Experience (QoMEX) 2014, Sep 2014, Singapore, Indonesia. pp.303-308, ⟨10.1109/QoMEX.2014.6982336⟩. ⟨hal-01160471⟩
234 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More