Perceptual annotation of local distortions in videos: tools and datasets - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Perceptual annotation of local distortions in videos: tools and datasets

Résumé

To assess the quality of multimedia content, create datasets, and train objective quality metrics, one needs to collect subjective opinions from annotators. Different subjective methodologies exist, from direct rating with single or double stimuli to indirect rating with pairwise comparisons. Triplet and quadruplet-based comparisons are a type of indirect rating. From these comparisons and preferences on stimuli, we can place the assessed stimuli on a perceptual scale (e.g., from low to high quality). Maximum Likelihood Difference Scaling (MLDS) solver is one of these algorithms working with triplets and quadruplets. A participant is asked to compare intervals inside pairs of stimuli: (a,b) and (c,d), where a,b,c,d are stimuli forming a quadruplet. However, one limitation is that the perceptual scales retrieved from stimuli of different contents are usually not comparable. We previously offered a solution to measure the inter-content scale of multiple contents. This paper presents an open-source python implementation of the method and demonstrates its use on three datasets collected in an in-lab environment. We compared the accuracy and effectiveness of the method using pairwise, triplet, and quadruplet for intra-content annotations. The code is available here: https:// github.com/ andreaspastor/ MLDS_inter_content_scaling.
Fichier principal
Vignette du fichier
MMsys_2023_ODS (2).pdf (813.18 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04131998 , version 1 (19-06-2023)

Identifiants

Citer

Andréas Pastor, Patrick Le Callet. Perceptual annotation of local distortions in videos: tools and datasets. 14th Conference on ACM Multimedia Systems (MMSys '23), Jun 2023, Vancouver, Canada. pp.458-462, ⟨10.1145/3587819.3592559⟩. ⟨hal-04131998⟩
20 Consultations
42 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More