A Framework to Map VMAF with the Probability of Just Noticeable Difference between Video Encoding Recipes - Archive ouverte HAL
Communication Dans Un Congrès Année : 2022

A Framework to Map VMAF with the Probability of Just Noticeable Difference between Video Encoding Recipes

Résumé

Just Noticeable Difference (JND) model developed based on Human Vision System (HVS) through subjective studies is valuable for many multimedia use cases. In the streaming industries, it is commonly applied to reach a good balance between compression efficiency and perceptual quality when selecting video encoding recipes. Nevertheless, recent state-of-theart deep learning based JND prediction model relies on largescale JND ground truth that is expensive and time consuming to collect. Most of the existing JND datasets contain limited number of contents and are limited to a certain codec (e.g., H264). As a result, JND prediction models that were trained on such datasets are normally not agnostic to the codecs. To this end, in order to decouple encoding recipes and JND estimation, we propose a novel framework to map the difference of objective Video Quality Assessment (VQA) scores, i.e., VMAF, between two given videos encoded with different encoding recipes from the same content to the probability of having just noticeable difference between them. The proposed probability mapping model learns from DCR test data, which is significantly cheaper compared to standard JND subjective test. As we utilize objective VQA metric (e.g., VMAF that trained with contents encoded with different codecs) as proxy to estimate JND, our model is agnostic to codecs and computationally efficient. Throughout extensive experiments, it is demonstrated that the proposed model is able to estimate JND values efficiently.
Fichier principal
Vignette du fichier
IVMSP2022_camera_ready.pdf (777.06 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03788610 , version 1 (26-09-2022)

Identifiants

  • HAL Id : hal-03788610 , version 1

Citer

Jingwen Zhu, Suiyi Ling, Yoann Baveye, Patrick Le Callet. A Framework to Map VMAF with the Probability of Just Noticeable Difference between Video Encoding Recipes. IEEE 14th Image, Video, and Multidimensional Signal Processing Workshop, Jun 2022, Nafplio, Greece. ⟨hal-03788610⟩
28 Consultations
46 Téléchargements

Partager

More