A machine learning driven solution to the problem of perceptual video quality metrics - Archive ouverte HAL Accéder directement au contenu
Chapitre D'ouvrage Année : 2020

A machine learning driven solution to the problem of perceptual video quality metrics

Hassan Rabah
Naeem Ramzan

Résumé

The advent of high-speed internet connections, advanced video coding algorithms, and consumer-grade computers with high computational capabilities has led videostreaming-over-the-internet to make up the majority of network traffic. This effect has led to a continuously expanding video streaming industry that seeks to offer enhanced quality-of-experience (QoE) to its users at the lowest cost possible. Video streaming services are now able to adapt to the hardware and network restrictions that each user faces and thus provide the best experience possible under those restrictions. The most common way to adapt to network bandwidth restrictions is to offer a video stream at the highest possible visual quality, for the maximum achievable bitrate under the network connection in use. This is achieved by storing various preencoded versions of the video content with different bitrate and visual quality settings. Visual quality is measured by means of objective quality metrics, such as the mean squared error (MSE), peak signal-to-noise ratio (PSNR), structural similarity (SSIM) index, visual information fidelity (VIF), and others, which can be easily computed analytically. Nevertheless, it is widely accepted that although these metrics provide an accurate estimate of the statistical quality degradation, they do not reflect the viewer's perception of visual quality accurately. As a result, the acquisition of user ratings in the form of mean opinion scores (MOSs) remains the most accurate depiction of human-perceived video quality, albeit very costly and time consuming, and thus cannot be practically employed by video streaming providers that have hundreds or thousands of videos in their catalogues. A recent very promising approach for addressing this limitation is the use of machine learning techniques in order to train models that represent human video quality perception more accurately. To this end, regression techniques are used in order to map objective quality metrics to human video quality ratings, acquired for a large number of diverse video sequences. Results have been very promising, with approaches like the Video Multimethod Assessment Fusion (VMAF) metric achieving higher correlations to user-acquired MOS ratings compared to traditional widely used objective quality metrics. In this chapter, we examine the performance of VMAF and its potential as a replacement for common objective video quality metrics.
Fichier principal
Vignette du fichier
32440.pdf (396.34 Ko) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-03982143 , version 1 (10-02-2023)

Licence

Paternité - Pas d'utilisation commerciale - Pas de modification

Identifiants

Citer

Stamos Katsigiannis, Hassan Rabah, Naeem Ramzan. A machine learning driven solution to the problem of perceptual video quality metrics. Muhammad Zeeshan Shakir; Naeem Ramzan. AI for Emerging Verticals: Human-robot computing, sensing and networking, 34, The Institution of Engineering and Technology, 2020, IET computing collection, 978-1-78561-982-3. ⟨10.1049/pbpc034e_ch12⟩. ⟨hal-03982143⟩
16 Consultations
19 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More