A Unified Evaluation Framework for Head Motion Prediction Methods in 360° Videos - Archive ouverte HAL
Conference Papers Year : 2020

A Unified Evaluation Framework for Head Motion Prediction Methods in 360° Videos

Abstract

The streaming transmissions of 360°videos is a major challenge for the development of Virtual Reality, and require a reliable head motion predictor to identify which region of the sphere to send in high quality and save data rate. Different head motion predictors have been proposed recently. Some of these works have similar evaluation metrics or even share the same dataset, however, none of them compare with each other. In this article we introduce an open software that enables to evaluate heterogeneous head motion prediction methods on various common grounds. The goal is to ease the development of new head/eye motion prediction methods. We first propose an algorithm to create a uniform data structure from each of the datasets. We also provide the description of the algorithms used to compute the saliency maps either estimated from the raw video content or from the users' statistics. We exemplify how to run existing approaches on customizable settings, and finally present the targeted usage of our open framework: how to train and evaluate a new prediction method, and compare it with existing approaches and baselines in common settings. The entire material (code, datasets, neural network weights and documentation) is publicly available. CCS CONCEPTS • Computing methodologies → Model verification and validation ; Virtual reality. KEYWORDS 360°videos, head motion prediction framework, saliency, dataset analysis ACM Reference Format:
Fichier principal
Vignette du fichier
ODS2020_CR.pdf (1.12 Mo) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-02615979 , version 1 (23-07-2020)

Identifiers

Cite

Miguel Fabian Romero Rondon, Lucile Sassatelli, Ramon Aparicio-Pardo, Frédéric Precioso. A Unified Evaluation Framework for Head Motion Prediction Methods in 360° Videos. MMSys '20 - 11th ACM Multimedia Systems Conference, ACM, Jun 2020, Istanbul, Turkey. pp.279-284, ⟨10.1145/3339825.3394934⟩. ⟨hal-02615979⟩
156 View
359 Download

Altmetric

Share

More