3D Interest maps from simultaneous video recordings - Archive ouverte HAL Access content directly
Conference Papers Year : 2014

3D Interest maps from simultaneous video recordings

Abstract

We consider an emerging situation where multiple cameras are filming the same event simultaneously from a diverse set of angles. The captured videos provide us with the multiple view geometry and an understanding of the 3D structure of the scene. We further extend this understanding by introducing the concept of 3D interest map in this paper. As most users naturally film what they find interesting from their respective viewpoints, the 3D structure can be annotated with the level of interest, naturally crowdsourced from the users. A 3D interest map can be understood as an extension of saliency maps in the 3D space that captures the semantics of the scene. We evaluate the idea of 3D interest maps on two real datasets, taken from the environment or the cameras that are equipped enough to have an estimation of the poses of cameras and a reasonable synchronization between them. We study two aspects of the 3D interest maps in our evaluation. First, by projecting them into 2D, we compare them to state-of-the-art saliency maps. Second, to demonstrate the usefulness of the 3D interest maps, we apply them to a video mashup system that automatically produces an edited video from one of the datasets.
Fichier principal
Vignette du fichier
carlier_13291.pdf (5.9 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-04080583 , version 1 (25-04-2023)

Identifiers

  • HAL Id : hal-04080583 , version 1
  • OATAO : 13291

Cite

Axel Carlier, Lilian Calvet, Duong-Trung-Dung Nguyen, Wei Tsang Ooi, Pierre Gurdjos, et al.. 3D Interest maps from simultaneous video recordings. 22th ACM International Conference on Multimedia (MM 2014), ACM SIGMM, Nov 2014, Orlando, United States. pp.577-586. ⟨hal-04080583⟩
13 View
8 Download

Share

Gmail Mastodon Facebook X LinkedIn More