Zooming On All Actors: Automatic Focus+Context Split Screen Video Generation - Archive ouverte HAL Access content directly
Journal Articles Computer Graphics Forum Year : 2017

Zooming On All Actors: Automatic Focus+Context Split Screen Video Generation

(1) , (1) , (2) , (3)
1
2
3

Abstract

Recordings of stage performances are easy to capture with a high-resolution camera, but are difficult to watch because the actors' faces are too small. We present an approach to automatically create a split screen video that transforms these recordings to show both the context of the scene as well as close-up details of the actors. Given a static recording of a stage performance and tracking information about the actors positions, our system generates videos showing a focus+context view based on computed close-up camera motions using crop-and zoom. The key to our approach is to compute these camera motions such that they are cinematically valid close-ups and to ensure that the set of views of the different actors are properly coordinated and presented. We pose the computation of camera motions as convex optimization that creates detailed views and smooth movements, subject to cinematic constraints such as not cutting faces with the edge of the frame. Additional constraints link the close up views of each actor, causing them to merge seamlessly when actors are close. Generated views are placed in a resulting layout that preserves the spatial relationships between actors. We demonstrate our results on a variety of staged theater and dance performances.
Vignette du fichier
0961new.jpg (158.32 Ko) Télécharger le fichier Fichier principal
Vignette du fichier
Eurographics_2017.pdf (6.28 Mo) Télécharger le fichier
Format : Figure, Image
Origin : Files produced by the author(s)
Origin : Files produced by the author(s)

Dates and versions

hal-01482165 , version 1 (14-03-2017)

Identifiers

Cite

Moneish Kumar, Vineet Gandhi, Rémi Ronfard, Michael Gleicher. Zooming On All Actors: Automatic Focus+Context Split Screen Video Generation. Computer Graphics Forum, 2017, 36 (2), pp.455-465. ⟨10.1111/cgf.13140⟩. ⟨hal-01482165⟩
907 View
638 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More