Interactive intrinsic video editing - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue ACM Transactions on Graphics Année : 2014

Interactive intrinsic video editing

Résumé

Separating a photograph into its reflectance and illumination intrinsic images is a fundamentally ambiguous problem, and state-of-the-art algorithms combine sophisticated reflectance and illumination priors with user annotations to create plausible results. However, these algorithms cannot be easily extended to videos for two reasons: first, naively applying algorithms designed for single images to videos produce results that are temporally incoherent; second, effectively specifying user annotations for a video requires interactive feedback , and current approaches are orders of magnitudes too slow to support this. We introduce a fast and temporally consistent algorithm to decompose video sequences into their reflectance and illumination components. Our algorithm uses a hybrid formulation that separates image gradients into smooth illumination and sparse reflectance gradients using look-up tables. We use a multi-scale parallelized solver to reconstruct the reflectance and illumination from these gradients while enforcing spatial and temporal reflectance constraints and user annotations. We demonstrate that our algorithm automatically produces reasonable results, that can be interactively refined by users, at rates that are two orders of magnitude faster than existing tools, to produce high-quality decompositions for challenging real-world video sequences. We also show how these decompositions can be used for a number of video editing applications including recoloring, retexturing, illumination editing, and lighting-aware compositing.
Fichier principal
Vignette du fichier
intrinsicvideos.pdf (11.41 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01264124 , version 1 (28-01-2016)

Identifiants

Citer

Nicolas Bonneel, Kalyan Sunkavalli, James Tompkin, Deqing Sun, Sylvain Paris, et al.. Interactive intrinsic video editing. ACM Transactions on Graphics, 2014, 33 (6), pp.197:1--197:10. ⟨10.1145/2661229.2661253⟩. ⟨hal-01264124⟩
247 Consultations
196 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More