Interactive intrinsic video editing - Archive ouverte HAL Access content directly
Journal Articles ACM Transactions on Graphics Year : 2014

Interactive intrinsic video editing


Separating a photograph into its reflectance and illumination intrinsic images is a fundamentally ambiguous problem, and state-of-the-art algorithms combine sophisticated reflectance and illumination priors with user annotations to create plausible results. However, these algorithms cannot be easily extended to videos for two reasons: first, naively applying algorithms designed for single images to videos produce results that are temporally incoherent; second, effectively specifying user annotations for a video requires interactive feedback , and current approaches are orders of magnitudes too slow to support this. We introduce a fast and temporally consistent algorithm to decompose video sequences into their reflectance and illumination components. Our algorithm uses a hybrid formulation that separates image gradients into smooth illumination and sparse reflectance gradients using look-up tables. We use a multi-scale parallelized solver to reconstruct the reflectance and illumination from these gradients while enforcing spatial and temporal reflectance constraints and user annotations. We demonstrate that our algorithm automatically produces reasonable results, that can be interactively refined by users, at rates that are two orders of magnitude faster than existing tools, to produce high-quality decompositions for challenging real-world video sequences. We also show how these decompositions can be used for a number of video editing applications including recoloring, retexturing, illumination editing, and lighting-aware compositing.
Fichier principal
Vignette du fichier
intrinsicvideos.pdf (11.41 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01264124 , version 1 (28-01-2016)



Nicolas Bonneel, Kalyan Sunkavalli, James Tompkin, Deqing Sun, Sylvain Paris, et al.. Interactive intrinsic video editing. ACM Transactions on Graphics, 2014, 33 (6), pp.197:1--197:10. ⟨10.1145/2661229.2661253⟩. ⟨hal-01264124⟩
229 View
189 Download



Gmail Facebook Twitter LinkedIn More