A unified view on patch aggregation - Archive ouverte HAL Access content directly
Journal Articles Journal of Mathematical Imaging and Vision Year : 2020

A unified view on patch aggregation


Patch-based methods are widely used in various topics of image processing, such as image restoration or image editing and synthesis. Patches capture local image geometry and structure and are much easier to model than whole images: in practice, patches are small enough to be represented by simple multivariate priors. An important question arising in all patch-based methods is the one of patch aggregation. For instance, in image restoration, restored patches are usually not compatible, in the sense that two overlapping restored patches do not necessarily yield the same values to their common pixels. A standard way to overcome this difficulty is to see the values provided by different patches at a given pixel as independent estimators of a true unknown value and to aggregate these estimators. This aggregation step usually boils down to a simple average , with uniform weights or with weights depending on the trust we have on these different estimators. In this paper, we propose a probabilistic framework aiming at a better understanding of this crucial and often neglected step. The key idea is to see the aggregation of two patches as a fusion between their models rather than a fusion of estimators. The proposed fusion operation is pretty intuitive and generalizes previous aggregation methods. It also yields a novel interpretation of the Expected Patch Log Likelihood (EPLL) proposed in [40]
Fichier principal
Vignette du fichier
article (1).pdf (10.08 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01865340 , version 1 (31-08-2018)
hal-01865340 , version 2 (09-01-2019)
hal-01865340 , version 3 (06-04-2019)



Alexandre Saint-Dizier, Julie Delon, Charles Bouveyron. A unified view on patch aggregation. Journal of Mathematical Imaging and Vision, 2020, ⟨10.1007/s10851-019-00921-z⟩. ⟨hal-01865340v3⟩
423 View
218 Download



Gmail Facebook Twitter LinkedIn More