Locally-Rank-One-Based Joint Unmixing and Demosaicing Methods for Snapshot Spectral Images. Part I: a Matrix-Completion Framework - Archive ouverte HAL
Article Dans Une Revue IEEE Transactions on Computational Imaging Année : 2024

Locally-Rank-One-Based Joint Unmixing and Demosaicing Methods for Snapshot Spectral Images. Part I: a Matrix-Completion Framework

Résumé

With the recent advancements in design and processing speed, a new snapshot mosaic imaging sensor architecture (SSI) has been successfully developed, holding the potential to transform the way dynamic scenes are captured using miniaturized platforms. However, SSI systems encounter a core trade-off concerning spatial and spectral resolution due to the assignment of individual spectral bands to each pixel. While the SSI camera manufacturer provides a pipeline to process such data, we propose in this paper to process the RAW SSI data directly. We show this strategy to be much more accurate than post-processing after the pipeline. In particular, in the first part of this paper, we propose a low-rank matrix factorization and completion framework which jointly tackles both the demosaicing and the unmixing steps of the SSI data. In addition to a "natural" technique, we expand the well-known pure pixel assumption to the SSI sensor level and propose two dedicated methods to extract the endmembers. The first one can be seen as a weighted Sparse Component Analysis (SCA) method, while the second one relaxes the abundance sparsity assumption of the former. The abundances are then recovered by applying the naive approach with the fixed extracted endmembers. Finally, we experimentally validate the merits of the proposed methods using synthetically generated data and real images obtained with an SSI camera.
Fichier principal
Vignette du fichier
kampgdgr_IEEE_TCI_Part_I_authors_version_2024.pdf (5.63 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04568404 , version 1 (08-06-2024)

Identifiants

Citer

Kinan Abbas, Matthieu Puigt, Gilles Delmaire, Gilles Roussel. Locally-Rank-One-Based Joint Unmixing and Demosaicing Methods for Snapshot Spectral Images. Part I: a Matrix-Completion Framework. IEEE Transactions on Computational Imaging, 2024, 10, pp.848 - 862. ⟨10.1109/TCI.2024.3402322⟩. ⟨hal-04568404⟩
135 Consultations
2 Téléchargements

Altmetric

Partager

More