Locally-Rank-One-Based Joint Unmixing and Demosaicing Methods for Snapshot Spectral Images. Part I: a Matrix-Completion Framework - Archive ouverte HAL
Article Dans Une Revue IEEE Transactions on Computational Imaging Année : 2024

Locally-Rank-One-Based Joint Unmixing and Demosaicing Methods for Snapshot Spectral Images. Part I: a Matrix-Completion Framework

Résumé

With the recent advancements in design and processing speed, a new snapshot mosaic imaging sensor architecture (SSI) has been successfully developed, holding the potential to transform the way dynamic scenes are captured using miniaturized platforms. However, SSI systems encounter a core trade-off concerning spatial and spectral resolution due to the assignment of individual spectral bands to each pixel. While the SSI camera manufacturer provides a pipeline to process such data, we propose in this paper to process the RAW SSI data directly. We show this strategy to be much more accurate than post-processing after the pipeline. In particular, in the first part of this paper, we propose a low-rank matrix factorization and completion framework which jointly tackles both the demosaicing and the unmixing steps of the SSI data. In addition to a "natural" technique, we expand the well-known pure pixel assumption to the SSI sensor level and propose two dedicated methods to extract the endmembers. The first one can be seen as a weighted Sparse Component Analysis (SCA) method, while the second one relaxes the abundance sparsity assumption of the former. The abundances are then recovered by applying the naive approach with the fixed extracted endmembers. Finally, we experimentally validate the merits of the proposed methods using synthetically generated data and real images obtained with an SSI camera.
Fichier sous embargo
Fichier sous embargo
0 0 20
Année Mois Jours
Avant la publication
dimanche 8 décembre 2024
Fichier sous embargo
dimanche 8 décembre 2024
Connectez-vous pour demander l'accès au fichier

Dates et versions

hal-04568404 , version 1 (08-06-2024)

Identifiants

Citer

Kinan Abbas, Matthieu Puigt, Gilles Delmaire, Gilles Roussel. Locally-Rank-One-Based Joint Unmixing and Demosaicing Methods for Snapshot Spectral Images. Part I: a Matrix-Completion Framework. IEEE Transactions on Computational Imaging, 2024, 10, pp.848 - 862. ⟨10.1109/TCI.2024.3402322⟩. ⟨hal-04568404⟩
133 Consultations
2 Téléchargements

Altmetric

Partager

More