Multi-modal Evaluation of 3D Point Clouds Images: A Novel No-Reference Approach using a Multi-Stream Attentive Architecture - Archive ouverte HAL Access content directly
Conference Papers Year :

Multi-modal Evaluation of 3D Point Clouds Images: A Novel No-Reference Approach using a Multi-Stream Attentive Architecture

Abstract

Most existing Point Cloud Quality Assessment (PCQA) methods do not consider the local structures among points, which can impact the overall perceived quality. In this paper, we introduce a novel and efficient no-reference objective metric for PCQA that takes into account the intrinsic feature affinities of points using a fully attention-based network, which results in extracting relevant information to the local structures of the 3D content. In addition, we employ information from two modalities: a suitable 2D projection of the PC and a relevant subset of the native 3D point cloud data. The rationale is that each modality may be more sensitive to different distortion types and thus contribute to the overall quality assessment. To evaluate the performance of our method, we conducted experiments on well-known 3D Point Clouds Quality Assessment benchmarks for PC compression. Our results demonstrate that our multi-modal attentionbased PCQA metric is competitive with state-of-the-art methods in terms of both effectiveness and reliability. In particular, our method is able to capture local structures and provide more accurate quality assessments, even better than most full-reference metrics, with a moderate computational cost.
Fichier principal
Vignette du fichier
2023_EUSIPCO_Tliba_et_al_.pdf (364.3 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-04135641 , version 1 (22-07-2023)

Identifiers

  • HAL Id : hal-04135641 , version 1

Cite

Marouane Tliba, Aladine Chetouani, Giuseppe Valenzise, Frédéric Dufaux. Multi-modal Evaluation of 3D Point Clouds Images: A Novel No-Reference Approach using a Multi-Stream Attentive Architecture. European Signal Processing Conference (EUSIPCO 2023), Sep 2023, Helsinki, Finland. ⟨hal-04135641⟩
16 View
7 Download

Share

Gmail Facebook Twitter LinkedIn More