Compressed indexing of (ultra) large viral alignments - Archive ouverte HAL
Communication Dans Un Congrès Année : 2024

Compressed indexing of (ultra) large viral alignments

Résumé

The analysis of MSAs allows for the evaluation of evolutionary distances and position-specific and other higher-order statistics. In particular, in the context of viruses whose genetic material consists of single-stranded nucleic acids (ssRNA viruses), evolutionary constraints at the structural level can be revealed by covariation analysis. Such analyses motivate the analysis of the joint content of columns pairs, to assess the propensity of genomic positions to form a base pair mediated by hydrogen bonds. Ultimately, they enable a reconstruction of RNA architecture(s), potentially revealing targets for future drugs [1]. In this work, we introduce a new compressed index, called CREMSA (Column-wise Runlength Encoding for Multiple Sequence Alignments) which both greatly reduces the storage required to store column-wise redundant MSAs. Contrasting with earlier efforts, solely focusing on the file-level compression of an MSA [2], our index enabling direct and efficient access to column-wise statistics (no decompression needed). Our index processes columns independently, and replaces each column content with a compressed bit vector [ 3] storing the offsets where a new nucleotide occurs (storing the new nucleotide in a separate array). Doing so, it exploits the presence of long runs of nucleotides (or gap) that are frequent in viral alignments, saving space while speeding-up queries. The data structure enables access to individual sequences of length n in O(n) time, and (multiple) column-wise statistics in O(r) time, where r is the total number of runs in the column(s). We performed a preliminary analysis of a dataset of 106 SARS-CoV 2 genomes from the NCBI to demonstrate the usability of the approach. The method directly reduces the disk space from 30 GB to 53 MB (99.8% deflation), an impressive feat of compression, even if compared to a baseline gzip compression (2.7GB/98% deflation; 51× larger than CREMSA). In principle, the compression ratio could further benefit from a custom sort procedure, minimizing the sum of Hamming distances over consecutive genomes/rows, but we unfortunately proved the associated problem to be NP-hard. As a practical tradeoff, we sorted rows according to an accepted phylogenetic tree (ordering genomes by their Pango lineage, to contiguously present genomes of a given clade), leading to a substantial improvement (30MB, a further 44% reduction). From the CREMSA representation, we compute the popular RNAalifold [4 ] conservation score between every pair of MSA columns (66M pairs of 1Mbp columns) within 7h and 100MB RAM on a desktop computer (Intel i7-12700, 64GB RAM), and found 251 pairs of columns associated with a conservation score greater than 0.5, indicating potential evolutionarily-pressured base pairs.
Fichier principal
Vignette du fichier
Seqbim_compressed_MSA-2.pdf (287.13 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-04773755 , version 1 (13-11-2024)

Licence

Identifiants

  • HAL Id : hal-04773755 , version 1

Citer

Mikael Salson, Thomas Baudeau, Arthur Boddaert, Awa Bousso Gueye, Laurent Bulteau, et al.. Compressed indexing of (ultra) large viral alignments. SEQBIM 2024 - Journées du groupe de travail Séquences en Bioinformatique, Nov 2024, Rennes, France. ⟨hal-04773755⟩
18 Consultations
20 Téléchargements

Partager

More