Efficient and Robust Search of Microbial Genomes via Phylogenetic Compression - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2023

Efficient and Robust Search of Microbial Genomes via Phylogenetic Compression

Résumé

Comprehensive collections approaching millions of sequenced genomes have become central information sources in the life sciences. However, the rapid growth of these collections makes it effectively impossible to search these data using tools such as BLAST and its successors. Here, we present a technique called phylogenetic compression, which uses evolutionary history to guide compression and efficiently search large collections of microbial genomes using existing algorithms and data structures. We show that, when applied to modern diverse collections approaching millions of genomes, lossless phylogenetic compression improves the compression ratios of assemblies, de Bruijn graphs, and k -mer indexes by one to two orders of magnitude. Additionally, we develop a pipeline for a BLAST-like search over these phylogeny-compressed reference data, and demonstrate it can align genes, plasmids, or entire sequencing experiments against all sequenced bacteria until 2019 on ordinary desktop computers within a few hours. Phylogenetic compression has broad applications in computational biology and may provide a fundamental design principle for future genomics infrastructure.
Fichier principal
Vignette du fichier
2023.04.15.536996v2.full.pdf (740.66 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Licence : CC BY NC - Paternité - Pas d'utilisation commerciale

Dates et versions

hal-04287842 , version 1 (15-11-2023)

Licence

Paternité - Pas d'utilisation commerciale

Identifiants

Citer

Karel Břinda, Leandro Lima, Simone Pignotti, Natalia Quinones-Olvera, Kamil Salikhov, et al.. Efficient and Robust Search of Microbial Genomes via Phylogenetic Compression. 2023. ⟨hal-04287842⟩
38 Consultations
15 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More