Communication Dans Un Congrès Année : 2024

WebGraph: The Next Generation (Is in Rust)

Résumé

We report the results of a yearlong effort to port the WebGraph framework from Java to Rust. For two decades WebGraph has been instrumental in the analysis and distribution of large graphs for the research community of TheWebConf, but the intrinsic limitations of the Java Virtual Machine had become a bottleneck for very large use cases, such as the Software Heritage Merkle graph with its half a trillion arcs. As part of this clean-slate implementation of WebGraph in Rust, we developed a few ancillary projects bringing to the Rust ecosystem some missing features of independent interest, such as easy, consistent and zero-cost memory mapping of data structures. WebGraph in Rust offers impressive performance improvements over the previous implementation, enabling open-source graph analytics on very large datasets on top of a modern system programming language.

Fichier principal
Vignette du fichier
main.pdf (434.61 Ko) Télécharger le fichier
Origine Publication financée par une institution
Licence
DOI

Cite 10.5281/zenodo.10793566 Ouvrage Sebastiano Vigna, Tommaso Fontana, & Stefano Zacchiroli. (2024). WebGraph: The Next Generation (Is in Rust) — Reproducibility Package (Versions 2024-03-07). Zenodo. https://doi.org/10.5281/ZENODO.10793566

Dates et versions

hal-04494627 , version 1 (07-03-2024)

Licence

Identifiants

Citer

Tommaso Fontana, Sebastiano Vigna, Stefano Zacchiroli. WebGraph: The Next Generation (Is in Rust). ACM Web Conference 2024, May 2024, Singapore, Singapore. ⟨10.1145/3589335.3651581⟩. ⟨hal-04494627⟩
2190 Consultations
805 Téléchargements

Altmetric

Partager

  • More