qEndpoint: A Wikidata SPARQL endpoint on commodity hardware - Archive ouverte HAL
Pré-Publication, Document De Travail Année : 2023

qEndpoint: A Wikidata SPARQL endpoint on commodity hardware

Dennis Diefenbach
Angela Bonifati

Résumé

In this work, we demonstrate how to setup a Wikidata SPARQL endpoint on commodity hardware resources. We achieve this by using a novel triple store called qEndpoint, which uses a read-only partition based on HDT and a write partition based on RDF4J. We show that qEndpoint can index and query the entire Wikidata dump (currently 17 billion triples) on a machine with 600GB SSD, 10 cores and 10GB of RAM, while keeping the query performance comparable with other SPARQL endpoints indexing Wikidata. In a nutshell, we present the first SPARQL endpoint over Wikidata that can run on commodity hardware while preserving the query run time of existing implementations. Our work goes in the direction of democratizing the access to Wikidata as well as to other large-scale Knowledge Graphs published on the Web. The source code of qEndpoint along with the query workloads are publicly available. CCS CONCEPTS • Information systems → DBMS engine architectures.
Fichier principal
Vignette du fichier
Demo_QEP_Wikidata_V2.pdf (598.13 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04370881 , version 1 (03-01-2024)

Identifiants

Citer

Antoine Willerval, Dennis Diefenbach, Angela Bonifati. qEndpoint: A Wikidata SPARQL endpoint on commodity hardware. 2023. ⟨hal-04370881⟩
46 Consultations
95 Téléchargements

Altmetric

Partager

More