Draw Me Like Your Triples: Leveraging Generative AI for the Completion of Wikidata - (Working paper) - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2023

Draw Me Like Your Triples: Leveraging Generative AI for the Completion of Wikidata - (Working paper)

Résumé

Humans are critical for the creation and maintenance of high-quality Knowledge Graphs (KGs). However, creating and maintaining large KGs only with humans does not scale, which is especially true for contributions based on multimedia (e.g. images) that are hard to find on the Web and expensive to generate by humans. Therefore, we leverage creative AI for the task of generating images for Wikidata items that do not have them. Our approach uses triples contained in Wikidata and generates natural text descriptions of items about fictional characters with missing images in multiple ways, including verbalizing them through large language models (LLMs). Then, we use those natural text descriptions as prompts for text-to-image models to generate plausible candidate images for Wikidata KG image completion. We design and implement several evaluations to verify the plausibility of our methods.
Fichier principal
Vignette du fichier
ISWS2023_Gryffindor.pdf (3.22 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04526070 , version 1 (29-03-2024)

Licence

Paternité

Identifiants

  • HAL Id : hal-04526070 , version 1

Citer

Raia Abu, Martin Critelli, Şefika Efeoğlu, Eleonora Mancini, Célian Ringwald, et al.. Draw Me Like Your Triples: Leveraging Generative AI for the Completion of Wikidata - (Working paper): Draft. 2023. ⟨hal-04526070⟩
3 Consultations
2 Téléchargements

Partager

Gmail Facebook X LinkedIn More