Communication Dans Un Congrès Année : 2025

On the Feasibility of LLM-based Automated Generation and Filtering of Competency Questions for Ontologies

Zola Mahlaza
  • Fonction : Auteur
  • PersonId : 1587300
C Maria Keet
  • Fonction : Auteur
Nanée Chahinian
Batoul Haydar

Résumé

Competency questions for ontologies are used in a number of ontology development tasks. The questions' sentences structure have been analysed to inform ontology authoring and validation. One of the problems to make this a seamless process is the hurdle of writing good CQs manually or offering automated assistance in writing CQs. In this paper, we propose an enhanced and automated pipeline where one can trace meticulously through each step, using a mini-corpus, T5, and the SQuAD dataset to generate questions, and the CLaRO controlled language, semantic similarity, and other steps for filtering. This was evaluated with two corpora of different genre in the same broad domain and evaluated with domain experts. The final output questions across the experiments were around 25% for scope and relevance and 45% of unproblematic quality. Technically, it provided ample insight into trade-offs in generation and filtering, where relaxing filtering increased sentence structure diversity but also led to more spurious sentences that required additional processing.

Fichier principal
Vignette du fichier
LDK25CQgenWW.pdf (190.13 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-05284209 , version 1 (26-09-2025)

Licence

Identifiants

  • HAL Id : hal-05284209 , version 1

Citer

Zola Mahlaza, C Maria Keet, Nanée Chahinian, Batoul Haydar. On the Feasibility of LLM-based Automated Generation and Filtering of Competency Questions for Ontologies. LDK'25, Proceedings of the 5th Conference onLanguage, Data and Knowledge, Sep 2025, Naples, Italy. pp.136. ⟨hal-05284209⟩
98 Consultations
84 Téléchargements

Partager

  • More