Conference Papers Year : 2021

Explainable Zero-Shot Topic Extraction Using a Common-Sense Knowledge Graph

Raphaël Troncy

Abstract

Pre-trained word embeddings constitute an essential building block for many NLP systems and applications, notably when labeled data is scarce. However, since they compress word meanings into a fixed-dimensional representation, their use usually lack interpretability beyond a measure of similarity and linear analogies that do not always reflect real-world word relatedness, which can be important for many NLP applications. In this paper, we propose a model which extracts topics from text documents based on the common-sense knowledge available in ConceptNet [24]-a semantic concept graph that explicitly encodes real-world relations between words-and without any human supervision. When combining both ConceptNet's knowledge graph and graph embeddings, our approach outperforms other baselines in the zero-shot setting, while generating a human-understandable explanation for its predictions through the knowledge graph. We study the importance of some modeling choices and criteria for designing the model, and we demonstrate that it can be used to label data for a supervised classifier to achieve an even better performance without relying on any humanly-annotated training data. We publish the code of our approach at https://github.com/D2KLab/ZeSTE and we provide a user friendly demo at https://zeste.tools.eurecom.fr/.
Fichier principal
Vignette du fichier
publi-6538.pdf (976.04 Ko) Télécharger le fichier
Origin Publisher files allowed on an open archive

Dates and versions

hal-03554652 , version 1 (03-02-2022)

Identifiers

Cite

Ismail Harrando, Raphaël Troncy. Explainable Zero-Shot Topic Extraction Using a Common-Sense Knowledge Graph. LDK 2021, 3rd Conference on Language, Data and Knowledge, Sep 2021, Zaragoza, Spain. ⟨10.4230/OASIcs.LDK.2021.17⟩. ⟨hal-03554652⟩

Collections

EURECOM ANR
311 View
358 Download

Altmetric

Share

More