SENSE-LM : A Synergy between a Language Model and Sensorimotor Representations for Auditory and Olfactory Information Extraction - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2024

SENSE-LM : A Synergy between a Language Model and Sensorimotor Representations for Auditory and Olfactory Information Extraction

Résumé

The five human senses – vision, taste, smell, hearing, and touch – are key concepts that shape human perception of the world. The extraction of sensory references (i.e., expressions that evoke the presence of a sensory experience) in textual corpus is a challenge of high interest, with many applications in various areas. In this paper, we propose SENSE-LM, an information extraction system tailored for the discovery of sensory references in large collections of textual documents. Based on the novel idea of combining the strength of large language models and linguistic resources such as sensorimotor norms, it addresses the task of sensory information extraction at a coarse-grained (sentence binary classification) and fine-grained (sensory term extraction) level.Our evaluation of SENSE-LM for two sensory functions, Olfaction and Audition, and comparison with state-of-the-art methods emphasize a significant leap forward in automating these complex tasks.
Fichier non déposé

Dates et versions

hal-04509138 , version 1 (03-04-2024)

Identifiants

  • HAL Id : hal-04509138 , version 1

Citer

Cédric Boscher, Christine Largeron, Véronique Eglin, Elöd Egyed-Zsigmond. SENSE-LM : A Synergy between a Language Model and Sensorimotor Representations for Auditory and Olfactory Information Extraction. Findings of the Association for Computational Linguistics: EACL 2024, Mar 2024, San Ġiljan, Malta. pp.1695-1711. ⟨hal-04509138⟩
3 Consultations
3 Téléchargements

Partager

Gmail Facebook X LinkedIn More