Representation of Irregularly Sampled Time Series with Generative Language Models for Classification and Transfer Learning - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2024

Representation of Irregularly Sampled Time Series with Generative Language Models for Classification and Transfer Learning

Résumé

Human Activity Recognition plays a crucial role in various fields, including healthcare and smart homes. With the increasing prevalence of smart homes equipped with ambient sensors, there is a growing interest in leveraging artificial intelligence techniques to understand and recognize human activities within these environments. However, the irregular and noisy nature of data collected by ambient sensors presents unique challenges. To address these challenges, we propose the use of a pre-trained embedding trained on sensor activation sequences, specifically an algorithm based on an architecture similar to GPT, to improve the classification performance of activities of daily living in smart homes. Additionally, we investigate the concept of transfer learning between smart homes, utilizing the knowledge gained from one environment to enhance activity recognition in another. The results demonstrate that the GPT-like-based approach outperforms other algorithms in terms of accuracy and balanced accuracy across multiple datasets. The findings also highlight the potential of transfer learning, with GPT-like pre-trained embeddings from a clean and large dataset showing promising results in various scenarios.
Fichier principal
Vignette du fichier
Bouchabou2023MLITSWEP.pdf (247.24 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04437409 , version 1 (04-02-2024)

Identifiants

  • HAL Id : hal-04437409 , version 1

Citer

Damien Bouchabou, Sao Mai Nguyen, Christophe Lohr, Benoit Leduc, Ioannis Kanellos. Representation of Irregularly Sampled Time Series with Generative Language Models for Classification and Transfer Learning: a Case Study in Activities of Daily Living Recognition. ML4ITS 2023 - Machine Learning for Irregular Time Series Workshop in ECML PKDD, Sep 2023, Turin (IT), Italy. ⟨hal-04437409⟩
42 Consultations
25 Téléchargements

Partager

Gmail Facebook X LinkedIn More