Towards interpreting deep learning models for industry 4.0 with gated mixture of experts - Archive ouverte HAL Access content directly
Conference Papers Year : 2022

Towards interpreting deep learning models for industry 4.0 with gated mixture of experts

Abstract

In this work, we propose to use the Gated Mixture of Experts to interpret a deep learning model trained on industrial data. Unlike monolithic deep learning models, gated modular neural networks enable to decompose parts of the models in a way that may potentially be interpreted by domain experts or users. We first propose to transform a model that gives state-of-the-art performances on a standard industrial benchmark according to this paradigm. The model aims at predicting the remaining useful life of an asset in the field of prognostics and health management for industry 4.0. Then, we experimentally validate that the performances of the transformed model are not degraded and that the resulting model segments and clusters the data streams according to an emerging concept that reflects previously published analyses by experts on this dataset, even though such a concept has never been introduced at training time. This work thus confirms the interpretable properties of the Gated Mixture of Experts in a new domain. We further study some potential weaknesses of this paradigm, in particular the excessive variability of the resulting decomposition across experiments, and we propose to modify the loss with a new knowledge-based constraint term that encodes a known prior distribution of latent concepts in the data. We show that this term enables greater control over the Gated Mixture of Experts that results in a decomposition of significantly better quality on our benchmark.
Fichier principal
Vignette du fichier
achaoub2022.pdf (403.77 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03785546 , version 1 (17-11-2022)

Identifiers

  • HAL Id : hal-03785546 , version 1

Cite

Alaaeddine Chaoub, Christophe Cerisara, Alexandre Voisin, Benoît Iung. Towards interpreting deep learning models for industry 4.0 with gated mixture of experts. 30th European Signal Processing Conference, EUSIPCO 2022, Aug 2022, Belgrade, Serbia. ⟨hal-03785546⟩
136 View
86 Download

Share

Gmail Mastodon Facebook X LinkedIn More