A deep reinforcement learning approach for early classification of time series - Archive ouverte HAL Access content directly
Conference Papers Year :

A deep reinforcement learning approach for early classification of time series

(1, 2) , (2) , (3) , (1)
1
2
3

Abstract

—In many real-world applications, ranging from pre-dictive maintenance to personalized medicine, early classification of time series data is of paramount importance for supporting decision makers. In this article, we address this challenging task with a novel approach based on reinforcement learning. We introduce an early classifier agent, an end-to-end reinforcement learning agent (deep Q-network, DQN) [1] able to perform early classification in an efficient way. We formulate the early classification problem in a reinforcement learning framework: we introduce a suitable set of states and actions but we also define a specific reward function which aims at finding a compromise between earliness and classification accuracy. While most of the existing solutions do not explicitly take time into account in the final decision, this solution allows the user to set this trade-off in a more flexible way. In particular, we show experimentally on datasets from the UCR time series archive [2] that this agent is able to continually adapt its behavior without human intervention and progressively learn to compromise between accurate and fast predictions.
Fichier principal
Vignette du fichier
PID5426633.pdf (256.07 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01825472 , version 1 (28-06-2018)

Identifiers

  • HAL Id : hal-01825472 , version 1

Cite

Coralie Martinez, Guillaume Perrin, E Ramasso, Michèle Rombaut. A deep reinforcement learning approach for early classification of time series. EUSIPCO 2018 - 26th European Signal Processing Conference, Sep 2018, Rome, Italy. ⟨hal-01825472⟩
572 View
3322 Download

Share

Gmail Facebook Twitter LinkedIn More