Sequence Labelling with Reinforcement Learning and Ranking Algorithms - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2007

Sequence Labelling with Reinforcement Learning and Ranking Algorithms

Résumé

Many problems in areas such as Natural Language Processing, Information Retrieval, or Bioinformatic involve the generic task of sequence labeling. In many cases, the aim is to assign a label to each element in a sequence. Until now, this problem has mainly been addressed with Markov models and Dynamic Programming. We propose a new approach where the sequence labeling task is seen as a sequential decision process. This method is shown to be very fast with good generalization accuracy. Instead of searching for a globally optimal label sequence, we learn to construct this optimal sequence directly in a greedy fashion. First, we show that sequence labeling can be modelled using Markov Decision Processes, so that several Reinforcement Learning (RL) algorithms can be used for this task. Second, we introduce a new RL algorithm which is based on the ranking of local labeling decisions.

Dates et versions

hal-01336187 , version 1 (22-06-2016)

Identifiants

Citer

Francis Maes, Ludovic Denoyer, Patrick Gallinari. Sequence Labelling with Reinforcement Learning and Ranking Algorithms. 18th European Conference on Machine Learning, ECML 2007, Sep 2007, Warsaw, Poland. pp.648-657, ⟨10.1007/978-3-540-74958-5_64⟩. ⟨hal-01336187⟩
159 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Mastodon Facebook X LinkedIn More