Reinforcement Learning of User Preferences for a Ubiquitous Personal Assistant - Archive ouverte HAL Accéder directement au contenu
Chapitre D'ouvrage Année : 2011

Reinforcement Learning of User Preferences for a Ubiquitous Personal Assistant

Résumé

New technologies bring a multiplicity of new possibilities for users to work with computers. Not only are spaces more and more equipped with stationary computers or notebooks, but more and more users carry mobile devices with them (smart-phones, personal digital assistants, etc.). Ubiquitous computing aims at creating smart environments where devices are dynamically linked in order to provide new services to users and new human-machine interaction possibilities. The most profound technologies are those that disappear. They weave themselves into the fabric of everyday life until they are indistinguishable from it (Weiser, 1991). This network of devices must perceive the context in order to understand and anticipate the user's needs. Devices should be able to execute actions that help the user to fulfill his goal or that simply accommodate him. Actions depend on the user's context and, in particular, on the situation within the context. The objective of this work is to construct automatically a context model by applying reinforcement learning techniques. Rewards are given by the user when expressing his degree of satisfaction towards actions proposed by the system. A default context model is used from the beginning in order to have a consistent initial behavior. This model is then adapted to each particular user in a way that maximizes the user's satisfaction towards the system's actions.
Fichier principal
Vignette du fichier
chapter.pdf (566.29 Ko) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte
Loading...

Dates et versions

hal-00753245 , version 1 (18-11-2012)

Identifiants

Citer

Sofia Zaidenberg, Patrick Reignier. Reinforcement Learning of User Preferences for a Ubiquitous Personal Assistant. Abdelhamid Mellouk. Advances in Reinforcement Learning, Intech, pp.59-80, 2011, 978-953-307-369-9. ⟨10.5772/13723⟩. ⟨hal-00753245⟩
401 Consultations
446 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More