On the Sensory Commutativity of Action Sequences for Embodied Agents - Archive ouverte HAL Access content directly
Conference Papers Year :

On the Sensory Commutativity of Action Sequences for Embodied Agents

Abstract

We study perception in the scenario of an embodied agent equipped with first-person sensors and a continuous motor space with multiple degrees of freedom. We consider the commutative properties of action sequences with respect to sensory information perceived by such an embodied agent. We introduce the Sensory Commutativity Probability (SCP) criterion which measures how much an agent's degree of freedom affects the environment in embodied scenarios. We show how to compute this criterion in different environments, including realistic robotic setups. We empirically illustrate how SCP and the commutative properties of action sequences can be used to learn about objects in the environment and improve sample-efficiency in Reinforcement Learning.

Dates and versions

hal-03123920 , version 1 (28-01-2021)

Identifiers

Cite

Hugo Caselles-Dupré, Michael Garcia Ortiz, David Filliat. On the Sensory Commutativity of Action Sequences for Embodied Agents. Workshop on Learning in Artificial Open Worlds at ICML20, Jul 2020, Online, France. ⟨hal-03123920⟩
31 View
0 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More