In this paper, we address the problem of object detection in an autonomous mobile robot. The goal is to define a perceptual system that can quickly adapt itself to detect a specific object. To achieve this, we propose a goal-oriented approach to let the robot build the most fitted image descriptors for a given object.