Sensorimotor assessment aims at evaluating sensorial and motor capabilities of children who are likely topresent a pervasive developmental disorder, such as autism. It relies on playful activities which are proposedby a psychomotrician expert to the child, with the intent of observing how the latter responds to variousphysical and cognitive stimuli. Each session is recorded so that the psychomotrician can use the video as asupport for reviewing in-session impressions and drawing final conclusions. These recordings carry a wealthof information that could be exploited for research purposes and contribute to a better understanding of autismspectrum disorders. However, the systematic inspection of these data by clinical professionals would be timeconsumingand impracticable. In order to make these analyses feasible, we discuss a computer vision approachto prospect behavior information from the available visual data acquired throughout assessment sessions.