A fNIRS study of static versus animated presentations processing in deaf and hearing learners
Résumé
No research has explored the brain activities underlying the processing of animated vs. static presentation in multimedia learning. This is the goal of the present experiment, in the context of learning of high way code rules in deaf candidates from multimedia presentation of road scenes. Previous study showed that, compared to their static counterparts, animation compensate for temporal processing difficulties in deaf people. The present study analyzed the brain activity underlying the decision of undertaking a driving action by using functional near infrared spectroscopy (fNIRS) technique, which has allowed covering three cortical regions: frontal, central and occipital. Thirty-seven participants were recruited (19 deaf). The task consisted in processing road scenes for determining whether the driver had enough time to execute a driving task safely, such as overtaking. Road scenes were presented in animated format or by using a sequence of static images. Their processing required a spatiotemporal inference and a clocking mechanism about the relation between speed and distance of cars involved in the scene. The results suggest that cognitive effort – load- was higher in deaf people to process these scenes according to the higher frontal region activity. In line with other studies, the clocking mechanism involved can be measured in the central region. During decision task, cortical activity was higher in static presentation than in animation, and in deaf people, but this higher cognitive cost did not lead to higher task performance. Results encourages further studies on the neural basis of animation processing and its links with auditory capacities.