A social robot should be able to understand human's profile (i.e., human's emotions and personality), so as to make the robot able to behave appropriately to the mul-timodal interaction context. This research addresses the online recognition of emotions based on a new fuzzy-based methodology. It also focuses on investigating how could a match between the human's and the robot's personalities influence interaction. Furthermore, it studies the automatic generation of head-arm metaphoric gestures under different emotional states based on the prosodic cues of the interacting human. The conducted experiments have been validated with NAO robot from Aldebaran Robotics and ALICE robot from Hanson Robotics.