In this paper, we propose a help to a comfort system development based on Kinect sensor to assist people commanding their own house by using only their gestures. The system uses a multi-sensors to detect the person, recognize her gestures and communicate through an IP/KNX gateway to act on actuators related to the home. Thus, a simple gesture is able to turn on/off the lights, to switch on/off the TV, to move up or down the shutters etc. We performed a test bed within the smart home of our University Institute of Technology in Blagnac.