Multiple works have proposed extensions of HMMs for handling variability. We focus here on the design of HMMs whose probability distribution on sequences depends on additional external variables that we call the context, which may stand for emotion features in speech recognition, physical features in gesture recognition, etc. We show experimentally the relevance of the method for handwriting recognition.