This paper deals with continuous-time system identification using fractional differentiation models in a colored noisy output context. An optimal instrumental variable method for identifying hybrid fractional Box-Jenkins models is described. The relationship between the measured input and the output is a fractional continuous-time transfer function, and the noise is a discrete-time AR or ARMA process. The method is illustrated on a simulation example.