Generalized Linear Models with categorical explanatory variables are considered and parameters of the model are estimated with an original exact maximum likelihood method. The existence of a sequence of maximum likelihood estimators is discussed and considerations on possible link functions are proposed. A focus is then given on two particular positive distributions: the Pareto 1 distribution and the shifted log-normal distributions. Finally, the approach is illustrated on a actuarial dataset to model insurance losses.