Classification of galaxies is traditionally associated with their morphologies through visual inspection of images. The amount of data to come renders this task inhuman and Machine Learning (mainly Deep Learning) has been called to the rescue for more than a decade. However, the results look mitigate and there seems to be a shift away from the paradigm of the traditional morphological classification of galaxies. In this paper, I want to show that the algorithms indeed are very sensitive to the features present in images, features that do not necessarily correspond to the Hubble or de Vaucouleurs vision of a galaxy. However, this does not preclude to get the correct insights into the physics of galaxies. I have applied a state-of-the-art "traditional" Machine Learning clustering tool, called Fisher-EM, a latent discriminant subspace Gaussian Mixture Model algorithm, to 4458 galaxies carefully classified into 18 types by the EFIGI project. The optimum number of clusters given by the Integrated Complete Likelihood criterion is 47. The correspondence with the EFIGI classification is correct, but it appears that the Fisher-EM algorithm gives a great importance to the distribution of light which translates to characteristics such as the bulge to disk ratio, the inclination or the presence of foreground stars. The discrimination of some physical parameters (bulge-to-total luminosity ratio, $(B − B)T$ , intrinsic diameter, presence of flocculence or dust, arm strength) is very comparable in the two classifications.