This paper presents a general approach for high-resolution polarimetric SAR data classification in heterogeneous clutter, based on a statistical test of equality of covariance matrices. The Spherically Invariant Random Vector (SIRV) model is used to describe the clutter. Several distance measures, including classical ones used in standard classification methods, can be derived from the general test. The new approach provide a threshold over which pixels are rejected from the image, meaning they are not sufficiently "close" from any existing class. A distance measure using this general approach is derived and tested on a high-resolution polarimetric data set acquired by the ONERA RAMSES system. It is compared to the results of the classical decomposition and Wishart classifier under Gaussian and SIRV assumption. Results show that the new approach rejects all pixels from heterogeneous parts of the scene and classifies its Gaussian parts.