Similarity learning with a collection of matrices and tensors
Résumé
In data analysis domain, data are often described by a single matrix in which the rows describe objects and the columns describe features of these objects. Nevertheless, in many real world applications, data are said to be multi-dimensional, meaning that they cannot be fully described by only one matrix, but rather by a collection of matrices, or even as a tensor. Typically, we can nd these kind of data in the social networks where several entities (people, documents, etc) can have multiple relationship. In the framework of the co-clustering problem (or two-way clustering) we already proposed (Bisson et al. 2008; Hussain et al. 2010) an algorithm, named chisim, to compute simultaneously the similarity measures between rows and columns. This approach allows to discover high order similarities between objects and features, and we experimentally shown that our method achieves better results than the state of the art co-clustering systems such as LSA, ITCC, etc. In this paper, we propose to go a step further by extending the chisim method in two directions. First, we introduce di erent architectures in order to combine the similarity matrices obtained by applying chisim to a collection of matrices. We show that some of these architectures improve the quality of the co-clustering. Second, we propose a natural generalization of chisim in order to directly tackle tensors. Here a major concern is time and space complexity of this new method and thus we analyze some trade-o allowing the problem to become tractable for medium size datasets.