Learning Continuous High-Dimensional Models using Mutual Information and Copula Bayesian Networks - Archive ouverte HAL Access content directly
Conference Papers Year :

Learning Continuous High-Dimensional Models using Mutual Information and Copula Bayesian Networks

Marvin Lasserre
  • Function : Author
  • PersonId : 1110439
Régis Lebrun
  • Function : Author
  • PersonId : 1110440
Pierre-Henri Wuillemin

Abstract

We propose a new framework to learn non-parametric graphical models from continuous observational data. Our method is based on concepts from information theory in order to discover independences and causality between variables: the conditional and multivariate mutual information (such as (Verny et al. 2017) for discrete models). To estimate these quantities, we propose non-parametric estimators relying on the Bernstein copula and that are constructed by exploiting the relation between the mutual information and the copula entropy (Ma and Sun 2011; Belalia et al. 2017). To our knowledge, this relation is only documented for the bivariate case and, for the need of our algorithms, is here extended to the conditional and multivariate mutual information. This framework leads to a new algorithm to learn continuous nonparametric Bayesian networks. Moreover, we use this estimator to speed up the BIC algorithm proposed in (Elidan 2010) by taking advantage of the decomposition of the likelihood function in a sum of mutual information (Koller and Friedman 2009). Finally, our method is compared in terms of performances and complexity with other state of the art techniques to learn Copula Bayesian Networks and shows superior results. In particular, it needs less data to recover the original structure and generalizes better on data that are not sampled from Gaussian distributions.
Fichier principal
Vignette du fichier
aaai2021-paper.pdf (1.81 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03346955 , version 1 (16-09-2021)

Identifiers

  • HAL Id : hal-03346955 , version 1

Cite

Marvin Lasserre, Régis Lebrun, Pierre-Henri Wuillemin. Learning Continuous High-Dimensional Models using Mutual Information and Copula Bayesian Networks. The Thirty-Fifth AAAI Conference on Artificial Intelligence, Association for the Advancement of Artificial Intelligence, Feb 2021, Vancouver, Canada. pp.12139-12146. ⟨hal-03346955⟩
50 View
78 Download

Share

Gmail Facebook Twitter LinkedIn More