DCDILP: a distributed learning method for large-scale causal structure learning - Archive ouverte HAL
Pré-Publication, Document De Travail (Preprint/Prepublication) Année : 2024

DCDILP: a distributed learning method for large-scale causal structure learning

Résumé

This paper presents a novel approach to causal discovery through a divide-and-conquer framework. By decomposing the problem into smaller subproblems defined on Markov blankets, the proposed DCDILP method first explores in parallel the local causal graphs of these subproblems. However, this local discovery phase encounters systematic challenges due to the presence of hidden confounders (variables within each Markov blanket may be influenced by external variables). Moreover, aggregating these local causal graphs in a consistent global graph defines a large size combinatorial optimization problem. DCDILP addresses these challenges by: i) restricting the local subgraphs to causal links only related with the central variable of the Markov blanket; ii) formulating the reconciliation of local causal graphs as an integer linear programming method. The merits of the approach, in both terms of causal discovery accuracy and scalability in the size of the problem, are showcased by experiments and comparisons with the state of the art.

Dates et versions

hal-04710846 , version 1 (26-09-2024)

Identifiants

Citer

Shuyu Dong, Michèle Sebag, Kento Uemura, Akito Fujii, Shuang Chang, et al.. DCDILP: a distributed learning method for large-scale causal structure learning. 2024. ⟨hal-04710846⟩
23 Consultations
0 Téléchargements

Altmetric

Partager

More