Gradient COBRA: A kernel-based consensual aggregation for regression - Archive ouverte HAL
Pré-Publication, Document De Travail Année : 2023

Gradient COBRA: A kernel-based consensual aggregation for regression

Résumé

In this article, we introduce a kernel-based consensual aggregation method for regression problems. We aim to exibly combine individual regression estimators r 1 , ..., r M using a weighted average where the weights are dened based on predicted features given by all the basic estimators and some kernel function. This work extends the context of Biau et al. (2016) to a more general kernel-based framework. We show that this more general conguration also inherits the consistency of the basic consistent estimators, and the same convergence rate as in the classical method is achieved. Moreover, an optimization method based on gradient descent algorithm is proposed to eciently and rapidly estimate the key parameter of the strategy. Various numerical experiments carried out on several simulated and real datasets are also provided to illustrate the eciency and accuracy of the proposed method. Moreover, a domain adaptation-like property of the aggregation strategy is also illustrated on a physics data provided by Commissariat à l'Énergie Atomique (CEA).
Fichier principal
Vignette du fichier
GradientCOBRA.pdf (2.3 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04219729 , version 1 (02-10-2023)

Identifiants

Citer

Sothea Has. Gradient COBRA: A kernel-based consensual aggregation for regression. 2023. ⟨hal-04219729⟩
27 Consultations
26 Téléchargements

Altmetric

Partager

More