A Kernel-based Consensual Regression Aggregation Method - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2021

A Kernel-based Consensual Regression Aggregation Method

Résumé

In this article, we introduce a kernel-based consensual aggregation method for regression problems. We aim to flexibly combine individual regression estimators r_1,r_2,...,r_M using a weighted average where the weights are defined based on some kernel function. It may be seen as a kernel smoother method implemented on the features of predictions, given by all the individual estimators, instead of the original inputs. This work extends the context of Biau et al. (2016) to a more general kernel-based framework. We show that this configuration asymptotically inherits the consistency property of the basic consistent estimators. Moreover, we propose to numerically learn the key parameter of the method using a gradient descent algorithm for a suitable choice of kernel functions instead of using the classical grid search algorithm. The numerical experiments carried out on several simulated and real datasets suggest that the performance of the method is improved with the introduction of kernel functions.
Fichier principal
Vignette du fichier
Kernel-based-COBRA.pdf (616.49 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-02884333 , version 1 (29-06-2020)
hal-02884333 , version 2 (30-06-2020)
hal-02884333 , version 3 (25-02-2021)
hal-02884333 , version 4 (26-02-2021)
hal-02884333 , version 5 (27-04-2021)
hal-02884333 , version 6 (13-06-2023)

Identifiants

Citer

Sothea Has. A Kernel-based Consensual Regression Aggregation Method. 2021. ⟨hal-02884333v3⟩
325 Consultations
176 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More