A Kernel-based Consensual Aggregation for Regression - Archive ouverte HAL
Pré-Publication, Document De Travail Année : 2021

A Kernel-based Consensual Aggregation for Regression

Résumé

In this article, we introduce a kernel-based consensual aggregation method for regression problems. We aim to flexibly combine individual regression estimators r_1, r_2, ..., r_M using a weighted average where the weights are defined based on some kernel function to build a target prediction. This work extends the context of Biau et al. (2016) to a more general kernel-based framework. We show that this more general configuration also inherits the consistency of the basic consistent estimators. Moreover, an optimization method based on gradient descent algorithm is proposed to efficiently and rapidly estimate the key parameter of the strategy. The numerical experiments carried out on several simulated and real datasets are also provided to illustrate the speed-up of gradient descent algorithm in estimating the key parameter and the improvement of overall performance of the method with the introduction of smoother kernel functions.
Fichier principal
Vignette du fichier
A_Kernel-based_Consensual_Aggregation_for_Regression.pdf (640.15 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-02884333 , version 1 (29-06-2020)
hal-02884333 , version 2 (30-06-2020)
hal-02884333 , version 3 (25-02-2021)
hal-02884333 , version 4 (26-02-2021)
hal-02884333 , version 5 (27-04-2021)
hal-02884333 , version 6 (13-06-2023)

Identifiants

Citer

Sothea Has. A Kernel-based Consensual Aggregation for Regression. 2021. ⟨hal-02884333v5⟩
358 Consultations
207 Téléchargements

Altmetric

Partager

More