A Kernel-based Consensual Aggregation for Regression - Archive ouverte HAL Access content directly
Preprints, Working Papers, ... Year :

A Kernel-based Consensual Aggregation for Regression

Abstract

In this article, we introduce a kernel-based consensual aggregation method for regression problems. We aim to flexibly combine individual regression estimators r_1, r_2, ..., r_M using a weighted average where the weights are defined based on some kernel function to build a target prediction. This work extends the context of Biau et al. (2016) to a more general kernel-based framework. We show that this more general configuration also inherits the consistency of the basic consistent estimators. Moreover, an optimization method based on gradient descent algorithm is proposed to efficiently and rapidly estimate the key parameter of the strategy. The numerical experiments carried out on several simulated and real datasets are also provided to illustrate the speed-up of gradient descent algorithm in estimating the key parameter and the improvement of overall performance of the method with the introduction of smoother kernel functions.
Fichier principal
Vignette du fichier
A_Kernel-based_Consensual_Aggregation_for_Regression.pdf (640.15 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-02884333 , version 1 (29-06-2020)
hal-02884333 , version 2 (30-06-2020)
hal-02884333 , version 3 (25-02-2021)
hal-02884333 , version 4 (26-02-2021)
hal-02884333 , version 5 (27-04-2021)
hal-02884333 , version 6 (13-06-2023)

Identifiers

Cite

Sothea Has. A Kernel-based Consensual Aggregation for Regression. 2021. ⟨hal-02884333v5⟩
267 View
149 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More