Prediction regions through Inverse Regression - Archive ouverte HAL Access content directly
Journal Articles Journal of Machine Learning Research Year : 2020

Prediction regions through Inverse Regression


Predicting a new response from a covariate is a challenging task in regression, which raises new question since the era of high-dimensional data. In this paper, we are interested in the inverse regression method from a theoretical viewpoint. Theoretical results for the well-known Gaussian linear model are well-known, but the curse of dimensionality has increased the interest of prac- titioners and theoreticians into generalization of those results for various estimators, calibrated for the high-dimension context. We propose to focus on inverse regression. It is known to be a reliable and efficient approach when the number of features exceeds the number of observations. Indeed, under some conditions, dealing with the inverse regression problem associated to a forward regression problem drastically reduces the number of parameters to estimate, makes the problem tractable and allows to consider more general distributions, as elliptical distributions. When both the responses and the covariates are multivariate, estimators constructed by the inverse regression are studied in this paper, the main result being explicit asymptotic prediction regions for the response. The performances of the proposed estimators and prediction regions are also analyzed through a simulation study and compared with usual estimators.
Fichier principal
Vignette du fichier
papier_IR (2).pdf (727.37 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01840234 , version 1 (16-07-2018)
hal-01840234 , version 2 (27-06-2019)
hal-01840234 , version 3 (11-12-2019)




  • HAL Id : hal-01840234 , version 3


Emilie Devijver, Emeline Perthame. Prediction regions through Inverse Regression. Journal of Machine Learning Research, 2020, 21 (113), pp.1-24. ⟨hal-01840234v3⟩
106 View
735 Download


Gmail Facebook X LinkedIn More