Bayesian analysis of constrained Gaussian processes - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Bayesian Analysis Année : 2024

Bayesian analysis of constrained Gaussian processes

Résumé

Due to their flexibility Gaussian processes are a well-known Bayesian framework for nonparametric function estimation. Integrating inequality constraints, such as monotonicity, convexity, and boundedness, into Gaussian process models significantly improves prediction accuracy and yields more realistic credible intervals in various real-world data applications. The Gaussian process approximation, originally proposed in [22] is considered. It satisfies interpolation conditions and handles a wide range of inequality constraints everywhere. Our contribution in this paper is threefold. First, we extend this approach to handle noisy observations and multiple, more general convex and non-convex constraints. Second, we propose new basis functions in order to extend the smoothness of sample paths to differentiability of class C^p , for any p ≥ 1. Third, we examine its behavior in specific scenarios such as monotonicity with flat regions and boundedness near lower and/or upper bounds. In that case, we show that, unlike the Maximum a posteriori (MAP) estimate, the mean a posteriori (mAP) estimate fails to capture flat regions. To address this issue, we propose incorporating multiple constraints, such as monotonicity with bounded slope constraints. According to the theoretical convergence and based on a variety of numerical experiments, the MAP estimate behaves well and outperforms the mAP estimate in terms of prediction accuracy. The performance of the proposed approach is confirmed through real-world data studies.
Fichier principal
Vignette du fichier
flat-problem.pdf (2.15 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04084865 , version 1 (28-04-2023)

Identifiants

  • HAL Id : hal-04084865 , version 1

Citer

Hassan Maatouk, Didier Rullière, Xavier Bay. Bayesian analysis of constrained Gaussian processes. Bayesian Analysis, In press. ⟨hal-04084865⟩
70 Consultations
119 Téléchargements

Partager

Gmail Facebook X LinkedIn More