Computationally-efficient initialisation of GPs: The generalised variogram method - Archive ouverte HAL
Pré-Publication, Document De Travail Année : 2022

Computationally-efficient initialisation of GPs: The generalised variogram method

Elsa Cazelles
Taco de Wolff
  • Fonction : Auteur
  • PersonId : 1102079

Résumé

We present a computationally-efficient strategy to find the hyperparameters of a Gaussian process (GP) avoiding the computation of the likelihood function. The found hyperparameters can then be used directly for regression or passed as initial conditions to maximum-likelihood (ML) training. Motivated by the fact that training a GP via ML is equivalent (on average) to minimising the KL-divergence between the true and learnt model, we set to explore different metrics/divergences among GPs that are computationally inexpensive and provide estimates close to those of ML. In particular, we identify the GP hyperparameters by matching the empirical covariance to a parametric candidate, proposing and studying various measures of discrepancy. Our proposal extends the Variogram method developed by the geostatistics literature and thus is referred to as the Generalised Variogram method (GVM). In addition to the theoretical presentation of GVM, we provide experimental validation in terms of accuracy, consistency with ML and computational complexity for different kernels using synthetic and real-world data.
Fichier principal
Vignette du fichier
tobar_cazelles_dewolff_TMLR2022.pdf (1.41 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03814966 , version 1 (17-10-2022)
hal-03814966 , version 2 (24-01-2023)
hal-03814966 , version 3 (05-05-2023)

Licence

Identifiants

Citer

Felipe Tobar, Elsa Cazelles, Taco de Wolff. Computationally-efficient initialisation of GPs: The generalised variogram method. 2022. ⟨hal-03814966v1⟩
180 Consultations
67 Téléchargements

Altmetric

Partager

More