Article Dans Une Revue Mathematical Methods of Statistics Année : 2003

ESTIMATION OF THE KULLBACK-LEIBLER DIVERGENCE

Résumé

The Kullback-Leibler (KL) divergence K(fl, P) between a set O of probability measures (PMs) on ]R d and some PM P cannot be estimated by K(O, Pn) when O contains PM whose support is not included in the support of the empirical measure Pn. We propose an estimation procedure which avoids any smoothing of Pn. Also we provide an estimate of the derivative of the projected measure with respect to P. We make use of the representation of the KL divergence in terms of the Fenchel-Le ge ndre transform of the moment generating function. As an application we introduce some new technique in parametric estimation, and also apply our results to updating problems.

Fichier principal
Vignette du fichier
MMS.pdf (2.31 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-04363067 , version 1 (23-12-2023)

Licence

Identifiants

  • HAL Id : hal-04363067 , version 1

Citer

M Broniatowski. ESTIMATION OF THE KULLBACK-LEIBLER DIVERGENCE. Mathematical Methods of Statistics, 2003, 12 (4), pp.391-409. ⟨hal-04363067⟩
346 Consultations
807 Téléchargements

Partager

  • More