Equivalence between LC-CRF and HMM, and discriminative computing of HMM-based MPM and MAP
Résumé
Practitioners have used hidden Markov models (HMMs) in different problems for about sixty years. Moreover, conditional random fields (CRFs) are an alternative to HMMs and appear in the literature as different and somewhat concurrent models. We propose two contributions: First, we show that the basic linear-chain CRFs (LC-CRFs), considered as different from HMMs, are in fact equivalent to HMMs in the sense that for each LC-CRF there exists an HMM-that we specifywhose posterior distribution is identical to the given LC-CRF. Second, we show that it is possible to reformulate the generative Bayesian classifiers maximum posterior mode (MPM) and maximum a posteriori (MAP), used in HMMs, as discriminative ones. The last point is of importance in many fields, especially in natural language processing (NLP), as it shows that in some situations dropping HMMs in favor of CRFs is not necessary.
Mots clés
hidden Markov model linear chain conditional random field Bayesian classifier discriminative classifier generative classifier maximum posterior mode maximum a posteriori
hidden Markov model
linear chain conditional random field
Bayesian classifier
discriminative classifier
generative classifier
maximum posterior mode
maximum a posteriori
Domaines
Mathématiques [math]Origine | Fichiers éditeurs autorisés sur une archive ouverte |
---|