Enriching confusion networks for post-processing - Archive ouverte HAL Access content directly
Conference Papers Year :

Enriching confusion networks for post-processing


The paper proposes a new approach for a posteriori enrichment of automatic speech recognition (ASR) confusion networks (CNs). CNs are usually needed to decrease word error rate and to compute confidence measures, but they are also used in many ways in order to improve post-processing of ASR outputs. For instance, they can be helpfully used to propose alternative word hypotheses when ASR outputs are corrected by a human on post-edition. However, CNs bins do not have a fixed length, and sometimes contain only one or two word hypotheses: in this case the number of alternatives to correct a misrecognized word is very low, reducing the chance of helping the human annotator. Our approach for CN enrichment is based on a new similarity measure presented in this paper, computed from acoustic and linguistic word embeddings, that allows us to take into consideration both acoustic and linguistic similarities between two words. Experimental results show that our approach is relevant: enriched CNs (for a bin size equals to 6) increase the potential correction of erroneous words by 23% than initial CNs produced by an ASR system. In our experiments, a spoken language understanding task is also targeted. Index Terms: Confusion networks, post processing, acoustic and linguistic word em-beddings, similarity measure.
Fichier principal
Vignette du fichier
enriching-confusion-networks.pdf (296.35 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01585768 , version 1 (12-09-2017)


  • HAL Id : hal-01585768 , version 1


Sahar Ghannay, Yannick Estève, Nathalie Camelin. Enriching confusion networks for post-processing. Statistical Language and Speech Processing 2017, Oct 2017, Le Mans, France. ⟨hal-01585768⟩
208 View
224 Download


Gmail Facebook Twitter LinkedIn More