Clustering repeated Out-Of-Vocabulary word tokens in order to model them for broadcast news transcription
Résumé
This paper describes a novel technique to detect repeated Out-Of-Vocabulary (OOV) word tokens in a LVCSR system used for transcribing broadcast news speech data. The system is composed of two blocks: an OOV word detector and a clustering module working on the detected OOV word segments. This combination allows a more reliable detection of repeated OOV words. In the paper we focus our attention on the second part of the system i.e. the clustering algorithm. This algorithm is based on the estimation of the entropy. The proposed clustering algorithm gives better performance than a classical baseline incremental clustering algorithm based on a distance threshold for OOV word tokens classification. Furthermore, the combination of OOV word token detector and clustering OOV segments can achieve better precision compared to the use of the OOV word detector alone.