Low-latency speaker spotting with online diarization and detection - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2018

Low-latency speaker spotting with online diarization and detection

Résumé

This paper introduces a new task termed low-latency speaker spotting (LLSS). Related to security and intelligence applications, the task involves the detection, as soon as possible, of known speakers within multi-speaker audio streams. The paper describes differences to the established fields of speaker diarization and automatic speaker verification and proposes a new protocol and metrics to support exploration of LLSS. These can be used together with an existing, publicly available database to assess the performance of LLSS solutions also proposed in the paper. They combine online diarization and speaker detection systems. Diarization systems include a naive, over-segmentation approach and fully-fledged online diarization using segmental i-vectors. Speaker detection is performed using Gaussian mixture models, i-vectors or neural speaker embeddings. Metrics reflect different approaches to characterise latency in addition to detection performance. The relative performance of each solution is dependent on latency. When higher latency is admissible, i-vector solutions perform well; embeddings excel when latency must be kept to a minimum. With a need to improve the reliability of online diarization and detection, the proposed LLSS framework provides a vehicle to fuel future research in both areas. In this respect, we embrace a reproducible research policy; results can be readily reproduced using publicly available resources and open source codes.
Fichier non déposé

Dates et versions

hal-01836490 , version 1 (12-07-2018)

Identifiants

  • HAL Id : hal-01836490 , version 1

Citer

Jose Patino, Ruiqing Yin, H'Ector Delgado, Hervé Bredin, Alain Komaty, et al.. Low-latency speaker spotting with online diarization and detection. The Speaker and Language Recognition Workshop, ISCA, Jun 2018, Les Sables d'Olonne, France. ⟨hal-01836490⟩
138 Consultations
0 Téléchargements

Partager

Gmail Facebook X LinkedIn More