Microphone Array Channel Combination Algorithms for Overlapped Speech Detection - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

Microphone Array Channel Combination Algorithms for Overlapped Speech Detection

Résumé

Overlapped speech occurs when multiple speakers are simultaneously active. This may lead to severe performance degradation in automatic speech processing systems such as speaker diarization. Overlapped speech detection (OSD) aims at detecting time segments in which several speakers are simultaneously active. Recent deep neural network architectures have shown impressive results in the close-talk scenario. However, performance tends to deteriorate in the context of distant speech. Microphone arrays are often considered under these conditions to record signals including spatial information. This paper investigates the use of the self-attention channel combinator (SACC) system as a feature extractor for OSD. This model is also extended in the complex space (cSACC) to improve the interpretability of the approach. Results show that distant OSD performance with self-attentive models gets closer to the nearfield condition. A detailed analysis of the cSACC combinationweights is also conducted showing that the self-attention module focuses attention on the speakers' direction.
Fichier principal
Vignette du fichier
220114_interspeech2022_reviewed.pdf (2.34 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03713385 , version 1 (05-07-2022)

Identifiants

  • HAL Id : hal-03713385 , version 1

Citer

Théo Mariotte, Anthony Larcher, Silvio Montrésor, Jean-Hugh Thomas. Microphone Array Channel Combination Algorithms for Overlapped Speech Detection. Interspeech 2022 Human and Humanizing Speech Technology, Sep 2022, Incheon, South Korea. ⟨hal-03713385⟩
207 Consultations
227 Téléchargements

Partager

Gmail Facebook X LinkedIn More