Multi-microphone Automatic Speech Segmentation in Meetings Based on Circular Harmonics Features - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Multi-microphone Automatic Speech Segmentation in Meetings Based on Circular Harmonics Features

Résumé

Speaker diarization is the task of answering Who spoke and when? in an audio stream. Pipeline systems rely on speech segmentation to extract speakers' segments and achieve robust speaker diarization. This paper proposes a common framework to solve three segmentation tasks in the distant speech scenario: Voice Activity Detection (VAD), Overlapped Speech Detection (OSD), and Speaker Change Detection (SCD). In the literature, a few studies investigate the multi-microphone distant speech scenario. In this work, we propose a new set of spatial features based on direction-of-arrival estimations in the circular harmonic domain (CH-DOA). These spatial features are extracted from multi-microphone audio data and combined with standard acoustic features. Experiments on the AMI meeting corpus show that CH-DOA can improve the segmentation while being robust in the case of deactivated microphones.
Fichier principal
Vignette du fichier
2023_insterspeech_mariotte.pdf (378.57 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04117442 , version 1 (05-06-2023)

Identifiants

Citer

Théo Mariotte, Anthony Larcher, Silvio Montrésor, Jean-Hugh Thomas. Multi-microphone Automatic Speech Segmentation in Meetings Based on Circular Harmonics Features. Interspeech 2023, international Speech Communication Association (ISCA), Aug 2023, Dublin, Ireland. ⟨hal-04117442⟩
19 Consultations
22 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More