Communication Dans Un Congrès Année : 2025

LOCALIZE, FILTER, SEGMENT: TOWARDS MULTI-MICROPHONE SPEAKER SEGMENTATION

Résumé

Speaker Diarization addresses the question of Who spoke and when? -a crucial task in conversational AI. We propose Localize, Filter, Segment (LoFi-Seg), a novel framework for speaker segmentation in multi-microphone setups. LoFi-Seg consists of three modules: a direction-of-arrival (DOA) estimator, a spatial filter bank (beamforming), and a Voice Activity Detection (VAD) model. The framework processes multichannel audio by steering beamformers-one per speaker-toward predicted directions from the DOA module. The output of each beamformer is then passed through the VAD model to determine speaker activity. Combining explicit DoA estimation and VAD improves the model transparency, thus preserving physical interpretability during multichannel filtering. We validate LoFi-Seg through experiments on simulated multi-speaker, multi-microphone conversations, where speaker positions and acoustic conditions are controlled. The system is evaluated on speaker segmentation performance, with additional assessments of speaker localization performance drift across setups. This approach demonstrates how LoFi-Seg combines robust speaker segmentation with interpretable processing, making it a valuable tool for advancing speaker diarization in complex audio environments.

Fichier principal
Vignette du fichier
FA2025_steered_beamforming-4.pdf (737.3 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-05052460 , version 1 (30-04-2025)

Licence

Identifiants

Citer

Théo Mariotte. LOCALIZE, FILTER, SEGMENT: TOWARDS MULTI-MICROPHONE SPEAKER SEGMENTATION. Forum Acusticum Euronoise 2025, Jun 2025, Malaga, Spain. pp.5221-5228, ⟨10.61782/fa.2025.0526⟩. ⟨hal-05052460⟩
380 Consultations
189 Téléchargements

Altmetric

Partager

  • More