Audiovisual Speech Source Separation: An overview of key methodologies
Résumé
The separation of speech signals measured at multiple microphones in noisy and reverberant environments using only the audio modality has limitations because there is generally insufficient information to fully dis- criminate the different sound sources. Humans miti- gate this problem by exploiting the visual modality, which is insensitive to background noise and can provide contextual information about the audio scene. This advantage has inspired the creation of the new field of audiovisual (AV) speech source separation that targets exploiting visual modality alongside the microphone measurements in a machine. Success in this emerging field will expand the application of voice- based machine interfaces, such as Siri,theintelligentpersonal assistant on the iPhone and iPad, to much more realis- tic settings and thereby provide more natural human-machine interfaces.
Origine | Fichiers produits par l'(les) auteur(s) |
---|
Loading...