Audio synchronisation with a tunnel matrix for time series and dynamic programming - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2015

Audio synchronisation with a tunnel matrix for time series and dynamic programming

Résumé

Precise multimodal studies require precise synchronisation between audio and video signals. However, raw audio and audio from video recordings can be out of sync for several reasons. In order to re-synchronise them, a dynamic programming (DP) approach is presented here. Traditionally, DP is performed on the rectangular distance matrix comparing each value in signal A with each value in signal B. Previous work limited the search space using for example the Sakoe Chiba Band (Sakoe and Chiba, 1978). However, the overall space of the distance matrix remains identical. Here, a tunnel matrix and its according DP-algorithm are presented. The matrix contains merely the computed distance of two signals to a pre-specified bandwidth and the computational cost is equally reduced. An example implementation demonstrates the functionality on artificial data and on data from real audio and video recordings.
Fichier principal
Vignette du fichier
ICASSP2014_Template.pdf (195.41 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01231887 , version 1 (21-11-2015)

Identifiants

  • HAL Id : hal-01231887 , version 1

Citer

Jan Gorisch, Laurent Prevot. Audio synchronisation with a tunnel matrix for time series and dynamic programming. 40th IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2015, Brisbane, Australia. ⟨hal-01231887⟩
100 Consultations
204 Téléchargements

Partager

Gmail Facebook X LinkedIn More