Audio synchronisation with a tunnel matrix for time series and dynamic programming - Archive ouverte HAL Access content directly
Conference Papers Year : 2015

Audio synchronisation with a tunnel matrix for time series and dynamic programming

Abstract

Precise multimodal studies require precise synchronisation between audio and video signals. However, raw audio and audio from video recordings can be out of sync for several reasons. In order to re-synchronise them, a dynamic programming (DP) approach is presented here. Traditionally, DP is performed on the rectangular distance matrix comparing each value in signal A with each value in signal B. Previous work limited the search space using for example the Sakoe Chiba Band (Sakoe and Chiba, 1978). However, the overall space of the distance matrix remains identical. Here, a tunnel matrix and its according DP-algorithm are presented. The matrix contains merely the computed distance of two signals to a pre-specified bandwidth and the computational cost is equally reduced. An example implementation demonstrates the functionality on artificial data and on data from real audio and video recordings.
Fichier principal
Vignette du fichier
ICASSP2014_Template.pdf (195.41 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01231887 , version 1 (21-11-2015)

Identifiers

  • HAL Id : hal-01231887 , version 1

Cite

Jan Gorisch, Laurent Prevot. Audio synchronisation with a tunnel matrix for time series and dynamic programming. 40th IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2015, Brisbane, Australia. ⟨hal-01231887⟩
93 View
192 Download

Share

Gmail Facebook Twitter LinkedIn More