Automatic subtitle synchronization and positioning system dedicated to deaf and hearing impaired people - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue IEEE Access Année : 2021

Automatic subtitle synchronization and positioning system dedicated to deaf and hearing impaired people

Résumé

In this paper, we introduce a subtitle synchronization and positioning system designed to increase the accessibility of deaf and hearing impaired people to multimedia documents. The main contributions of the paper concern: a novel synchronization algorithm able to robustly align, without any human intervention, the closed caption with the audio transcript and a timestamp refinement technique that adjusts the subtitle segments duration with respect to the audiovisual recommendations. Finally, we introduce a novel method that performs a high level understanding of the multimedia content, in order to determine the subtitle optimal positions, within the video frame, such that they do not overlap with other relevant textual information. The experimental evaluation performed on a large dataset of 30 videos taken from the French national television validates the approach with average accuracy scores superior to 90% regardless on the video genre. The subjective evaluation of the proposed subtitle synchronization and positioning system, performed with actual hearing impaired people, demonstrates the effectiveness of our approach.

Dates et versions

hal-03585419 , version 1 (23-02-2022)

Licence

Paternité

Identifiants

Citer

Bogdan Mocanu, Ruxandra Tapu. Automatic subtitle synchronization and positioning system dedicated to deaf and hearing impaired people. IEEE Access, 2021, 9, pp.139544-139555. ⟨10.1109/ACCESS.2021.3119201⟩. ⟨hal-03585419⟩
25 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More