A Comprehensive Neural-Based Approach for Text Recognition in Videos using Natural Language Processing - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2011

A Comprehensive Neural-Based Approach for Text Recognition in Videos using Natural Language Processing

Khaoula Elagouni
  • Fonction : Auteur
  • PersonId : 914801
Pascale Sébillot

Résumé

This work aims at helping multimedia content understanding by deriving bene t from textual clues embedded in digital videos. For this, we developed a complete video Optical Character Recognition system (OCR), speci cally adapted to detect and recognize embedded texts in videos. Based on a neural approach, this new method outperforms related work, especially in terms of robustness to style and size variabilities, to background complexity and to low resolution of the image. A language model that drives several steps of the video OCR is also introduced in order to remove ambiguities due to a local letter by letter recognition and to reduce segmentation errors. This approach has been evaluated on a database of French TV news videos and achieves an outstanding character recognition rate of 95%, corresponding to 78% of words correctly recognized, which enables its incorporation into an automatic video indexing and retrieval system.
Fichier principal
Vignette du fichier
Paper_74.pdf (1.66 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00645219 , version 1 (27-11-2011)

Identifiants

  • HAL Id : hal-00645219 , version 1

Citer

Khaoula Elagouni, Christophe Garcia, Pascale Sébillot. A Comprehensive Neural-Based Approach for Text Recognition in Videos using Natural Language Processing. ACM International Conference on Multimedia Retrieval, ICMR, Apr 2011, Trento, Italy. 8 p., 2 columns. ⟨hal-00645219⟩
635 Consultations
640 Téléchargements

Partager

Gmail Facebook X LinkedIn More